Penalized likelihood estimation and iterative Kalman smoothing for non-Gaussian dynamic regression models. Fahrmeir, L. & Wagenpfeil, S. Computational Statistics & Data Analysis, 24:295–320, 1997.
Penalized likelihood estimation and iterative Kalman smoothing for non-Gaussian dynamic regression models [link]Paper  doi  abstract   bibtex   
Dynamic regression or state space models provide a flexible framework for analyzing non-Gaussian time series and longitudinal data, covering for example models for discrete longitudinal observations. As for non-Gaussian random coefficient models, a direct Bayesian approach leads to numerical integration problems, often intractable for more complicated data sets. Recent Markov chain Monte Carlo methods avoid this by repeated sampling from approximative posterior distributions, but there are still open questions about sampling schemes and convergence. In this article we consider simpler methods of inference based on posterior modes or, equivalently, maximum penalized likelihood estimation. From the latter point of view, the approach can also be interpreted as a nonparametric method for smoothing time-varying coefficients. Efficient smoothing algorithms are obtained by iteration of common linear Kalman filtering and smoothing, in the same way as estimation in generalized linear models with fixed effects can be performed by iteratively weighted least squares estimation. The algorithm can be combined with an EM-type method or cross-validation to estimate unknown hyper- or smoothing parameters. The approach is illustrated by applying to a binary time series and a multicategorical longitudinal data set.
@article{fahrmeir_penalized_1997,
	title = {Penalized likelihood estimation and iterative {Kalman} smoothing for non-{Gaussian} dynamic regression models},
	volume = {24},
	issn = {0167-9473},
	url = {http://www.sciencedirect.com/science/article/B6V8V-3SWY0KM-4/2/620424204f929b2e30bd4ec08b6ce02e},
	doi = {10.1016/S0167-9473(96)00064-3},
	abstract = {Dynamic regression or state space models provide a flexible framework for analyzing non-Gaussian time series and longitudinal data, covering for example models for discrete longitudinal observations. As for non-Gaussian random coefficient models, a direct Bayesian approach leads to numerical integration problems, often intractable for more complicated data sets. Recent Markov chain Monte Carlo methods avoid this by repeated sampling from approximative posterior distributions, but there are still open questions about sampling schemes and convergence. In this article we consider simpler methods of inference based on posterior modes or, equivalently, maximum penalized likelihood estimation. From the latter point of view, the approach can also be interpreted as a nonparametric method for smoothing time-varying coefficients. Efficient smoothing algorithms are obtained by iteration of common linear Kalman filtering and smoothing, in the same way as estimation in generalized linear models with fixed effects can be performed by iteratively weighted least squares estimation. The algorithm can be combined with an EM-type method or cross-validation to estimate unknown hyper- or smoothing parameters. The approach is illustrated by applying to a binary time series and a multicategorical longitudinal data set.},
	urldate = {2010-08-06},
	journal = {Computational Statistics \& Data Analysis},
	author = {Fahrmeir, L. and Wagenpfeil, S.},
	year = {1997},
	keywords = {Discrete observations, Hyperparameter estimation, Non-Gaussian longitudinal data, Smoothing, State space models, Time-varying coefficients},
	pages = {295--320}
}

Downloads: 0