Bayesian Filtering and Smoothing

Filtering and smoothing methods are used to produce an accurate estimate of the state of a time-varying system based on multiple observational inputs (data). Interest in these methods has exploded in recent years, with numerous applications emerging in fields such as navigation, aerospace engineering, telecommunications and medicine. This compact, informal introduction for graduate students and advanced undergraduates presents the current state-of-the-art filtering and smoothing methods in a unified Bayesian framework. Readers learn what non-linear Kalman filters and particle filters are, how they are related, and their relative advantages and disadvantages. They also discover how state-of-the-art Bayesian parameter estimation methods can be combined with state-of-the-art filtering and smoothing algorithms. The book's practical and algorithmic approach assumes only modest mathematical prerequisites. Examples include MATLAB computations, and the numerous end-of-chapter exercises include computational assignments. MATLAB/GNU Octave source code is available for download at www.cambridge.org/sarkka, promoting hands-on work with the methods.

[1]  A. O'Hagan,et al.  Bayes–Hermite quadrature , 1991 .

[2]  Jouko Lampinen,et al.  Time series prediction by Kalman smoother with cross-validated noise density , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[3]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[4]  Nando de Freitas,et al.  Rao-Blackwellised Particle Filtering via Data Augmentation , 2001, NIPS.

[5]  Simo Särkkä,et al.  Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations , 2009, IEEE Transactions on Automatic Control.

[6]  S. Sarkka,et al.  Application of Girsanov Theorem to Particle Filtering of Discretely Observed Continuous - Time Non-Linear Systems , 2007, 0705.1598.

[7]  Matti S Hämäläinen,et al.  Dynamic magnetic resonance inverse imaging of human brain function , 2006, Magnetic resonance in medicine.

[8]  Thomas B. Schön,et al.  Marginalized particle filters for mixed linear/nonlinear state-space models , 2005, IEEE Transactions on Signal Processing.

[9]  Simo Särkkä,et al.  Recursive outlier-robust filtering and smoothing for nonlinear systems using the multivariate student-t distribution , 2012, 2012 IEEE International Workshop on Machine Learning for Signal Processing.

[10]  Cornelius T. Leondes,et al.  Nonlinear Smoothing Theory , 1970, IEEE Trans. Syst. Sci. Cybern..

[11]  Aki Vehtari,et al.  Dynamic retrospective filtering of physiological noise in BOLD fMRI: DRIFTER , 2012, NeuroImage.

[12]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series, with Engineering Applications , 1949 .

[13]  Simo Särkkä,et al.  On Unscented Kalman Filtering for State Estimation of Continuous-Time Nonlinear Systems , 2007, IEEE Trans. Autom. Control..

[14]  Geir Storvik,et al.  Particle filters for state-space models with the presence of unknown static parameters , 2002, IEEE Trans. Signal Process..

[15]  M. Keeling,et al.  Modeling Infectious Diseases in Humans and Animals , 2007 .

[16]  Albert Tarantola,et al.  Inverse problem theory - and methods for model parameter estimation , 2004 .

[17]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[18]  Lennart Ljung,et al.  Identification of Hammerstein-Wiener models , 2013, Autom..

[19]  S. Haykin Kalman Filtering and Neural Networks , 2001 .

[20]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[21]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[22]  John B. Moore,et al.  Discrete-time fixed-lag smoothing algorithms , 1973 .

[23]  Thomas B. Schön,et al.  System identification of nonlinear state-space models , 2011, Autom..

[24]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[25]  Rudolph van der Merwe,et al.  The Unscented Kalman Filter , 2002 .

[26]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[27]  Miroslav Šimandl,et al.  DESIGN OF DERIVATIVE-FREE SMOOTHERS AND PREDICTORS , 2006 .

[28]  S. Haykin,et al.  Cubature Kalman Filters , 2009, IEEE Transactions on Automatic Control.

[29]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[30]  D. Fraser,et al.  The optimum linear smoother as a combination of two optimum linear filters , 1969 .

[31]  Peter J. W. Rayner,et al.  Digital Audio Restoration: A Statistical Model Based Approach , 1998 .

[32]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[33]  Lawrence D. Stone,et al.  Bayesian Multiple Target Tracking , 1999 .

[34]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[35]  Fredrik Lindsten,et al.  Rao-Blackwellised particle methods for inference and identification , 2011 .

[36]  Simo Särkkä,et al.  Fourier-Hermite Rauch-Tung-Striebel smoother , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[37]  David Barber,et al.  Expectation Correction for Smoothed Inference in Switching Linear Dynamical Systems , 2006, J. Mach. Learn. Res..

[38]  Ville Juhana Väänänen,et al.  Gaussian filtering and smoothing based parameter estimation in nonlinear models for sequential data , 2012 .

[39]  Samuel S. Blackman,et al.  Design and Analysis of Modern Tracking Systems , 1999 .

[40]  Arnaud Doucet,et al.  On the use and misuse of particle filtering in digital communications , 2002, 2002 11th European Signal Processing Conference.

[41]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[42]  Simo Särkkä,et al.  Recursive Bayesian inference on stochastic differential equations , 2006 .

[43]  Heikki Haario,et al.  Adaptive proposal distribution for random walk Metropolis algorithm , 1999, Comput. Stat..

[44]  David G. Luenberger,et al.  Linear and nonlinear programming , 1984 .

[45]  Simo Särkkä,et al.  Infinite-Dimensional Kalman Filtering Approach to Spatio-Temporal Gaussian Process Regression , 2012, AISTATS.

[46]  G. Kitagawa Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[47]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[48]  Carl E. Rasmussen,et al.  Robust Filtering and Smoothing with Gaussian Processes , 2012, IEEE Transactions on Automatic Control.

[49]  Rudolph van der Merwe,et al.  Sigma-point kalman filters for probabilistic inference in dynamic state-space models , 2004 .

[50]  Tom Heskes,et al.  Novel approximations for inference in nonlinear dynamical systems using expectation propagation , 2005, Neurocomputing.

[51]  S. Duane,et al.  Hybrid Monte Carlo , 1987 .

[52]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[53]  Olaf Hauk,et al.  Keep it simple: a case for using classical minimum norm estimation in the analysis of EEG and MEG data , 2004, NeuroImage.

[54]  David Barber Bayesian Time Series Models: Approximate inference in switching linear dynamical systems using Gaussian mixtures , 2011 .

[55]  Brian D. O. Anderson,et al.  On the stability of fixed-lag smoothing algorithms , 1971 .

[56]  Henry Cox,et al.  On the estimation of state variables and parameters for noisy dynamic systems , 1964 .

[57]  Hugh F. Durrant-Whyte,et al.  A new method for the nonlinear transformation of means and covariances in filters and estimators , 2000, IEEE Trans. Autom. Control..

[58]  R. S. Miyasako,et al.  Application of fixed point smoothing to the calibration, alignment and navigation data of inertial navigation systems , 1988, IEEE PLANS '88.,Position Location and Navigation Symposium, Record. 'Navigation into the 21st Century'..

[59]  B. Øksendal Stochastic differential equations : an introduction with applications , 1987 .

[60]  Simo Särkkä,et al.  On Gaussian Optimal Smoothing of Non-Linear State Space Models , 2010, IEEE Transactions on Automatic Control.

[61]  Xiao-Li Hu,et al.  A General Convergence Result for Particle Filtering , 2011, IEEE Transactions on Signal Processing.

[62]  J. Susan Milton,et al.  Introduction to Probability and Statistics: Principles and Applications for Engineering and the Computing Sciences , 1990 .

[63]  Uwe D. Hanebeck,et al.  Analytic moment-based Gaussian process filtering , 2009, ICML '09.

[64]  H.F. Durrant-Whyte,et al.  A new approach for filtering nonlinear systems , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[65]  J. Huang,et al.  Curse of dimensionality and particle filters , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[66]  P. Fearnhead,et al.  On‐line inference for hidden Markov models via particle filters , 2003 .

[67]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[68]  P. Bickel,et al.  Obstacles to High-Dimensional Particle Filtering , 2008 .

[69]  C. Striebel,et al.  Partial differential equations for the conditional distribution of a Markov process given noisy observations , 1965 .

[70]  Xiao-Li Hu,et al.  A Basic Convergence Result for Particle Filtering , 2008, IEEE Transactions on Signal Processing.

[71]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[72]  P. Fearnhead Markov chain Monte Carlo, Sufficient Statistics, and Particle Filters , 2002 .

[73]  Thomas Kailath,et al.  Square-root algorithms for the continuous-time linear least squares estimation problem , 1977 .

[74]  Hermann Singer Continuous-discrete state-space modeling of panel data with nonlinear filter algorithms , 2011 .

[75]  E. Somersalo,et al.  Statistical and computational inverse problems , 2004 .

[76]  Andrew P. Sage,et al.  Estimation theory with applications to communications and control , 1979 .

[77]  Amos J. Storkey,et al.  Particle Smoothing in Continuous Time: A Fast Approach via Density Estimation , 2011, IEEE Trans. Signal Process..

[78]  Arnaud Doucet,et al.  A survey of convergence results on particle filtering methods for practitioners , 2002, IEEE Trans. Signal Process..

[79]  Fredrik Gustafsson,et al.  Some Relations Between Extended and Unscented Kalman Filters , 2012, IEEE Transactions on Signal Processing.

[80]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[81]  Kazufumi Ito,et al.  Gaussian filters for nonlinear filtering problems , 2000, IEEE Trans. Autom. Control..

[82]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[83]  R. L. Stratonovich Conditional Markov Processes and their Application to the Theory of Optimal Control , 1968 .

[84]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[85]  Simon J. Godsill,et al.  Monte Carlo smoothing with application to audio signal enhancement , 2002, IEEE Trans. Signal Process..

[86]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[87]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[88]  J. Junkins,et al.  Optimal Estimation of Dynamic Systems , 2004 .

[89]  Simo Särkkä,et al.  Parameter estimation in stochastic differential equations with Markov chain Monte Carlo and non-linear Kalman filtering , 2013, Comput. Stat..

[90]  Andrew Gelman,et al.  Handbook of Markov Chain Monte Carlo , 2011 .

[91]  Lennart Svensson,et al.  Moment Estimation Using a Marginalized Transform , 2012, IEEE Transactions on Signal Processing.

[92]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[93]  Simo Särkkä,et al.  Fourier-Hermite Kalman Filter , 2012, IEEE Transactions on Automatic Control.

[94]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[95]  Niels Kjølstad Poulsen,et al.  New developments in state estimation for nonlinear systems , 2000, Autom..

[96]  Jun S. Liu,et al.  Blind Deconvolution via Sequential Imputations , 1995 .

[97]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[98]  Drew D. Creal A Survey of Sequential Monte Carlo Methods for Economics and Finance , 2012 .

[99]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .

[100]  James S. Meditch,et al.  Stochastic Optimal Linear Estimation and Control , 1969 .

[101]  Arthur Gelb,et al.  Multiple-Input Describing Functions and Nonlinear System Design , 1968 .

[102]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[103]  John B. Moore,et al.  Fixed-lag smoothing for nonlinear systems with discrete measurements , 1973, Inf. Sci..

[104]  Simon Haykin,et al.  Cubature Kalman Filtering for Continuous-Discrete Systems: Theory and Simulations , 2010, IEEE Transactions on Signal Processing.

[105]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[106]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[107]  E. Weinstein,et al.  A new method for evaluating the log-likelihood gradient, the Hessian, and the Fisher information matrix for linear dynamic systems , 1989, IEEE Trans. Inf. Theory.

[108]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[109]  Petar M. Djuric,et al.  Sequential particle filtering in the presence of additive Gaussian noise with unknown parameters , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[110]  Gene H. Golub,et al.  Calculation of Gauss quadrature rules , 1967, Milestones in Matrix Computation.

[111]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[112]  Y. Ho,et al.  A Bayesian approach to problems in stochastic estimation and control , 1964 .

[113]  S. Roweis,et al.  Learning Nonlinear Dynamical Systems Using the Expectation–Maximization Algorithm , 2001 .

[114]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[115]  Jouni Hartikainen,et al.  Kalman filtering and smoothing solutions to temporal Gaussian process regression models , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[116]  Jouni Hartikainen,et al.  Sigma point methods in optimal smoothing of non-linear stochastic state space models , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[117]  S. Godsill,et al.  A Backward-Simulation Based Rao-Blackwellized Particle Smoother for Conditionally Linear Gaussian Models , 2012 .

[118]  Hiromitsu Kumamoto,et al.  Random sampling approach to state estimation in switching environments , 1977, Autom..

[119]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[120]  Elliott D. Kaplan Understanding GPS : principles and applications , 1996 .

[121]  Kaare Brandt Petersen,et al.  State-Space Models: From the EM Algorithm to a Gradient Approach , 2007, Neural Computation.

[122]  Herman Bruyninckx,et al.  Comment on "A new method for the nonlinear transformation of means and covariances in filters and estimators" [with authors' reply] , 2002, IEEE Trans. Autom. Control..

[123]  Radford M. Neal MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[124]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[125]  Fredrik Gustafsson,et al.  Marginalized particle filters for Bayesian estimation of Gaussian noise parameters , 2010, 2010 13th International Conference on Information Fusion.

[126]  Walerian Kipiniak,et al.  Optimal Estimation, Identification, and Control , 1964 .

[127]  S. Särkkä,et al.  On Continuous-Discrete Cubature Kalman Filtering , 2012 .

[128]  G. Kitagawa The two-filter formula for smoothing and an implementation of the Gaussian-sum smoother , 1994 .

[129]  Christophe Andrieu,et al.  A tutorial on adaptive MCMC , 2008, Stat. Comput..

[130]  Jun S. Liu,et al.  Mixture Kalman filters , 2000 .

[131]  J. Rosenthal,et al.  Optimal scaling for various Metropolis-Hastings algorithms , 2001 .

[132]  A. Jazwinski Filtering for nonlinear dynamical systems , 1966 .

[133]  Hermann Singer Nonlinear continuous time modeling approaches in panel research , 2008 .

[134]  Robin J. Evans,et al.  Fundamentals of Object Tracking , 2011 .

[135]  Simo Särkkä,et al.  Gaussian filtering and smoothing for continuous-discrete dynamic systems , 2013, Signal Process..

[136]  John B. Moore,et al.  Fixed-lag demodulation of discrete noisy measurements of FM signals , 1973 .

[137]  Sumeetpal S. Singh,et al.  Particle approximations of the score and observed information matrix in state space models with application to parameter estimation , 2011 .

[138]  A. Doucet,et al.  Monte Carlo Smoothing for Nonlinear Time Series , 2004, Journal of the American Statistical Association.

[139]  Rudolph van der Merwe,et al.  The square-root unscented Kalman filter for state and parameter-estimation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[140]  Eduardo Mario Nebot,et al.  An outlier-robust Kalman filter , 2011, 2011 IEEE International Conference on Robotics and Automation.

[141]  Simo Särkkä,et al.  Linear Operators and Stochastic Partial Differential Equations in Gaussian Process Regression , 2011, ICANN.

[142]  H. Rauch Solutions to the linear smoothing problem , 1963 .

[143]  Robert J. Elliott,et al.  Discrete-Time Nonlinear Filtering Algorithms Using Gauss–Hermite Quadrature , 2007, Proceedings of the IEEE.

[144]  Brett Ninness,et al.  Bayesian system identification via Markov chain Monte Carlo techniques , 2010, Autom..

[145]  Yuanxin Wu,et al.  Unscented Kalman filtering for additive noise case: augmented versus nonaugmented , 2005, IEEE Signal Processing Letters.

[146]  Christophe Andrieu,et al.  Particle methods for change detection, system identification, and control , 2004, Proceedings of the IEEE.

[147]  Mohinder S. Grewal,et al.  Global Positioning Systems, Inertial Navigation, and Integration , 2000 .

[148]  Arnaud Doucet,et al.  An overview of sequential Monte Carlo methods for parameter estimation in general state-space models , 2009 .

[149]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[150]  Aurélien Garivier,et al.  Sequential Monte Carlo smoothing for general state space hidden Markov models , 2011, 1202.2945.

[151]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[152]  Matti Vihola,et al.  Robust adaptive Metropolis algorithm with coerced acceptance rate , 2010, Stat. Comput..

[153]  Simon Haykin,et al.  Cubature Kalman smoothers , 2011, Autom..

[154]  A. Doucet,et al.  Smoothing algorithms for state–space models , 2010 .

[155]  Jouko Lampinen,et al.  Rao-Blackwellized particle filter for multiple target tracking , 2007, Inf. Fusion.

[156]  Yuanxin Wu,et al.  A Numerical-Integration Perspective on Gaussian Filters , 2006, IEEE Transactions on Signal Processing.

[157]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[158]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[159]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[160]  Simo Särkkä,et al.  Unscented Rauch-Tung-Striebel Smoother , 2008, IEEE Trans. Autom. Control..

[161]  Jouko Lampinen,et al.  State space regularization in the nonstationary inverse problem for diffuse optical tomography , 2011 .

[162]  Gene H. Golub,et al.  Matrix computations , 1983 .

[163]  Simo Särkkä,et al.  Continuous-time and continuous-discrete-time unscented Rauch-Tung-Striebel smoothers , 2010, Signal Process..

[164]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[165]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[166]  R. Mehra,et al.  Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculations , 1974 .