Bayesian Filtering and Smoothing

Filtering and smoothing methods are used to produce an accurate estimate of the state of a time-varying system based on multiple observational inputs (data). Interest in these methods has exploded in recent years, with numerous applications emerging in fields such as navigation, aerospace engineering, telecommunications, and medicine. This compact, informal introduction for graduate students and advanced undergraduates presents the current state-of-the-art filtering and smoothing methods in a unified Bayesian framework. Readers learn what non-linear Kalman filters and particle filters are, how they are related, and their relative advantages and disadvantages. They also discover how state-of-the-art Bayesian parameter estimation methods can be combined with state-of-the-art filtering and smoothing algorithms. The book’s practical and algorithmic approach assumes only modest mathematical prerequisites. Examples include MATLAB computations, and the numerous end-of-chapter exercises include computational assignments. MATLAB/GNU Octave source code is available for download at www.cambridge.org/sarkka, promoting hands-on work with the methods.

[1]  Simo Särkkä,et al.  Fourier-Hermite Rauch-Tung-Striebel smoother , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[2]  Chongzhao Han,et al.  The square root unscented Kalman filter formulation of risk-sensitive filter , 2008, 2008 11th International Conference on Information Fusion.

[3]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[4]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[5]  Jouko Lampinen,et al.  State space regularization in the nonstationary inverse problem for diffuse optical tomography , 2011 .

[6]  Carl E. Rasmussen,et al.  Robust Filtering and Smoothing with Gaussian Processes , 2012, IEEE Transactions on Automatic Control.

[7]  Victor C. M. Leung,et al.  Unscented Rauch--Tung--Striebel Smoother , 2008, IEEE Transactions on Automatic Control.

[8]  Thomas B. Schön,et al.  Marginalized particle filters for mixed linear/nonlinear state-space models , 2005, IEEE Transactions on Signal Processing.

[9]  Simo Särkkä,et al.  Recursive outlier-robust filtering and smoothing for nonlinear systems using the multivariate student-t distribution , 2012, 2012 IEEE International Workshop on Machine Learning for Signal Processing.

[10]  N. Ward Understanding GPS — Principles and Applications . Elliott D. Kaplan (Editor). £75. ISBN: 0-89006-793-7. Artech House Publishers, Boston & London. 1996. , 1997, Journal of Navigation.

[11]  A. O'Hagan,et al.  Bayes–Hermite quadrature , 1991 .

[12]  John B. Moore,et al.  Discrete-time fixed-lag smoothing algorithms , 1973 .

[13]  Drew D. Creal A Survey of Sequential Monte Carlo Methods for Economics and Finance , 2012 .

[14]  Tom Heskes,et al.  Expectation propagation and generalised EP methods for inference in switching linear dynamical systems , 2011 .

[15]  Heikki Haario,et al.  Adaptive proposal distribution for random walk Metropolis algorithm , 1999, Comput. Stat..

[16]  Gene H. Golub,et al.  Matrix computations , 1983 .

[17]  Simon Haykin,et al.  Cubature Kalman smoothers , 2011, Autom..

[18]  P. Fearnhead Markov chain Monte Carlo, Sufficient Statistics, and Particle Filters , 2002 .

[19]  A. Doucet,et al.  Smoothing algorithms for state–space models , 2010 .

[20]  Thomas Kailath,et al.  Square-root algorithms for the continuous-time linear least squares estimation problem , 1977 .

[21]  Arthur Gelb,et al.  Multiple-Input Describing Functions and Nonlinear System Design , 1968 .

[22]  Arnaud Doucet,et al.  A survey of convergence results on particle filtering methods for practitioners , 2002, IEEE Trans. Signal Process..

[23]  Christophe Andrieu,et al.  Particle methods for change detection, system identification, and control , 2004, Proceedings of the IEEE.

[24]  Mohinder S. Grewal,et al.  Global Positioning Systems, Inertial Navigation, and Integration , 2000 .

[25]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[26]  Thomas B. Schön,et al.  Estimation of general nonlinear state-space systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[27]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[28]  Yuanxin Wu,et al.  Unscented Kalman filtering for additive noise case: augmented vs. non-augmented , 2005, Proceedings of the 2005, American Control Conference, 2005..

[29]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[30]  E. Weinstein,et al.  A new method for evaluating the log-likelihood gradient, the Hessian, and the Fisher information matrix for linear dynamic systems , 1989, IEEE Trans. Inf. Theory.

[31]  Jouko Lampinen,et al.  Rao-Blackwellized particle filter for multiple target tracking , 2007, Inf. Fusion.

[32]  Yuanxin Wu,et al.  A Numerical-Integration Perspective on Gaussian Filters , 2006, IEEE Transactions on Signal Processing.

[33]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[34]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[35]  John B. Moore,et al.  Fixed-lag smoothing for nonlinear systems with discrete measurements , 1973, Inf. Sci..

[36]  Miroslav Šimandl,et al.  DESIGN OF DERIVATIVE-FREE SMOOTHERS AND PREDICTORS , 2006 .

[37]  D. Fraser,et al.  The optimum linear smoother as a combination of two optimum linear filters , 1969 .

[38]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[39]  Lawrence D. Stone,et al.  Bayesian Multiple Target Tracking , 1999 .

[40]  David Barber Bayesian Time Series Models: Approximate inference in switching linear dynamical systems using Gaussian mixtures , 2011 .

[41]  Hugh F. Durrant-Whyte,et al.  A new method for the nonlinear transformation of means and covariances in filters and estimators , 2000, IEEE Trans. Autom. Control..

[42]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[43]  Petar M. Djuric,et al.  Sequential particle filtering in the presence of additive Gaussian noise with unknown parameters , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[44]  Simo Särkkä,et al.  Infinite-Dimensional Kalman Filtering Approach to Spatio-Temporal Gaussian Process Regression , 2012, AISTATS.

[45]  A. Jazwinski Filtering for nonlinear dynamical systems , 1966 .

[46]  S. Sarkka,et al.  Application of Girsanov Theorem to Particle Filtering of Discretely Observed Continuous - Time Non-Linear Systems , 2007, 0705.1598.

[47]  Hermann Singer Nonlinear continuous time modeling approaches in panel research , 2008 .

[48]  S. Julier,et al.  A General Method for Approximating Nonlinear Transformations of Probability Distributions , 1996 .

[49]  Robin J. Evans,et al.  Fundamentals of Object Tracking , 2011 .

[50]  Simo Särkkä,et al.  Gaussian filtering and smoothing for continuous-discrete dynamic systems , 2013, Signal Process..

[51]  Simon Haykin,et al.  Cubature Kalman Filtering for Continuous-Discrete Systems: Theory and Simulations , 2010, IEEE Transactions on Signal Processing.

[52]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[53]  B. Øksendal Stochastic differential equations : an introduction with applications , 1987 .

[54]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[55]  Simo Särkkä,et al.  On Gaussian Optimal Smoothing of Non-Linear State Space Models , 2010, IEEE Transactions on Automatic Control.

[56]  P. Bickel,et al.  Obstacles to High-Dimensional Particle Filtering , 2008 .

[57]  Markus Hürzeler,et al.  Monte Carlo Approximations for General State-Space Models , 1998 .

[58]  C. Striebel,et al.  Partial differential equations for the conditional distribution of a Markov process given noisy observations , 1965 .

[59]  Xiao-Li Hu,et al.  A Basic Convergence Result for Particle Filtering , 2008, IEEE Transactions on Signal Processing.

[60]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[61]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[62]  Xiao-Li Hu,et al.  A General Convergence Result for Particle Filtering , 2011, IEEE Transactions on Signal Processing.

[63]  Kazufumi Ito,et al.  Gaussian filters for nonlinear filtering problems , 2000, IEEE Trans. Autom. Control..

[64]  Uwe D. Hanebeck,et al.  Analytic moment-based Gaussian process filtering , 2009, ICML '09.

[65]  Fredrik Gustafsson,et al.  Some Relations Between Extended and Unscented Kalman Filters , 2012, IEEE Transactions on Signal Processing.

[66]  Simo Särkkä,et al.  Parameter estimation in stochastic differential equations with Markov chain Monte Carlo and non-linear Kalman filtering , 2013, Comput. Stat..

[67]  John B. Moore,et al.  Fixed-lag demodulation of discrete noisy measurements of FM signals , 1973 .

[68]  Andrew Gelman,et al.  Handbook of Markov Chain Monte Carlo , 2011 .

[69]  Sumeetpal S. Singh,et al.  Particle approximations of the score and observed information matrix in state space models with application to parameter estimation , 2011 .

[70]  A. Doucet,et al.  Monte Carlo Smoothing for Nonlinear Time Series , 2004, Journal of the American Statistical Association.

[71]  A. S. Formulation Particle Smoothing in Continuous Time: A Fast Approach via Density Estimation , 2011 .

[72]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Peter J. W. Rayner,et al.  Digital Audio Restoration: A Statistical Model Based Approach , 1998 .

[74]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[75]  Lennart Svensson,et al.  Moment Estimation Using a Marginalized Transform , 2012, IEEE Transactions on Signal Processing.

[76]  Simon J. Godsill,et al.  Monte Carlo smoothing with application to audio signal enhancement , 2002, IEEE Trans. Signal Process..

[77]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[78]  Simo Särkkä,et al.  Fourier-Hermite Kalman Filter , 2012, IEEE Transactions on Automatic Control.

[79]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[80]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[81]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[82]  Nando de Freitas,et al.  Rao-Blackwellised Particle Filtering via Data Augmentation , 2001, NIPS.

[83]  Simo Särkkä,et al.  Recursive Noise Adaptive Kalman Filtering by Variational Bayesian Approximations , 2009, IEEE Transactions on Automatic Control.

[84]  N. Rashevsky,et al.  Mathematical biology , 1961, Connecticut medicine.

[85]  S. Haykin Kalman Filtering and Neural Networks , 2001 .

[86]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[87]  Abderrahmane Haddad,et al.  Estimation theory with applications to communications and control , 1972 .

[88]  Thomas B. Schön,et al.  System identification of nonlinear state-space models , 2011, Autom..

[89]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[90]  Aurélien Garivier,et al.  Sequential Monte Carlo smoothing for general state space hidden Markov models , 2011, 1202.2945.

[91]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[92]  Ville Juhana Väänänen,et al.  Gaussian filtering and smoothing based parameter estimation in nonlinear models for sequential data , 2012 .

[93]  David Barber,et al.  Expectation Correction for Smoothed Inference in Switching Linear Dynamical Systems , 2006, J. Mach. Learn. Res..

[94]  Matti Vihola,et al.  Robust adaptive Metropolis algorithm with coerced acceptance rate , 2010, Stat. Comput..

[95]  Arnaud Doucet,et al.  On the use and misuse of particle filtering in digital communications , 2002, 2002 11th European Signal Processing Conference.

[96]  S. Haykin,et al.  Cubature Kalman Filters , 2009, IEEE Transactions on Automatic Control.

[97]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[98]  Eduardo Mario Nebot,et al.  An outlier-robust Kalman filter , 2011, 2011 IEEE International Conference on Robotics and Automation.

[99]  Simo Särkkä,et al.  Linear Operators and Stochastic Partial Differential Equations in Gaussian Process Regression , 2011, ICANN.

[100]  H. Rauch Solutions to the linear smoothing problem , 1963 .

[101]  Robert J. Elliott,et al.  Discrete-Time Nonlinear Filtering Algorithms Using Gauss–Hermite Quadrature , 2007, Proceedings of the IEEE.

[102]  Brett Ninness,et al.  Bayesian system identification via Markov chain Monte Carlo techniques , 2010, Autom..

[103]  Thomas Bo Schön,et al.  Particle Filters for System Identification of State-Space Models Linear in Either Parameters or States , 2003 .

[104]  John G. Proakis,et al.  Digital Communications , 1983 .

[105]  R. L. Stratonovich Conditional Markov Processes and their Application to the Theory of Optimal Control , 1968 .

[106]  Matti S Hämäläinen,et al.  Dynamic magnetic resonance inverse imaging of human brain function , 2006, Magnetic resonance in medicine.

[107]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[108]  Rudolph van der Merwe,et al.  The Unscented Kalman Filter , 2002 .

[109]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[110]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[111]  Fredrik Gustafsson,et al.  Marginalized particle filters for Bayesian estimation of Gaussian noise parameters , 2010, 2010 13th International Conference on Information Fusion.

[112]  Walerian Kipiniak,et al.  Optimal Estimation, Identification, and Control , 1964 .

[113]  S. Särkkä,et al.  On Continuous-Discrete Cubature Kalman Filtering , 2012 .

[114]  Jouko Lampinen,et al.  Time series prediction by Kalman smoother with cross-validated noise density , 2004 .

[115]  Christophe Andrieu,et al.  A tutorial on adaptive MCMC , 2008, Stat. Comput..

[116]  Jun S. Liu,et al.  Mixture Kalman filters , 2000 .

[117]  J. Rosenthal,et al.  Optimal scaling for various Metropolis-Hastings algorithms , 2001 .

[118]  J. Huang,et al.  Curse of dimensionality and particle filters , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[119]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[120]  Hermann Singer Continuous-discrete state-space modeling of panel data with nonlinear filter algorithms , 2011 .

[121]  E. Somersalo,et al.  Statistical and computational inverse problems , 2004 .

[122]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[123]  Kaare Brandt Petersen,et al.  State-Space Models: From the EM Algorithm to a Gradient Approach , 2007, Neural Computation.

[124]  Radford M. Neal MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[125]  S. Roweis,et al.  Learning Nonlinear Dynamical Systems Using the Expectation–Maximization Algorithm , 2001 .

[126]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[127]  Jouni Hartikainen,et al.  Kalman filtering and smoothing solutions to temporal Gaussian process regression models , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[128]  Jouni Hartikainen,et al.  Sigma point methods in optimal smoothing of non-linear stochastic state space models , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[129]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[130]  J. Junkins,et al.  Optimal Estimation of Dynamic Systems , 2004 .

[131]  Niels Kjølstad Poulsen,et al.  New developments in state estimation for nonlinear systems , 2000, Autom..

[132]  S. Godsill,et al.  A Backward-Simulation Based Rao-Blackwellized Particle Smoother for Conditionally Linear Gaussian Models , 2012 .

[133]  Hiromitsu Kumamoto,et al.  Random sampling approach to state estimation in switching environments , 1977, Autom..

[134]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[135]  Aki Vehtari,et al.  Dynamic retrospective filtering of physiological noise in BOLD fMRI: DRIFTER , 2012, NeuroImage.

[136]  Olaf Hauk,et al.  Keep it simple: a case for using classical minimum norm estimation in the analysis of EEG and MEG data , 2004, NeuroImage.

[137]  Brian D. O. Anderson,et al.  On the stability of fixed-lag smoothing algorithms , 1971 .

[138]  Henry Cox,et al.  On the estimation of state variables and parameters for noisy dynamic systems , 1964 .

[139]  Simo Särkkä,et al.  Continuous-time and continuous-discrete-time unscented Rauch-Tung-Striebel smoothers , 2010, Signal Process..

[140]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[141]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[142]  R. Mehra,et al.  Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculations , 1974 .

[143]  A. Kennedy,et al.  Hybrid Monte Carlo , 1987 .

[144]  H.F. Durrant-Whyte,et al.  A new approach for filtering nonlinear systems , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[145]  P. Fearnhead,et al.  On‐line inference for hidden Markov models via particle filters , 2003 .

[146]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[147]  G. Storvik Particle filters in state space models with the presence of unknown static parameters YYYY No org found YYY , 2000 .

[148]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[149]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[150]  S. Särkkä,et al.  On Unscented Kalman Filtering for State Estimation of Continuous-Time Nonlinear Systems , 2007, IEEE Transactions on Automatic Control.

[151]  Simo Särkkä,et al.  Recursive Bayesian inference on stochastic differential equations , 2006 .

[152]  Tom Heskes,et al.  Novel approximations for inference in nonlinear dynamical systems using expectation propagation , 2005, Neurocomputing.

[153]  R. S. Miyasako,et al.  Application of fixed point smoothing to the calibration, alignment and navigation data of inertial navigation systems , 1988, IEEE PLANS '88.,Position Location and Navigation Symposium, Record. 'Navigation into the 21st Century'..

[154]  Gene H. Golub,et al.  Calculation of Gauss quadrature rules , 1967, Milestones in Matrix Computation.

[155]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[156]  Y. Ho,et al.  A Bayesian approach to problems in stochastic estimation and control , 1964 .