A new perspective and extension of the Gaussian Filter

The Gaussian Filter (GF) is one of the most widely used filtering algorithms; instances are the Extended Kalman Filter, the Unscented Kalman Filter and the Divided Difference Filter. The GF represents the belief of the current state by a Gaussian distribution, whose mean is an affine function of the measurement. We show that this representation can be too restrictive to accurately capture the dependences in systems with nonlinear observation models, and we investigate how the GF can be generalized to alleviate this problem. To this end, we view the GF as the solution to a constrained optimization problem. From this new perspective, the GF is seen as a special case of a much broader class of filters, obtained by relaxing the constraint on the form of the approximate posterior. On this basis, we outline some conditions which potential generalizations have to satisfy in order to maintain the computational efficiency of the GF. We propose one concrete generalization which corresponds to the standard GF using a pseudo measurement instead of the actual measurement. Extending an existing GF implementation in this manner is trivial. Nevertheless, we show that this small change can have a major impact on the estimation accuracy.

[1]  Stefan Schaal,et al.  Depth-based object tracking using a Robust Gaussian Filter , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Stefan Schaal,et al.  Robust Gaussian filtering using a pseudo measurement , 2015, 2016 American Control Conference (ACC).

[3]  Stefan Schaal,et al.  Robust Gaussian Filtering , 2015, ArXiv.

[4]  Nicholas Rotella,et al.  State estimation for a humanoid robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Ángel F. García-Fernández,et al.  Analysis of Kalman Filter Approximations for Nonlinear Measurements , 2013, IEEE Transactions on Signal Processing.

[6]  Simo Srkk,et al.  Bayesian Filtering and Smoothing , 2013 .

[7]  Simo Särkkä,et al.  Bayesian Filtering and Smoothing , 2013, Institute of Mathematical Statistics textbooks.

[8]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[9]  David Barber,et al.  Bayesian reasoning and machine learning , 2012 .

[10]  S. Haykin,et al.  Cubature Kalman Filters , 2009, IEEE Transactions on Automatic Control.

[11]  P. Bickel,et al.  Sharp failure rates for the bootstrap particle filter in high dimensions , 2008, 0805.3287.

[12]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[13]  Christopher D. Karlgaard,et al.  Comparison of Several Nonlinear Filters for a Benchmark Tracking Problem , 2006 .

[14]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[15]  Yuanxin Wu,et al.  A Numerical-Integration Perspective on Gaussian Filters , 2006, IEEE Transactions on Signal Processing.

[16]  P. Bickel,et al.  Curse-of-dimensionality revisited : Collapse of importance sampling in very large scale systems , 2005 .

[17]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[18]  Rudolph van der Merwe,et al.  Sigma-point kalman filters for probabilistic inference in dynamic state-space models , 2004 .

[19]  Tom Minka,et al.  Expectation Propagation for approximate Bayesian inference , 2001, UAI.

[20]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[21]  Nando de Freitas,et al.  An Introduction to Sequential Monte Carlo Methods , 2001, Sequential Monte Carlo Methods in Practice.

[22]  Niels Kjølstad Poulsen,et al.  New developments in state estimation for nonlinear systems , 2000, Autom..

[23]  Kazufumi Ito,et al.  Gaussian filters for nonlinear filtering problems , 2000, IEEE Trans. Autom. Control..

[24]  Harold J. Kushner,et al.  A nonlinear filtering algorithm based on an approximation of the conditional distribution , 2000, IEEE Trans. Autom. Control..

[25]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[26]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[27]  Hugh F. Durrant-Whyte,et al.  An Autonomous Guided Vehicle for Cargo Handling Applications , 1995, Int. J. Robotics Res..

[28]  Marie-José Aldon,et al.  Mobile robot attitude estimation by fusion of inertial data , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[29]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[30]  F. Daum Exact finite dimensional nonlinear filters , 1985, 1985 24th IEEE Conference on Decision and Control.

[31]  H. W. Sorenson,et al.  Kalman filtering : theory and application , 1985 .

[32]  R. Fitzgerald,et al.  Decoupled Kalman filters for phased array radar tracking , 1983 .

[33]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[34]  V. Benes Exact finite-dimensional filters for certain diffusions with nonlinear drift , 1981 .

[35]  H. Kushner Approximations to optimal nonlinear filters , 1967, IEEE Transactions on Automatic Control.