A Kalman filter for robust outlier detection

In this paper, we introduce a modified Kalman filter that can perform robust, real-time outlier detection in the observations, without the need for manual parameter tuning by the user. Robotic systems that rely on high quality sensory data can be sensitive to data containing outliers. Since the standard Kalman filter is not robust to outliers, other variations of the Kalman filter have been proposed to overcome this issue, but these methods may require manual parameter tuning, use of heuristics or complicated parameter estimation. Our Kalman filter uses a weighted least squares-like approach by introducing weights for each data sample. A data sample with a smaller weight has a weaker contribution when estimating the current time step's state. We learn the weights and system dynamics using a variational Expectation-Maximization framework. We evaluate our Kalman filter algorithm on data from a robotic dog.

[1]  J. Tukey A survey of sampling from contaminated distributions , 1960 .

[2]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[3]  H. Sorenson,et al.  Recursive bayesian estimation using gaussian sums , 1971 .

[4]  C. Masreliez Approximate non-Gaussian filtering with linear state and observation relations , 1975 .

[5]  B. Tapley,et al.  Adaptive sequential estimation with unknown noise statistics , 1976 .

[6]  Joel M. Morris,et al.  The Kalman filter: A robust estimator for some classes of linear quadratic problems , 1976, IEEE Trans. Inf. Theory.

[7]  R. Martin,et al.  Robust bayesian estimation for the linear model and robustifying the Kalman filter , 1977 .

[8]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[9]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[10]  M. West Robust Sequential Approximate Bayesian Estimation , 1981 .

[11]  M. West Aspects of recursive Bayesian estimation , 1982 .

[12]  A F Smith,et al.  Monitoring renal transplants: an application of the multiprocess Kalman filter. , 1983, Biometrics.

[13]  Harold W. Sorenson,et al.  Recursive Bayesian estimation using piece-wise constant approximations , 1988, Autom..

[14]  Richard J. Meinhold,et al.  Robustification of Kalman Filter Models , 1989 .

[15]  H. J. Arnold Introduction to the Practice of Statistics , 1990 .

[16]  S. Mitter,et al.  Robust Recursive Estimation in the Presence of Heavy-Tailed Observation Noise , 1994 .

[17]  David Lindley,et al.  Introduction to the Practice of Statistics , 1990, The Mathematical Gazette.

[18]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[19]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .

[20]  Thomas P. Ryan,et al.  Modern Regression Methods , 1996 .

[21]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[22]  G. Kitagawa Theory and Methods , 1998 .

[23]  Zeljko M. Durovic,et al.  Robust estimation with unknown noise statistics , 1999, IEEE Trans. Autom. Control..

[24]  Lambert Schomaker,et al.  2000 IEEE/RSJ International Conference On Intelligent Robots And Systems , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[25]  Matthew J. Beal,et al.  Graphical Models and Variational Methods , 2001 .

[26]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[27]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[28]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.

[29]  Shing-Chow Chan,et al.  A new robust Kalman filter algorithm under outliers and system uncertainties , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[30]  Stefan Schaal,et al.  Bayesian regression with input noise for high dimensional data , 2006, ICML.

[31]  Stefan Schaal,et al.  Automatic Outlier Detection: A Bayesian Approach , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[32]  C. Gouriéroux,et al.  Non-Gaussian State-Space Modeling of Nonstationary Time Series , 2008 .