Number : TR-CLMC-20071 Learning an Outlier-Robust Kalman Filter

In this paper, we introduce a modified Kalman filter that performs robust, real-time outlier detection, without the need for manual parameter tuning by the user. Systems that rely on high quality sensory data (for instance, robotic systems) can be sensitive to data containing outliers. The standard Kalman filter is not robust to outliers, and other variations of the Kalman filter have been proposed to overcome this issue. However, these methods may require manual parameter tuning, use of heuristics or complicated parameter estimation procedures. Our Kalman filter uses a weighted least squares-like approach by introducing weights for each data sample. A data sample with a smaller weight has a weaker contribution when estimating the current time step’s state. Using an incremental variational Expectation-Maximization framework, we learn the weights and system dynamics. We evaluate our Kalman filter algorithm on synthetic data and data from a robotic dog.

[1]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[2]  J. Tukey A survey of sampling from contaminated distributions , 1960 .

[3]  S. Mitter,et al.  Robust Recursive Estimation in the Presence of Heavy-Tailed Observation Noise , 1994 .

[4]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[5]  M. West Robust Sequential Approximate Bayesian Estimation , 1981 .

[6]  Stefan Schaal,et al.  Bayesian regression with input noise for high dimensional data , 2006, ICML.

[7]  G. Kitagawa Smoothness priors analysis of time series , 1996 .

[8]  Zeljko M. Durovic,et al.  Robust estimation with unknown noise statistics , 1999, IEEE Trans. Autom. Control..

[9]  Stefan Schaal,et al.  Automatic Outlier Detection: A Bayesian Approach , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.

[11]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[12]  R. Martin,et al.  Robust bayesian estimation for the linear model and robustifying the Kalman filter , 1977 .

[13]  Richard J. Meinhold,et al.  Robustification of Kalman Filter Models , 1989 .

[14]  Shing-Chow Chan,et al.  A new robust Kalman filter algorithm under outliers and system uncertainties , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[15]  B. Tapley,et al.  Adaptive sequential estimation with unknown noise statistics , 1976 .

[16]  G. Kitagawa Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[17]  A F Smith,et al.  Monitoring renal transplants: an application of the multiprocess Kalman filter. , 1983, Biometrics.

[18]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[19]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[20]  Matthew J. Beal,et al.  Graphical Models and Variational Methods , 2001 .

[21]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[22]  H. J. Arnold Introduction to the Practice of Statistics , 1990 .

[23]  Harold W. Sorenson,et al.  Recursive Bayesian estimation using piece-wise constant approximations , 1988, Autom..

[24]  Joel M. Morris,et al.  The Kalman filter: A robust estimator for some classes of linear quadratic problems , 1976, IEEE Trans. Inf. Theory.

[25]  M. West Aspects of recursive Bayesian estimation , 1982 .

[26]  H. Sorenson,et al.  Recursive bayesian estimation using gaussian sums , 1971 .

[27]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[28]  C. Masreliez Approximate non-Gaussian filtering with linear state and observation relations , 1975 .

[29]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[30]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .