Bayesian Online Detection and Prediction of Change Points

Online detection of instantaneous changes in the generative process of a data sequence generally focuses on retrospective inference of such change points without considering their future occurrences. We extend the Bayesian Online Change Point Detection algorithm to also infer the number of time steps until the next change point (i.e., the residual time). This enables us to handle observation models which depend on the total segment duration, which is useful to model data sequences with temporal scaling. In addition, we extend the model by removing the i.i.d. assumption on the observation model parameters. The resulting inference algorithm for segment detection can be deployed in an online fashion, and we illustrate applications to synthetic and to two medical real-world data sets.

[1]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[2]  D. Stephens Bayesian Retrospective Multiple‐Changepoint Identification , 1994 .

[3]  Pablo Laguna,et al.  A database for evaluation of algorithms for measurement of QT and other waveform intervals in the ECG , 1997, Computers in Cardiology 1997.

[4]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[5]  Kevin P. Murphy Hidden semi-Markov models ( HSMMs ) , 2002 .

[6]  Stephen J. Roberts,et al.  Markov Models for Automated ECG Interval Analysis , 2003, NIPS.

[7]  H. Kobayashi,et al.  An efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2003, IEEE Signal Processing Letters.

[8]  O. Cappé,et al.  Retrospective Mutiple Change-Point Estimation with Kernels , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[9]  James M. Rehg,et al.  Learning and Inferring Motion Patterns using Parametric Segmental Switching Linear Dynamic Systems , 2008, International Journal of Computer Vision.

[10]  P. Fearnhead,et al.  On‐line inference for multiple changepoint problems , 2007 .

[11]  F Sa Su,et al.  Forecasting Time Series with Multiple Seasonal Patterns , 2007 .

[12]  Ryan P. Adams,et al.  Bayesian Online Changepoint Detection , 2007, 0710.3742.

[13]  B. Nolan Boosting slow oscillations during sleep potentiates memory , 2008 .

[14]  Li Wang,et al.  Discriminative human action segmentation and recognition using semi-Markov model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jesús García,et al.  Segmentation and Classification of Time-Series: Real Case Studies , 2009, IDEAL.

[16]  Carl E. Rasmussen,et al.  Gaussian Process Change Point Models , 2010, ICML.

[17]  Jan Peters,et al.  Movement extraction by detecting dynamics switches and repetitions , 2010, NIPS.

[18]  Fernando De la Torre,et al.  Joint segmentation and classification of human actions in video , 2011, CVPR 2011.

[19]  Jan Peters,et al.  Probabilistic Movement Primitives , 2013, NIPS.

[20]  J. Born,et al.  Auditory Closed-Loop Stimulation of the Sleep Slow Oscillation Enhances Memory , 2013, Neuron.

[21]  Genshiro A. Sunagawa,et al.  FASTER: an unsupervised fully automated sleep staging method for mice , 2013, Genes to cells : devoted to molecular & cellular mechanisms.

[22]  Silvia Chiappa,et al.  Explicit-Duration Markov Switching Models , 2014, Found. Trends Mach. Learn..

[23]  Noah A. Smith,et al.  Conditional Random Field Autoencoders for Unsupervised Structured Prediction , 2014, NIPS.

[24]  Noah A. Smith,et al.  Segmental Recurrent Neural Networks , 2015, ICLR.

[25]  Diane J. Cook,et al.  A survey of methods for time series change point detection , 2017, Knowledge and Information Systems.

[26]  C. Cassisi,et al.  Probabilistic Reasoning Over Seismic Time Series: Volcano Monitoring by Hidden Markov Models at Mt. Etna , 2016, Pure and Applied Geophysics.

[27]  Michelle Karg,et al.  Movement Primitive Segmentation for Human Motion Modeling: A Framework for Analysis , 2016, IEEE Transactions on Human-Machine Systems.

[28]  Le Song,et al.  Recurrent Hidden Semi-Markov Model , 2017, ICLR.

[29]  Panagiotis Tsakalides,et al.  An online feature selection architecture for Human Activity Recognition , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Ju Lynn Ong,et al.  An end-to-end framework for real-time automatic sleep stage classification , 2018, Sleep.

[31]  Yaowu Chen,et al.  Ensembles of change-point detectors: implications for real-time BMI applications , 2018, Journal of Computational Neuroscience.

[32]  Zenglin Xu,et al.  Structured Inference for Recurrent Hidden Semi-markov Model , 2018, IJCAI.

[33]  Eamonn J. Keogh,et al.  Domain agnostic online semantic segmentation for multi-dimensional time series , 2018, Data Mining and Knowledge Discovery.

[34]  Nicolas Vayatis,et al.  A review of change point detection methods , 2018, ArXiv.