Informative missingness is unavoidable in the digital processing of continuous time series, where the value for one or more observations at different time points are missing. Such missing observations are one of the major limitations of time series processing using deep learning. Practical applications, e.g., sensor data, healthcare, weather, generates data that is in truth continuous in time, and informative missingness is a common phenomenon in these datasets. These datasets often consist of multiple variables, and often there are missing values for one or many of these variables. This characteristic makes time series prediction more challenging, and the impact of missing input observations on the accuracy of the final output can be significant. A recent novel deep learning model called GRU-D is one early attempt to address informative missingness in time series data. On the other hand, a new family of neural networks called Neural ODEs (Ordinary Differential Equations) are natural and efficient for processing time series data which is continuous in time. In this paper, a deep learning model is proposed that leverages the effective imputation of GRU-D, and the temporal continuity of Neural ODEs. A time series classification task performed on the PhysioNet dataset demonstrates the performance of this architecture.
[1]
Yan Liu,et al.
Recurrent Neural Networks for Multivariate Time Series with Missing Values
,
2016,
Scientific Reports.
[2]
A. E. Bryson,et al.
A Steepest-Ascent Method for Solving Optimum Programming Problems
,
1962
.
[3]
G. Moody,et al.
Predicting in-hospital mortality of ICU patients: The PhysioNet/Computing in cardiology challenge 2012
,
2012,
2012 Computing in Cardiology.
[4]
Yoshua Bengio,et al.
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
,
2014,
EMNLP.
[5]
Barak A. Pearlmutter.
Learning State Space Trajectories in Recurrent Neural Networks
,
1988,
Neural Computation.
[6]
David Duvenaud,et al.
Latent Ordinary Differential Equations for Irregularly-Sampled Time Series
,
2019,
NeurIPS.
[7]
David Duvenaud,et al.
Neural Ordinary Differential Equations
,
2018,
NeurIPS.
[8]
Peter Szolovits,et al.
MIMIC-III, a freely accessible critical care database
,
2016,
Scientific Data.
[9]
Jürgen Schmidhuber,et al.
Long Short-Term Memory
,
1997,
Neural Computation.