Most traditional time series models are global models based on local time information: they assume that the state can be fully and locally (in time) characterized with a finite embedding space. Prediction then amounts to simple regression. Unfortunately, there are many situations in which simple regression is not sufficient to model the temporal structure in a time series. The authors introduce an architecture that they call hidden Markov experts. It is based on hidden Markov models used in speech recognition research. By introducing the concept of hidden states, hidden Markov experts model time dependency of time series explicitly as a first-order Markov model with transitions between these hidden states. Within each state, local models are applied to estimate the probability density, which can be linear or nonlinear depending on the situation. The paper first discusses the statistical framework and the learning algorithm of hidden Markov experts, then applies them to daily S&P500 data and to high frequency currency exchange rate data. The hidden Markov experts have better profit than the linear and nonlinear global models. The volatilities of the time series can be characterized by the hidden states.
[1]
Yoshua Bengio,et al.
Input-output HMMs for sequence processing
,
1996,
IEEE Trans. Neural Networks.
[2]
Andreas S. Weigend,et al.
Decision Technologies for Financial Engineering
,
1998
.
[3]
L. Baum,et al.
An inequality and associated maximization technique in statistical estimation of probabilistic functions of a Markov process
,
1972
.
[4]
James D. Hamilton.
Analysis of time series subject to changes in regime
,
1990
.
[5]
Olivier V. Pictet,et al.
Changing time scale for short‐term forecasting in financial markets
,
1996
.
[6]
Geoffrey E. Hinton,et al.
Adaptive Mixtures of Local Experts
,
1991,
Neural Computation.
[7]
Ashok N. Srivastava,et al.
Nonlinear gated experts for time series: discovering regimes and avoiding overfitting
,
1995,
Int. J. Neural Syst..
[8]
Lawrence R. Rabiner,et al.
A tutorial on hidden Markov models and selected applications in speech recognition
,
1989,
Proc. IEEE.
[9]
Jonathan D. Cryer,et al.
Time Series Analysis
,
1986,
Encyclopedia of Big Data.