A self-organizing NARX network and its application to prediction of chaotic time series

Introduces the concept of dynamic embedding manifold (DEM), which allows the Kohonen self-organizing map (SOM) to learn dynamic, nonlinear input-output mappings. The combination of the DEM concept with the SOM results in a new modelling technique that we call vector-quantized temporal associative memory (VQTAM). We use VQTAM to propose an unsupervised neural algorithm called the self-organizing NARX (SONARX) network. The SONARX network is evaluated on the problem of modeling and prediction of three chaotic time series and compared with MLP, RBF and autoregressive (AR) models. Its is shown that SONARX exhibits similar performance when compared to MLP and RBF, while producing much better results than the AR model. The influence of the number of neurons, the memory order, the number of training epochs and the size of the training set in the final prediction error is also evaluated.

[1]  Guilherme A. Barreto,et al.  Bayesian Inference and Markov Chain Monte Carlo Methods Applied to Streamflow Forecasting , 2000 .

[2]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[3]  H. Akaike.  A new look at the statistical model identification , 1974 .

[4]  Peter Tiño,et al.  Learning long-term dependencies in NARX recurrent neural networks , 1996, IEEE Trans. Neural Networks.

[5]  Helge J. Ritter,et al.  Rapid learning with parametrized self-organizing maps , 1996, Neurocomputing.

[6]  Jari Kangas,et al.  Time-delayed self-organizing maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[7]  Jukka Heikkonen,et al.  Time Series Predicition using Recurrent SOM with Local Linear Models , 1997 .

[8]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[9]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[10]  Dimitris Kugiumtzis,et al.  Chaotic time series. Part II. System Identification and Prediction , 1994, chao-dyn/9401003.

[11]  Thomas Voegtlin,et al.  Context quantization and contextual self-organizing maps , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.