Financial time series prediction using hybrids of chaos theory, multi-layer perceptron and multi-objective evolutionary algorithms

Abstract Financial Time Series Prediction is a complex and a challenging problem. In this paper, we propose two 3-stage hybrid prediction models wherein Chaos theory is used to construct phase space (Stage-1) followed by invoking Multi-Layer Perceptron (MLP) (Stage-2) and Multi-Objective Particle Swarm Optimization (MOPSO) / elitist Non-dominated Sorting Genetic Algorithm (NSGA-II) (Stage-3) in tandem. In both of these hybrid models, Stage-3 improves the prediction yielded by stage-2. The effectiveness of the proposed models is tested on financial datasets including the exchange rates data of US Dollar (USD) versus Japanese Yen (JPY), British Pound (GBP), Euro (EUR), and Gold price in terms of USD. From the results, it is concluded that Chaos+MLP+NSGA-II hybrid yielded better predictions than the other three-stage hybrid models: Chaos+MLP+MOPSO and Chaos+MLP+PSO, and Two-stage hybrid models: Chaos+PSO, Chaos+MOPSO and Chaos+NSGA-II in terms of both Mean Squared Error (MSE) and Directional Change Statistic (Dstat). Theil's inequality coefficient computed also confirms the superiority of the Chaos+MLP+NSGA-II hybrid over the Chaos+MLP+MOPSO across all datasets. Finally, Diebold-Mariano test indicates that the performance of Chaos+MLP+NSGA-II hybrid is statistically significant than the Chaos+MLP+MOPSO and other hybrids across all datasets. The results of these models are also compared with the two-stage hybrids found in literature [1,2] (Pradeepkumar and Ravi, 2014, 2017). These results are encouraging and suggest further application of these hybrids to other financial and scientific time series prediction problems in the future.

[1]  Ganapati Panda,et al.  Forecasting of currency exchange rates using an adaptive ARMA model with differential evolution based training , 2014, J. King Saud Univ. Comput. Inf. Sci..

[2]  Leslie S. Smith,et al.  A novel neural network ensemble architecture for time series forecasting , 2011, Neurocomputing.

[3]  Tak-Chung Fu,et al.  A review on time series data mining , 2011, Eng. Appl. Artif. Intell..

[4]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[5]  Arindam Chaudhuri,et al.  Time Series Forecasting Using Hybrid Neuro-Fuzzy Regression Model , 2009, RSFDGrC.

[6]  L. Cao.  Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[7]  Amit Konar,et al.  Particle Swarm Optimization and Differential Evolution Algorithms: Technical Analysis, Applications and Hybridization Perspectives , 2008, Advances of Computational Intelligence in Industrial Systems.

[8]  George E. P. Box,et al.  Intervention Analysis with Applications to Economic and Environmental Problems , 1975 .

[9]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[10]  Chunshien Li,et al.  Neural Fuzzy Forecasting of the China Yuan to US Dollar Exchange Rate - A Swarm Intelligence Approach , 2011, ICSI.

[11]  Dimitris K. Tasoulis,et al.  Financial forecasting through unsupervised clustering and evolutionary trained neural networks , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[12]  C. Dhanya,et al.  Nonlinear ensemble prediction of chaotic daily rainfall , 2010 .

[13]  An-Sing Chen,et al.  Regression neural network for error correction in foreign exchange forecasting and trading , 2004, Comput. Oper. Res..

[14]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[15]  Tugba Taskaya-Temizel,et al.  2005 Special Issue: A comparative study of autoregressive neural network hybrids , 2005 .

[16]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[17]  David Horn,et al.  Combined Neural Networks for Time Series Analysis , 1993, NIPS.

[18]  Dhiya Al-Jumeily,et al.  Regularized dynamic self-organized neural network inspired by the immune algorithm for financial time series prediction , 2016, Neurocomputing.

[19]  Vadlamani Ravi,et al.  FOREX Rate Prediction Using Chaos, Neural Network and Particle Swarm Optimization , 2014, ICSI.

[20]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[21]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[22]  Shen Furao,et al.  Forecasting exchange rate using deep belief networks and conjugate gradient method , 2015, Neurocomputing.

[23]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[24]  Carlos M. Fonseca,et al.  On the Computation of the Empirical Attainment Function , 2011, EMO.

[25]  Oscar Castillo,et al.  Optimization of ensemble neural networks with fuzzy integration using the particle swarm algorithm for the US Dollar/MX time series prediction , 2014, 2014 IEEE Conference on Norbert Wiener in the 21st Century (21CW).

[26]  Michael Y. Hu,et al.  Forecasting with artificial neural networks : The state of the art * , 1997 .

[27]  Ahmed BenSaïda,et al.  Using the Lyapunov Exponent as a Practical Test for Noisy Chaos , 2007 .

[28]  Svitlana Galeshchuk,et al.  Neural networks performance in exchange rate prediction , 2016, Neurocomputing.

[29]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[30]  Vadlamani Ravi,et al.  FOREX Rate Prediction: A Hybrid Approach Using Chaos Theory and Multivariate Adaptive Regression Splines , 2016, FICTA.

[31]  Shian-Chang Huang,et al.  Chaos-based support vector regressions for exchange rate forecasting , 2010, Expert Syst. Appl..

[32]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[33]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[34]  Ying-Jye Lee,et al.  Performance comparison between Genetic Algorithm and Particle Swarm Optimization based on back propagation network in forecasting exchange rate , 2010 .

[35]  F. Diebold,et al.  Comparing Predictive Accuracy , 1994, Business Cycles.

[36]  Pradyot Ranjan Jena,et al.  Development and performance evaluation of a novel knowledge guided artificial neural network (KGANN) model for exchange rate prediction , 2015, J. King Saud Univ. Comput. Inf. Sci..

[37]  T. Hellström,et al.  Predicting the Stock Market , 1998 .

[38]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[39]  D. J. Reid.  Combining Three Estimates of Gross Domestic Product , 1968 .

[40]  Arash Ghanbari,et al.  Developing a Time Series Model Based on Particle Swarm Optimization for Gold Price Forecasting , 2010, 2010 Third International Conference on Business Intelligence and Financial Engineering.

[41]  Efstratios F. Georgopoulos,et al.  A Hybrid Radial Basis Function and Particle Swarm Optimization Neural Network Approach in Forecasting the EUR/GBP Exchange Rates Returns , 2012, EANN.

[42]  Mehdi Khashei,et al.  A new hybrid artificial neural networks and fuzzy regression model for time series forecasting , 2008, Fuzzy Sets Syst..

[43]  Carlos M. Fonseca,et al.  Exploring the Performance of Stochastic Multiobjective Optimisers with the Second-Order Attainment Function , 2005, EMO.

[44]  Kin Keung Lai,et al.  Multistage RBF neural network ensemble learning for exchange rates forecasting , 2008, Neurocomputing.

[45]  H. Akaike.  A new look at the statistical model identification , 1974 .

[46]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[47]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[48]  Çagdas Hakan Aladag,et al.  A new time invariant fuzzy time series forecasting method based on particle swarm optimization , 2012, Appl. Soft Comput..

[49]  Del Moral HernandezEmilio.  2005 Special Issue , 2005 .

[50]  Jingtao Yao,et al.  A case study on using neural networks to perform technical forecasting of forex , 2000, Neurocomputing.

[51]  Cheung-Wen Chang,et al.  Forecasting Exchange Rates Using Integration of Particle Swarm Optimization and Neural Networks , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[52]  Efstratios F. Georgopoulos,et al.  Forecasting foreign exchange rates with adaptive neural networks using radial-basis functions and Particle Swarm Optimization , 2013, Eur. J. Oper. Res..

[53]  Malik Magdon-Ismail,et al.  Financial markets: very noisy information processing , 1998 .

[54]  Chris Chatfield,et al.  Model uncertainty and forecast accuracy , 1996 .

[55]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[56]  Carlos Agón,et al.  Time-series data mining , 2012, CSUR.

[57]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[58]  Theodore B. Trafalis,et al.  A hybrid model for exchange rate prediction , 2006, Decis. Support Syst..

[59]  Georgios Sermpinis,et al.  Modeling, forecasting and trading the EUR exchange rates with hybrid rolling genetic algorithms - Support vector regression forecast combinations , 2015, Eur. J. Oper. Res..

[60]  Araceli Sanchis,et al.  Time series forecasting using a weighted cross-validation evolutionary artificial neural network ensemble , 2013, Neurocomputing.

[61]  Enrico Zio,et al.  Multi-objective Genetic Algorithm Optimization of a Neural Network for Estimating Wind Speed Prediction Intervals , 2013 .

[62]  Joarder Kamruzzaman,et al.  A hybrid of multiobjective Evolutionary Algorithm and HMM-Fuzzy model for time series prediction , 2012, Neurocomputing.

[63]  Dong Zhou,et al.  Translation techniques in cross-language information retrieval , 2012, CSUR.

[64]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[65]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .