Multi-step-ahead time series prediction using multiple-output support vector regression

Accurate time series prediction over long future horizons is challenging and of great interest to both practitioners and academics. As a well-known intelligent algorithm, the standard formulation of Support Vector Regression (SVR) could be taken for multi-step-ahead time series prediction, only relying either on iterated strategy or direct strategy. This study proposes a novel multiple-step-ahead time series prediction approach which employs multiple-output support vector regression (M-SVR) with multiple-input multiple-output (MIMO) prediction strategy. In addition, the rank of three leading prediction strategies with SVR is comparatively examined, providing practical implications on the selection of the prediction strategy for multi-step-ahead forecasting while taking SVR as modeling technique. The proposed approach is validated with the simulated and real datasets. The quantitative and comprehensive assessments are performed on the basis of the prediction accuracy and computational cost. The results indicate that (1) the M-SVR using MIMO strategy achieves the best accurate forecasts with accredited computational load, (2) the standard SVR using direct strategy achieves the second best accurate forecasts, but with the most expensive computational cost, and (3) the standard SVR using iterated strategy is the worst in terms of prediction accuracy, but with the least computational cost.

[1]  Gérard Bloch,et al.  Incorporating prior knowledge in support vector regression , 2007, Machine Learning.

[2]  Sven F. Crone,et al.  Automatic Modelling and Forecasting with Artificial Neural Networks- A forecasting competition evaluation , 2008 .

[3]  Ching-Kang Ing,et al.  MULTISTEP PREDICTION IN AUTOREGRESSIVE PROCESSES , 2003, Econometric Theory.

[4]  Ted Jaditz Time series prediction: Forecasting the future and understanding the past : Andreas S. Weigend and Neil A. Gershenfeld, eds., (Reading, MA: Addison-Wesley Publishing Co., 1949) pp. xvii + 643, $29.95 , 1995 .

[5]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[6]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[7]  Kyoung-jae Kim,et al.  Financial time series forecasting using support vector machines , 2003, Neurocomputing.

[8]  H. Pomares,et al.  A heuristic method for parameter selection in LS-SVM: Application to time series prediction , 2011 .

[9]  Fernando Pérez-Cruz,et al.  Multi-dimensional Function Approximation and Regression Estimation , 2002, ICANN.

[10]  Luis Alonso,et al.  Multioutput Support Vector Regression for Remote Sensing Biophysical Parameter Estimation , 2011, IEEE Geoscience and Remote Sensing Letters.

[11]  F. Ramsey,et al.  The Statistical Sleuth , 1996 .

[12]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[13]  D. Cox Prediction by Exponentially Weighted Moving Averages and Related Methods , 1961 .

[14]  Rajib Maity,et al.  Multistep-Ahead River Flow Prediction Using LS-SVR at Daily Scale , 2012 .

[15]  Ping-Feng Pai,et al.  Support Vector Machines with Simulated Annealing Algorithms in Electricity Load Forecasting , 2005 .

[16]  Kenneth de Jong Parameter Setting in EAs: a 30 Year Perspective , 2007 .

[17]  Amaury Lendasse,et al.  Long-term prediction of time series by combining direct and MIMO strategies , 2009, 2009 International Joint Conference on Neural Networks.

[18]  N. R. Srinivasa Raghavan,et al.  A Support Vector Machine Based Approach for Forecasting of Network Weather Services , 2006, Journal of Grid Computing.

[19]  Guoqiang Peter Zhang,et al.  Quarterly Time-Series Forecasting With Neural Networks , 2007, IEEE Transactions on Neural Networks.

[20]  Ashish Sharma,et al.  Seasonal to interannual rainfall probabilistic forecasts for improved water supply management: Part 1 — A strategy for system predictor identification , 2000 .

[21]  M. Bayazit,et al.  The Power of Statistical Tests for Trend Detection , 2003 .

[22]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[23]  Pei-Chann Chang,et al.  Iterated time series prediction with multiple support vector regression models , 2013, Neurocomputing.

[24]  Amir F. Atiya,et al.  Forecast combinations of computational intelligence and linear models for the NN5 time series forecasting competition , 2011 .

[25]  A. Kusiak,et al.  Short-Term Prediction of Wind Farm Power: A Data Mining Approach , 2009, IEEE Transactions on Energy Conversion.

[26]  Amaury Lendasse,et al.  Methodology for long-term prediction of time series , 2007, Neurocomputing.

[27]  Antti Sorjamaa,et al.  Multiple-output modeling for multi-step-ahead time series forecasting , 2010, Neurocomputing.

[28]  Cheng-Hua Wang,et al.  Support vector regression with genetic algorithms in forecasting tourism demand , 2007 .

[29]  P. Goodwin,et al.  On the asymmetry of the symmetric MAPE , 1999 .

[30]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[31]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[32]  Gianluca Bontempi,et al.  Long Term Time Series Prediction with Multi-Input Multi-Output Local Learning , 2008 .

[33]  Xin Yao,et al.  Simultaneous training of negatively correlated neural networks in an ensemble , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[34]  Li-Chiu Chang,et al.  Reinforced Two-Step-Ahead Weight Adjustment Technique for Online Training of Recurrent Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Fernando Pérez-Cruz,et al.  SVM multiregression for nonlinear channel estimation in multiple-input multiple-output systems , 2004, IEEE Transactions on Signal Processing.

[36]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Philip Hans Franses,et al.  A Unifying View on Multi-Step Forecasting Using an Autoregression , 2009 .

[39]  M. Hénon,et al.  A two-dimensional mapping with a strange attractor , 1976 .

[40]  Amir F. Atiya,et al.  A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition , 2011, Expert Syst. Appl..

[41]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[42]  Teresa Bernarda Ludermir,et al.  An Optimization Methodology for Neural Network Weights and Architectures , 2006, IEEE Transactions on Neural Networks.

[43]  Kenneth DeJong,et al.  Parameter Setting in EAs: a 30 Year Perspective , 2007, Parameter Setting in Evolutionary Algorithms.

[44]  Guillaume Chevillon,et al.  Direct Multi-Step Estimation and Forecasting , 2006 .

[45]  I-Fan Chang,et al.  Support vector regression for real-time flood stage forecasting , 2006 .

[46]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[47]  Desheng Dash Wu,et al.  A soft computing system for day-ahead electricity price forecasting , 2010, Appl. Soft Comput..

[48]  W Mao,et al.  Research of load identification based on multiple-input multiple-output SVM model selection , 2012 .