Classification of Stock Market Trends with Confidence-Based Selective Predictions

Predicting the trend of stock price movement accurately allows investors to maximize their profits from investments. However, due to the complexity of the stock data, classifiers often make errors, which cause the investors to lose money from failed investments. This study attempts to reduce such risks by focusing on easy-to-classify cases that have the highest chances of success. Therefore, we propose a method which selects only the predictions that have the highest confidence. In an experiment on 50 stocks, each learning model is trained on each stock data and evaluated based on the classification accuracy over a moving time window. The models which have the highest confidence are selected to predict the trend for that stock the next day. The experiment results shows the classification accuracy has improved significantly when the top 10% of predictions were used.

[1]  Donald B. Percival,et al.  An introduction to wavelet analysis with applications to vegetation time series , 2004 .

[2]  Kin Keung Lai,et al.  Multivariate EMD-Based Modeling and Forecasting of Crude Oil Price , 2016 .

[3]  Yuting Wang,et al.  Very Short-Term Load Forecasting: Wavelet Neural Networks With Data Pre-Filtering , 2013, IEEE Transactions on Power Systems.

[4]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[5]  G. J. Janacek,et al.  Time series analysis forecasting and control , 2009 .

[6]  C. Holt Author's retrospective on ‘Forecasting seasonals and trends by exponentially weighted moving averages’ , 2004 .

[7]  Ponnuthurai Nagaratnam Suganthan,et al.  Empirical Mode Decomposition based ensemble deep learning for load demand time series forecasting , 2017, Appl. Soft Comput..

[8]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[9]  Ponnuthurai N. Suganthan,et al.  Random vector functional link network for short-term electricity load demand forecasting , 2016, Inf. Sci..

[10]  P. N. Suganthan,et al.  A comprehensive evaluation of random vector functional link networks , 2016, Inf. Sci..

[11]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[12]  Rahmat-Allah Hooshmand,et al.  A hybrid intelligent algorithm based short-term load forecasting approach , 2013 .

[13]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[14]  Yue Zhang,et al.  Deep Learning for Event-Driven Stock Prediction , 2015, IJCAI.

[15]  Georges A. Darbellay,et al.  Forecasting the short-term demand for electricity: Do neural networks stand a better chance? , 2000 .

[16]  T. Hesterberg,et al.  A regression-based approach to short-term system load forecasting , 1989, Conference Papers Power Industry Computer Application Conference.

[17]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[18]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[19]  A. Walden,et al.  Wavelet Methods for Time Series Analysis , 2000 .

[20]  Robert P. W. Duin,et al.  Feedforward neural networks with random weights , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[21]  Dejan J. Sobajic,et al.  Neural-net computing and the intelligent control of systems , 1992 .

[22]  Maria Q. Feng,et al.  A technique to improve the empirical mode decomposition in the Hilbert-Huang transform , 2003 .

[23]  Ömer Kaan Baykan,et al.  Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange , 2011, Expert Syst. Appl..

[24]  Sergio Ortobelli Lozza,et al.  Fusion of multiple diverse predictors in stock market , 2017, Inf. Fusion.

[25]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[26]  Ponnuthurai Nagaratnam Suganthan,et al.  Fusion of multiple indicators with ensemble incremental learning techniques for stock price forecasting , 2019, J. Bank. Financial Technol..

[27]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[28]  Ponnuthurai N. Suganthan,et al.  Ensemble incremental learning Random Vector Functional Link network for short-term electric load forecasting , 2018, Knowl. Based Syst..

[29]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[30]  K. Satheesh Kumar,et al.  Improved week-ahead predictions of wind speed using simple linear models with wavelet decomposition , 2016 .

[31]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[32]  Ponnuthurai N. Suganthan,et al.  Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article] , 2016, IEEE Computational Intelligence Magazine.

[33]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[34]  L. Breiman Stacked Regressions , 1996, Machine Learning.

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.