Modeling of steelmaking process with effective machine learning techniques

Machine learning methods on open-hearth steel making process prediction.Predicted yield based on 4 machine learning methods has very low errors.Best performance is achieved by SVR. Monitoring and control of the output yield of steel in a steelmaking shop plays a critical role in steel industry. The yield of steel determines how much percentage of hot metal, scrap, and iron ore are being converted into steel ingots. It represents the operational efficiency of the steelmaking shop and is considered as an important performance measure for producing a specific quantity of steel. Due to complexity of the steelmaking process and nonlinear relationship between the process parameters, modeling the input-output process parameters and accurately predicting the output yield in the steelmaking shop is very difficult and has been a major research issue. Statistical models and artificial neural networks (ANN) have been extensively studied by researchers and practitioners to model a variety of complex processes. In the present study, we consider random forests (RF), ANN, dynamic evolving neuro-fuzzy inference system (DENFIS) and support vector regression (SVR) as competitive learning tools to verify the suitability of applications of these approaches and investigate their comparative predictive ability. In the present investigation, 0.00001 of MSE is set as a goal of learning during modeling. Based on real-life data, the computational results depict that the training and testing MSE values of SVR and DENFIS are close to 0.00001 indicating that they have higher prediction ability than ANN and RF. Also, mean absolute percentage prediction errors of the proposed models confirm that the predicted yield based on each method is in good agreement with the testing datasets. Overall, SVR performs best and DENFIS the next best followed by ANN and RF methods respectively. The results suggest that the prediction precision given by SVR can meet the requirement for the actual production of steel.

[1]  Chee Peng Lim,et al.  A hybrid intelligent system for medical data classification , 2014, Expert Syst. Appl..

[2]  Dirk Van den Poel,et al.  Predicting customer retention and profitability by using random forests and regression forests techniques , 2005, Expert Syst. Appl..

[3]  Gérard Biau,et al.  Analysis of a Random Forests Model , 2010, J. Mach. Learn. Res..

[4]  M. Jalali-Heravi,et al.  QSAR study of heparanase inhibitors activity using artificial neural networks and Levenberg-Marquardt algorithm. , 2008, European journal of medicinal chemistry.

[5]  Ushasta Aich,et al.  Modeling of EDM responses by support vector machine regression with parameters selected by particle swarm optimization , 2014 .

[6]  Surjya K. Pal,et al.  Artificial neural network modeling of weld joint strength prediction of a pulsed metal inert gas welding process using arc signals , 2008 .

[7]  Haidar Samet,et al.  A new hybrid Modified Firefly Algorithm and Support Vector Regression model for accurate Short Term Load Forecasting , 2014, Expert Syst. Appl..

[8]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[9]  Sami Ekici,et al.  An adaptive neuro-fuzzy inference system (ANFIS) model for wire-EDM , 2009, Expert Syst. Appl..

[10]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[11]  Eric W. T. Ngai,et al.  Customer churn prediction using improved balanced random forests , 2009, Expert Syst. Appl..

[12]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[13]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[14]  Ömer Kaan Baykan,et al.  Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange , 2011, Expert Syst. Appl..

[15]  Koshun Iha,et al.  Artificial neural networks applied to epoxy composites reinforced with carbon and E-glass fibers: Analysis of the shear mechanical properties , 2007 .

[16]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[17]  Indrajit Mukherjee,et al.  Comparing the performance of neural networks developed by using Levenberg-Marquardt and Quasi-Newton with the gradient descent algorithm for modelling a multiple response grinding process , 2012, Expert Syst. Appl..

[18]  D. Basak,et al.  Support Vector Regression , 2008 .

[19]  Ali Azadeh,et al.  A hybrid simulation-adaptive network based fuzzy inference system for improvement of electricity consumption estimation , 2009, Expert Syst. Appl..

[20]  Qing Zhou,et al.  Modeling of the carbon dioxide capture process system using machine intelligence approaches , 2011, Eng. Appl. Artif. Intell..

[21]  Božidar Šarler,et al.  APPLICATION OF ARTIFICIAL NEURAL NETWORKS TO IMPROVE STEEL PRODUCTION PROCESS , 2012 .

[22]  Jan Kusiak,et al.  Artificial Neural Network Predictive System for Oxygen Steelmaking Converter , 2003 .

[23]  Chuang Liu,et al.  Endpoint prediction model for basic oxygen furnace steel-making based on membrane algorithm evolving extreme learning machine , 2014, Appl. Soft Comput..

[24]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[25]  J. Pereira,et al.  Modeling spatial patterns of fire occurrence in Mediterranean Europe using Multiple Regression and Random Forest , 2012 .

[26]  Gunnar Rätsch,et al.  Soft Margins for AdaBoost , 2001, Machine Learning.

[27]  P. J. García Nieto,et al.  Evolutionary support vector regression algorithm applied to the prediction of the thickness of the chromium layer in a hard chromium plating process , 2014, Appl. Math. Comput..

[28]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  Pijush Samui,et al.  Support vector regression based models to predict fracture characteristics of high strength and ultra high strength concrete beams , 2013 .

[30]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[31]  Pedro Paulo Balestrassi,et al.  Optimization of Radial Basis Function neural network employed for prediction of surface roughness in hard turning process using Taguchi's orthogonal arrays , 2012, Expert Syst. Appl..

[32]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[33]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[34]  Robin Genuer,et al.  Random Forests: some methodological insights , 2008, 0811.3619.

[35]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[36]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[37]  Ling Zhuang,et al.  Prediction of silicon content in hot metal using support vector regression based on chaos particle swarm optimization , 2009, Expert Syst. Appl..

[38]  Amin Talei,et al.  A novel application of a neuro-fuzzy computational technique in event-based rainfall-runoff modeling , 2010, Expert Syst. Appl..

[39]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[40]  Che Hassan Che Haron,et al.  Online tool wear prediction system in the turning process using an adaptive neuro-fuzzy inference system , 2013, Appl. Soft Comput..

[41]  Cheng-Che Chen,et al.  Optimal laser-cutting parameters for QFN packages by utilizing artificial neural networks and genetic algorithm , 2008 .

[42]  J. Paulo Davim,et al.  Delamination analysis in high speed drilling of carbon fiber reinforced plastics (CFRP) using artificial neural network model , 2008 .

[43]  Tuncay Erzurumlu,et al.  Comparison of response surface model with neural network in determining the surface quality of moulded parts , 2007 .

[44]  Jun Wang,et al.  Comparison of random forest, support vector machine and back propagation neural network for electronic tongue data classification: Application to the recognition of orange beverage and Chinese vinegar , 2013 .

[45]  Aleksandar Jovicic,et al.  An application of learning machine methods in prediction of wear rate of wear resistant casting parts , 2013, Comput. Ind. Eng..

[46]  Harri Kiiveri,et al.  Quantifying mixtures of hydrocarbons dissolved in water with a partially selective sensor array using random forests analysis , 2014 .

[47]  Ecir U. Küçüksille,et al.  Data mining approach for supply unbalance detection in induction motor , 2009, Expert Syst. Appl..

[48]  Nikola Kasabov,et al.  Dynamic Evolving Neuro-Fuzzy Inference System (DENFIS): On-line learning and Application for Time-Series Prediction , 2000 .

[49]  James W. Evans,et al.  Modeling of Steelmaking Processes , 2009 .