Design of hybrid differential evolution and group method of data handling networks for modeling and prediction

This paper proposes a hybrid modeling approach based on two familiar non-linear methods of mathematical modeling; the group method of data handling (GMDH) and differential evolution (DE) population-based algorithm. The proposed method constructs a GMDH self-organizing network model of a population of promising DE solutions. The new hybrid implementation is then applied to modeling tool wear in milling operations and also applied to two representative time series prediction problems of exchange rates of three international currencies and the well-studied Box-Jenkins gas furnace process data. The results of the proposed DE-GMDH approach are compared with the results obtained by the standard GMDH algorithm and its variants. Results presented show that the proposed DE-GMDH algorithm appears to perform better than the standard GMDH algorithm and the polynomial neural network (PNN) model for the tool wear problem. For the exchange rate problem, the results of the proposed DE-GMDH algorithm are competitive with all other approaches except in one case. For the Box-Jenkins gas furnace data, the experimental results clearly demonstrates that the proposed DE-GMDH-type network outperforms the existing models both in terms of better approximation capabilities as well as generalization abilities. Consequently, this self-organizing modeling approach may be useful in modeling advanced manufacturing systems where it is necessary to model tool wear during machining operations, and in time series applications such as in prediction of time series exchange rate and industrial gas furnace problems.

[1]  Euntai Kim,et al.  A Simple Identified Sugeno-Type Fuzzy Model via Double Clustering , 1998, Inf. Sci..

[2]  Nachol Chaiyaratana,et al.  Thalassaemia classification by neural networks and genetic programming , 2007, Inf. Sci..

[3]  Seok-Beom Roh,et al.  Genetically optimized fuzzy polynomial neural networks with fuzzy set-based polynomial neurons , 2006, Inf. Sci..

[4]  Sung-Kwun Oh,et al.  Evolutionary design of hybrid self-organizing fuzzy polynomial neural networks with the aid of information granulation , 2007, Expert Syst. Appl..

[5]  Hamparsum Bozdogan,et al.  Statistical Data Mining and Knowledge Discovery , 2004 .

[6]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[7]  Jingtao Yao,et al.  A case study on using neural networks to perform technical forecasting of forex , 2000, Neurocomputing.

[8]  Sung-Kwun Oh,et al.  Genetically Optimized Hybrid Fuzzy Neural Networks Based on Linear Fuzzy Inference Rules , 2005 .

[9]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[10]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[11]  J. K. Kinnear,et al.  Advances in Genetic Programming , 1994 .

[12]  Vasan Arunachalam,et al.  Optimization Using Differential Evolution , 2008 .

[13]  Sung-Kwun Oh,et al.  Identification of fuzzy systems by means of an auto-tuning algorithm and its application to nonlinear systems , 2000, Fuzzy Sets Syst..

[14]  Godfrey C. Onwubolu,et al.  Scheduling flow shops using differential evolution algorithm , 2006, Eur. J. Oper. Res..

[15]  R. Tong The evaluation of fuzzy models derived from experimental data , 1980 .

[16]  W. Pedrycz An identification algorithm in fuzzy relational systems , 1984 .

[17]  Nader Nariman-zadeh,et al.  Hybrid genetic design of GMDH-type neural networks using singular value decomposition for modelling and prediction of the explosive cutting process , 2003 .

[18]  A. G. Ivakhnenko,et al.  Polynomial Theory of Complex Systems , 1971, IEEE Trans. Syst. Man Cybern..

[19]  Sung-Kwun Oh,et al.  Self-Organizing Polynomial Neural Networks Based on Genetically Optimized Multi-Layer Perceptron Architecture , 2004 .

[20]  Jacek M. Leski,et al.  A new artificial neural network based fuzzy inference system with moving consequents in if-then rules and selected applications , 1999, Fuzzy Sets Syst..

[21]  Ivan Zelinka,et al.  Flow Shop Scheduling Using Clustered Differential Evolution , 2009, ECMS.

[22]  K. Asai,et al.  Fuzzy linear programming problems with fuzzy numbers , 1984 .

[23]  Hitoshi Iba,et al.  Genetic programming using a minimum description length principle , 1994 .

[24]  Sung-Kwun Oh,et al.  Rule-Based Fuzzy Polynomial Neural Networks in Modeling Software Process Data , 2003 .

[25]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[26]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[27]  William H. Press,et al.  Numerical recipes in C++: the art of scientific computing, 2nd Edition (C++ ed., print. is corrected to software version 2.10) , 1994 .

[28]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[29]  Stanley J. Farlow,et al.  Self-Organizing Methods in Modeling: Gmdh Type Algorithms , 1984 .

[30]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[31]  Antonio F. Gómez-Skarmeta,et al.  About the use of fuzzy clustering techniques for fuzzy model identification , 1999, Fuzzy Sets Syst..

[32]  Sung-Kwun Oh,et al.  The design of self-organizing Polynomial Neural Networks , 2002, Inf. Sci..

[33]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[34]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[35]  Yu-Geng Xi,et al.  A clustering algorithm for fuzzy model identification , 1998, Fuzzy Sets Syst..

[36]  Gwi-Tae Park,et al.  GMDH-Type Neural Network Modeling in Evolutionary Optimization , 2005, IEA/AIE.

[37]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[38]  D. Davendra,et al.  Flow Shop Scheduling Using Enhanced Differential Evolution Algorithm , 2007 .

[39]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[40]  Javier Echanobe,et al.  An adaptive neuro-fuzzy system for efficient implementations , 2008, Inf. Sci..

[41]  N Mort,et al.  Using Genetic Programming to Improve the Group Method of Data Handling in Time Series Prediction , 2003 .