Resource allocation between initialization and optimization under computational expensive environment

Initialization techniques are normally considered as “resource-free” and their computational complexities are seldom addressed. Since many techniques require objective function evaluations to generate initial solutions, this “resource-free” assumption is invalid under computational expensive environment. In this paper, we propose an Computational Resource Optimization Problem (CROP) between initialization and optimization under such environment. We provide a comparison metric among different initialization techniques. Four popular initialization techniques, namely, Pseudo Random Number Generator (PRNG), Opposition-based Learning (OBL), Quasi-Opposition-based Learning (QOBL) and Quadratic Interpolation (QI) are studied. Differential Evolution (DE) is used as the underlying optimization technique, while Chemical Reaction Optimization (CRO) is used to solve CROP. The CEC2014 computational expensive problem set is used as test cases. Our results show the importance of considering resource allocation between initialization and optimization in computational expensive environment.

[1]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[2]  M. Pant,et al.  A New Particle Swarm Optimization with Quadratic Interpolation , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[3]  Victor O. K. Li,et al.  Chemical-Reaction-Inspired Metaheuristic for Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[4]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[5]  Victor O. K. Li,et al.  Evolutionary artificial neural network based on Chemical Reaction Optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[6]  Shahryar Rahnamayan,et al.  Quasi-oppositional Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[7]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[8]  Millie Pant,et al.  Differential Evolution using Quadratic Interpolation for Initializing the Population , 2009, 2009 IEEE International Advance Computing Conference.

[9]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[10]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[11]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[12]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2015 Special Session on Bound Constrained Single-Objective Computationally Expensive Numerical Optimization , 2015 .

[13]  K.P. Wong,et al.  Application of Differential Evolution Algorithm for Transient Stability Constrained Optimal Power Flow , 2008, IEEE Transactions on Power Systems.

[14]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[15]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[16]  Jin Xu,et al.  Chemical Reaction Optimization for the optimal power flow problem , 2012, 2012 IEEE Congress on Evolutionary Computation.

[17]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[18]  Enis Günay,et al.  Efficient edge detection in digital images using a cellular neural network optimized by differential evolution algorithm , 2009, Expert Syst. Appl..

[19]  Yi Sun,et al.  A heuristic to generate initial feasible solutions for the Unit Commitment problem , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).