An ensemble of differential evolution algorithms with variable neighborhood search for constrained function optimization

In this paper, an ensemble of differential evolution algorithms based on a variable neighborhood search algorithm (EDE-VNS) is proposed so as to solve the constrained real parameter-optimization problems. The performance of DE algorithms heavily depends on the mutation strategies, crossover operators and control parameters employed. The proposed EDE-VNS algorithm employs multiple mutation operators and control parameters in its VNS loops to enhance the solution quality. In addition, we utilize opposition-based learning (OBL) to take advantages of opposite solutions to find a candidate solution which might be close to the global optimum. In addition, we also present an idea of injecting some good dimensional values from promising areas in the population to the trial individual through the injection procedure. The computational results show that the EDE-VNS algorithm is very competitive to some of the best performing algorithms from the literature.

[1]  Yafei Huang,et al.  A hybrid differential evolution augmented Lagrangian method for constrained numerical and engineering optimization , 2013, Comput. Aided Des..

[2]  Zhijian Wu,et al.  Enhancing particle swarm optimization using generalized opposition-based learning , 2011, Inf. Sci..

[3]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[4]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[5]  Feng-Sheng Wang,et al.  Hybrid differential evolution with multiplier updating method for nonlinear constrained optimization problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[6]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[7]  Janez Brest,et al.  Population Reduction Differential Evolution with Multiple Mutation Strategies in Real World Industry Challenges , 2012, ICAISC.

[8]  J. Lampinen A constraint handling approach for the differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[9]  Mehmet Fatih Tasgetiren,et al.  An ensemble of differential evolution algorithms for constrained function optimization , 2010, IEEE Congress on Evolutionary Computation.

[10]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[11]  Zhijian Wu,et al.  Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems , 2011, Soft Comput..

[12]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[13]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[14]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[15]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[16]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[17]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2008, Applied Intelligence.

[18]  Ruhul A. Sarker,et al.  A self-adaptive combined strategies algorithm for constrained optimization using differential evolution , 2014, Appl. Math. Comput..

[19]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[20]  J. Lampinen Multi-Constrained Nonlinear Optimization by the Differential Evolution Algorithm , 2002 .

[21]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution for Optimization of Noisy Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[22]  Alice E. Smith,et al.  Genetic Optimization Using A Penalty Function , 1993, ICGA.

[23]  Wenyin Gong,et al.  Engineering optimization by means of an improved constrained differential evolution , 2014 .

[24]  Zhijian Wu,et al.  A Scalability Test for Accelerated DE Using Generalized Opposition-Based Learning , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[25]  Tetsuyuki Takahama,et al.  Constrained Optimization by the ε Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[26]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[27]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[28]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[29]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[30]  Ruhul A. Sarker,et al.  A new genetic algorithm for solving optimization problems , 2014, Eng. Appl. Artif. Intell..

[31]  Haralambos Sarimveis,et al.  A line up evolutionary algorithm for solving nonlinear constrained optimization problems , 2005, Comput. Oper. Res..

[32]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[33]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[34]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[36]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[37]  Gary G. Yen,et al.  A Self Adaptive Penalty Function Based Algorithm for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[38]  Ali Wagdy Mohamed,et al.  Constrained optimization based on modified differential evolution algorithm , 2012, Inf. Sci..