Differential evolution with multi-population based ensemble of mutation strategies

A multi-population based approach is proposed to realize the adapted ensemble of multiple strategies of differential evolution.The control parameters of each mutation strategy are adapted independently.Extensive experiments are conducted to test the performance of multi-population ensemble DE (MPEDE). Differential evolution (DE) is among the most efficient evolutionary algorithms (EAs) for global optimization and now widely applied to solve diverse real-world applications. As the most appropriate configuration of DE to efficiently solve different optimization problems can be significantly different, an appropriate combination of multiple strategies into one DE variant attracts increasing attention recently. In this study, we propose a multi-population based approach to realize an ensemble of multiple strategies, thereby resulting in a new DE variant named multi-population ensemble DE (MPEDE) which simultaneously consists of three mutation strategies, i.e., "current-to-pbest/1" and "current-to-rand/1" and "rand/1". There are three equally sized smaller indicator subpopulations and one much larger reward subpopulation. Each constituent mutation strategy has one indicator subpopulation. After every certain number of generations, the current best performing mutation strategy will be determined according to the ratios between fitness improvements and consumed function evaluations. Then the reward subpopulation will be allocated to the determined best performing mutation strategy dynamically. As a result, better mutation strategies obtain more computational resources in an adaptive manner during the evolution. The control parameters of each mutation strategy are adapted independently as well. Extensive experiments on the suit of CEC 2005 benchmark functions and comprehensive comparisons with several other efficient DE variants show the competitive performance of the proposed MPEDE (Matlab codes of MPEDE are available from http://guohuawunudt.gotoip2.com/publications.html).

[1]  Pradipta Kishore Dash,et al.  A self adaptive differential harmony search based optimized extreme learning machine for financial time series prediction , 2014, Swarm Evol. Comput..

[2]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[3]  Sanyang Liu,et al.  A Cluster-Based Differential Evolution With Self-Adaptive Strategy for Multimodal Optimization , 2014, IEEE Transactions on Cybernetics.

[4]  Tapabrata Ray,et al.  Differential Evolution With Dynamic Parameters Selection for Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[5]  Qingfu Zhang,et al.  Decomposition-Based Multiobjective Evolutionary Algorithm With an Ensemble of Neighborhood Sizes , 2012, IEEE Transactions on Evolutionary Computation.

[6]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[7]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Wei-jie Yu,et al.  Multi-population differential evolution with adaptive parameter control for global optimization , 2011, GECCO '11.

[9]  Yiqiao Cai,et al.  Differential Evolution Enhanced With Multiobjective Sorting-Based Mutation Operators , 2014, IEEE Transactions on Cybernetics.

[10]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[11]  M. Pandit,et al.  Self-Organizing Hierarchical Particle Swarm Optimization for Nonconvex Economic Dispatch , 2008, IEEE Transactions on Power Systems.

[12]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[13]  Yang Tang,et al.  Adaptive population tuning scheme for differential evolution , 2013, Inf. Sci..

[14]  P. N. Suganthan,et al.  Multi-population differential evolution with balanced ensemble of mutation strategies for large-scale global optimization , 2015, Appl. Soft Comput..

[15]  Amir Hossein Gandomi,et al.  Firefly Algorithm for solving non-convex economic dispatch problems with valve loading effect , 2012, Appl. Soft Comput..

[16]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[17]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[18]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[19]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[20]  A. Selvakumar,et al.  A New Particle Swarm Optimization Solution to Nonconvex Economic Dispatch Problems , 2007, IEEE Transactions on Power Systems.

[21]  Hui Li,et al.  Adaptive strategy selection in differential evolution for numerical optimization: An empirical study , 2011, Inf. Sci..

[22]  Amit Konar,et al.  Differential Evolution with Local Neighborhood , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[23]  Lixin Tang,et al.  Differential Evolution With an Individual-Dependent Mechanism , 2015, IEEE Transactions on Evolutionary Computation.

[24]  Cheng-Chien Kuo,et al.  A Novel Coding Scheme for Practical Economic Dispatch by Modified Particle Swarm Approach , 2008, IEEE Transactions on Power Systems.

[25]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[26]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[27]  Aimin Zhou,et al.  A Multioperator Search Strategy Based on Cheap Surrogate Models for Evolutionary Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[28]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[29]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[30]  Ajith Abraham,et al.  Improved differential evolution algorithm with decentralisation of population , 2011, Int. J. Bio Inspired Comput..

[31]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[32]  Licheng Jiao,et al.  A multi-population cooperative coevolutionary algorithm for multi-objective capacitated arc routing problem , 2014, Inf. Sci..

[33]  Rami N. Khushaba,et al.  Feature subset selection using differential evolution and a wheel based search strategy , 2013, Swarm Evol. Comput..

[34]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[35]  E. Kyriakides,et al.  A GA-API Solution for the Economic Dispatch of Generation in Power System Operation , 2012, IEEE Transactions on Power Systems.

[36]  Gexiang Zhang,et al.  Enhancing distributed differential evolution with multicultural migration for global numerical optimization , 2013, Inf. Sci..

[37]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[38]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[39]  Swagatam Das,et al.  An Improved Parent-Centric Mutation With Normalized Neighborhoods for Inducing Niching Behavior in Differential Evolution , 2014, IEEE Transactions on Cybernetics.

[40]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[41]  Witold Pedrycz,et al.  Superior solution guided particle swarm optimization combined with local search techniques , 2014, Expert Syst. Appl..

[42]  Witold Pedrycz,et al.  A variable reduction strategy for evolutionary algorithms handling equality constraints , 2015, Appl. Soft Comput..

[43]  Nantiwat Pholdee,et al.  Hybridisation of real-code population-based incremental learning and differential evolution for multiobjective design of trusses , 2013, Inf. Sci..

[44]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[45]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[46]  Ming Yang,et al.  Differential Evolution With Auto-Enhanced Population Diversity , 2015, IEEE Transactions on Cybernetics.

[47]  Z. Dong,et al.  A Modified Differential Evolution Algorithm With Fitness Sharing for Power System Planning , 2008, IEEE Transactions on Power Systems.

[48]  Mehmet Fatih Tasgetiren,et al.  Dynamic multi-swarm particle swarm optimizer with harmony search , 2011, Expert Syst. Appl..

[49]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[50]  Rainer Storn,et al.  Differential Evolution-A simple evolution strategy for fast optimization , 1997 .

[51]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[52]  Samir Sayah,et al.  A hybrid differential evolution algorithm based on particle swarm optimization for nonconvex economic dispatch problems , 2013, Appl. Soft Comput..

[53]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[54]  K.P. Wong,et al.  Application of Differential Evolution Algorithm for Transient Stability Constrained Optimal Power Flow , 2008, IEEE Transactions on Power Systems.

[55]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[56]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[58]  Long Li,et al.  Differential evolution based on covariance matrix learning and bimodal distribution parameter setting , 2014, Appl. Soft Comput..

[59]  Peter J. Fleming,et al.  General framework for localised multi-objective evolutionary algorithms , 2014, Inf. Sci..

[60]  Xueming Ding,et al.  A Multi-Swarm Self-Adaptive and Cooperative Particle Swarm Optimization , 2011, Eng. Appl. Artif. Intell..

[61]  Carlos Cruz Corona,et al.  Self-adaptive, multipopulation differential evolution in dynamic environments , 2013, Soft Comput..

[62]  Yu-Jun Zheng,et al.  A hybrid fireworks optimization method with differential evolution operators , 2015, Neurocomputing.

[63]  Jun Zhang,et al.  A new differential evolution algorithm with dynamic population partition and local restart , 2011, GECCO '11.

[64]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[65]  Yong Wang,et al.  An improved (μ + λ)-constrained differential evolution for constrained optimization , 2013, Inf. Sci..

[66]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[67]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[68]  Jason Sheng-Hong Tsai,et al.  Improving Differential Evolution With a Successful-Parent-Selecting Framework , 2015, IEEE Transactions on Evolutionary Computation.

[69]  Deyun Wang,et al.  Differential evolution improved with self-adaptive control parameters based on simulated annealing , 2014, Swarm Evol. Comput..

[70]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[71]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[72]  Ponnuthurai N. Suganthan,et al.  Empirical investigations into the exponential crossover of differential evolutions , 2013, Swarm Evol. Comput..