An Adaptive Multipopulation Differential Evolution With Dynamic Population Reduction

Developing efficient evolutionary algorithms attracts many researchers due to the existence of optimization problems in numerous real-world applications. A new differential evolution algorithm, ${s}$ TDE- ${d}\text{R}$ , is proposed to improve the search quality, avoid premature convergence, and stagnation. The population is clustered in multiple tribes and utilizes an ensemble of different mutation and crossover strategies. In this algorithm, a competitive success-based scheme is introduced to determine the life cycle of each tribe and its participation ratio for the next generation. In each tribe, a different adaptive scheme is used to control the scaling factor and crossover rate. The mean success of each subgroup is used to calculate the ratio of its participation for the next generation. This guarantees that successful tribes with the best adaptive schemes are only the ones that guide the search toward the optimal solution. The population size is dynamically reduced using a dynamic reduction method. Comprehensive comparison of the proposed heuristic over a challenging set of benchmarks from the CEC2014 real parameter single objective competition against several state-of-the-art algorithms is performed. The results affirm robustness of the proposed approach compared to other state-of-the-art algorithms.

[1]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[2]  Ponnuthurai N. Suganthan,et al.  Ensemble and Arithmetic Recombination-Based Speciation Differential Evolution for Multimodal Optimization , 2016, IEEE Transactions on Cybernetics.

[3]  K. Doksum Robust Procedures for Some Linear Models with one Observation per Cell , 1967 .

[4]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[5]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[6]  Robert G. Reynolds,et al.  Adapting Crossover in Evolutionary Algorithms , 1995 .

[7]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[8]  Arthur C. Sanderson,et al.  Differential evolution for discrete optimization: An experimental study on Combinatorial Auction problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[9]  Minho Lee,et al.  Gaussian adaptation based parameter adaptation for differential evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[10]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[11]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[12]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[13]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[14]  Ming Yang,et al.  Differential Evolution With Auto-Enhanced Population Diversity , 2015, IEEE Transactions on Cybernetics.

[15]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[16]  Mostafa Z. Ali,et al.  A novel class of niche hybrid Cultural Algorithms for continuous engineering optimization , 2014, Inf. Sci..

[17]  Yahya M. Tashtoush,et al.  Cultural Algorithms: Emerging Social Structures for the Solution of Complex Optimization Problems , 2013 .

[18]  István Erlich,et al.  Evaluating the Mean-Variance Mapping Optimization on the IEEE-CEC 2014 test suite , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[19]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[20]  Lei Chen,et al.  An evolutionary algorithm based on Covariance Matrix Leaning and Searching Preference for solving CEC 2014 benchmark problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[21]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[22]  Peter J. Angeline,et al.  Adaptive and Self-adaptive Evolutionary Computations , 1995 .

[23]  P. N. Suganthan,et al.  Multi-population differential evolution with balanced ensemble of mutation strategies for large-scale global optimization , 2015, Appl. Soft Comput..

[24]  Josef Tvrdík,et al.  Evolutionary Algorithms with Competing Heuristics in Computational Statistics , 2002, COMPSTAT.

[25]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[26]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[27]  Jun Zhang,et al.  Differential Evolution with an Evolution Path: A DEEP Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[28]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[29]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[30]  Ruhul A. Sarker,et al.  United multi-operator evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[31]  Wenyin Gong,et al.  Adaptive Ranking Mutation Operator Based Differential Evolution for Constrained Optimization , 2015, IEEE Transactions on Cybernetics.

[32]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[33]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[34]  Christian Gagné,et al.  Improving genetic algorithms performance via deterministic population shrinkage , 2009, GECCO.

[35]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[36]  Robert G. Reynolds,et al.  Leveraged Neighborhood Restructuring in Cultural Algorithms for Solving Real-World Numerical Optimization Problems , 2016, IEEE Transactions on Evolutionary Computation.

[37]  Jason Sheng-Hong Tsai,et al.  Improving Differential Evolution With a Successful-Parent-Selecting Framework , 2015, IEEE Transactions on Evolutionary Computation.

[38]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2008, Applied Intelligence.

[39]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[40]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[41]  Janez Brest,et al.  Performance comparison of self-adaptive and adaptive differential evolution algorithms , 2007, Soft Comput..

[42]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[43]  Arthur C. Sanderson,et al.  An approximate gaussian model of Differential Evolution with spherical fitness functions , 2007, 2007 IEEE Congress on Evolutionary Computation.

[44]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..