An analysis of the automatic adaptation of the crossover rate in differential evolution

Differential Evolution (DE) is a very efficient meta-heuristic for optimization over continuous spaces which has gained much popularity in recent years. Several parameter control strategies have been proposed to automatically adapt its internal parameters. The most advanced DE variants take into account the feedback obtained in the optimization process to guide the dynamic setting of the DE parameters. Indeed, the automatic adaptation of the crossover rate (CR) has attracted a lot of research in the last decades. In most of such strategies, the quality of using a given CR value is measured by considering the probability of performing a replacement in the DE selection stage when such a value is applied. One of the main contributions of this paper is to experimentally show that the probability of replacement induced by the application of a given CR value and the quality of the obtained results are not as correlated as expected. This might cause a performance deterioration that avoids the achievement of good quality solutions even in the long-term. In addition, the experimental evaluation developed with a set of optimization problems of varying complexities clarifies some of the advantages and drawbacks of the different tested strategies. The only component varied among the different tested schemes has been the CR control strategy. The study presented in this paper provides advances in the understanding of the inner working of several state-of-the-art adaptive DE variants.

[1]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[2]  Thomas Bäck,et al.  The Interaction of Mutation Rate, Selection, and Self-Adaptation Within a Genetic Algorithm , 1992, PPSN.

[3]  Janez Brest,et al.  An Analysis of the Control Parameters’ Adaptation in DE , 2008 .

[4]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[5]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[6]  Lalit M. Patnaik,et al.  Adaptive probabilities of crossover and mutation in genetic algorithms , 1994, IEEE Trans. Syst. Man Cybern..

[7]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[8]  Rainer Storn,et al.  Minimizing the real functions of the ICEC'96 contest by differential evolution , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[9]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[10]  Carlos A. Coello Coello,et al.  On the adaptation of the mutation scale factor in differential evolution , 2015, Optim. Lett..

[11]  Karl-Dirk Kammeyer,et al.  Parameter Study for Differential Evolution Using a Power Allocation Problem Including Interference Cancellation , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[12]  Antonio LaTorre,et al.  A MOS-based dynamic memetic differential evolution algorithm for continuous optimization: a scalability test , 2011, Soft Comput..

[13]  Rainer Laur,et al.  Comparison of Adaptive Approaches for Differential Evolution , 2008, PPSN.

[14]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[15]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[16]  Jongrae Kim,et al.  Clearance of Nonlinear Flight Control Laws Using Hybrid Evolutionary Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[17]  Josef Tvrdík,et al.  Competitive differential evolution for constrained problems , 2010, IEEE Congress on Evolutionary Computation.

[18]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[19]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[20]  K.P. Wong,et al.  Application of Differential Evolution Algorithm for Transient Stability Constrained Optimal Power Flow , 2008, IEEE Transactions on Power Systems.

[21]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[22]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[23]  Fei Peng,et al.  Multi-start JADE with knowledge transfer for numerical optimization , 2009, IEEE Congress on Evolutionary Computation.

[24]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[25]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[26]  A. E. Eiben,et al.  Parameter tuning for configuring and analyzing evolutionary algorithms , 2011, Swarm Evol. Comput..

[27]  Petr Bujok,et al.  Adaptive Variants of Differential Evolution: Towards Control-Parameter-Free Optimizers , 2013, Handbook of Optimization.

[28]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[29]  Francisco Herrera,et al.  Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems , 2011, Soft Comput..

[30]  Riccardo Poli,et al.  Evolving Problems to Learn About Particle Swarm Optimizers and Other Search Algorithms , 2006, IEEE Transactions on Evolutionary Computation.

[31]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[32]  Carlos A. Coello Coello,et al.  Promising infeasibility and multiple offspring incorporated to differential evolution for constrained optimization , 2005, GECCO '05.