Gaussian adaptation based parameter adaptation for differential evolution

Differential Evolution (DE), a global optimization algorithm based on the concepts of Darwinian evolution, is popular for its simplicity and effectiveness in solving numerous real-world optimization problems in real-valued spaces. The effectiveness of DE is due to the differential mutation operator that allows DE to automatically adjust between the exploration/exploitation in its search moves. However, the performance of DE is dependent on the setting of control parameters such as the mutation factor and the crossover probability. Therefore, to obtain optimal performance preliminary tuning of the numerical parameters, which is quite timing consuming, is needed. Recently, different parameter adaptation techniques, which can automatically update the control parameters to appropriate values to suit the characteristics of optimization problems, have been proposed. However, most of the adaptation techniques try to adapt each of the parameter individually but do not take into account interaction between the parameters that are being adapted. In this paper, we introduce a DE self-adaptive scheme that takes into account the parameters dependencies by means of a multivariate probabilistic technique based on Gaussian Adaptation working on the parameter space. The performance of the DE algorithm with the proposed parameter adaptation scheme is evaluated on the benchmark problems designed for CEC 2014.

[1]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[2]  Rainer Storn,et al.  Differential Evolution-A simple evolution strategy for fast optimization , 1997 .

[3]  Rammohan Mallipeddi Harmony Search Based Parameter Ensemble Adaptation for Differential Evolution , 2013, J. Appl. Math..

[4]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[5]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[6]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[7]  Marcus Gallagher,et al.  Experimental results for the special session on real-parameter optimization at CEC 2005: a simple, continuous EDA , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[9]  Josef Tvrdík Adaptation in differential evolution: A numerical comparison , 2009, Appl. Soft Comput..

[10]  Amit Konar,et al.  Automatic image pixel clustering with an improved differential evolution , 2009, Appl. Soft Comput..

[11]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[12]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[13]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[14]  Dana Petcu,et al.  Adaptive Pareto Differential Evolution and Its Parallelization , 2003, PPAM.

[15]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[16]  Ponnuthurai Nagaratnam Suganthan,et al.  ROBUST ADAPTIVE BEAMFORMING BASED ON COVARIANCE MATRIX RECONSTRUCTION FOR LOOK DIRECTION MISMATCH , 2011 .

[17]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[18]  Arthur C. Sanderson,et al.  An approximate gaussian model of Differential Evolution with spherical fitness functions , 2007, 2007 IEEE Congress on Evolutionary Computation.

[19]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[20]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[21]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[22]  Rainer Storn,et al.  Differential evolution design of an IIR-filter , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[23]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[24]  Ponnuthurai Nagaratnam Suganthan,et al.  Fiber Bragg grating sensor array interrogation using differential evolution , 2008 .

[25]  Christian L. Müller,et al.  Gaussian Adaptation Revisited - An Entropic View on Covariance Matrix Adaptation , 2010, EvoApplications.

[26]  Ponnuthurai N. Suganthan,et al.  Efficient constraint handling for optimal reactive power dispatch problems , 2012, Swarm Evol. Comput..

[27]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[28]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.