Annealed Differential Evolution

Differential evolution (DE) has recently emerged as a leading methodology for global search and optimization over continuous, high-dimensional spaces. It has been successfully applied to a wide variety of nearly intractable engineering problems. However, the DE and its variants usually employ a deterministic selection mechanism that always allows the better solution to survive to the next generation. This often prevents DE from escaping local optima at the early stages of search over a multi-modal fitness landscape and leads to a premature convergence. The present work proposes to improve the accuracy and convergence speed of DE by introducing a stochastic selection mechanism. The idea of a conditional acceptance function (that allows accepting inferior solutions with a gradually decaying probability) is borrowed from the realm of the simulated annealing (SA). In addition, the work proposes a center of mass based mutation operator and a decreasing crossover rate in DE. Performance of the resulting hybrid algorithm has been compared with three state-of-the-art adaptive DE schemes. The method is shown to be statistically significantly better on a six-function test-bed and one difficult engineering optimization problem with respect to the following performance measures: solution quality, time to find the solution, frequency of finding the solution, and scalability.

[1]  Andries Petrus Engelbrecht,et al.  Differential evolution methods for unsupervised image classification , 2005, 2005 IEEE Congress on Evolutionary Computation.

[2]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[3]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[4]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[5]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[6]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[7]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[9]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[11]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[12]  Mirjana Cangalovic,et al.  Solving spread spectrum radar polyphase code design problem by tabu search and variable neighbourhood search , 2003, Eur. J. Oper. Res..

[13]  Dana Petcu,et al.  Adaptive Pareto Differential Evolution and Its Parallelization , 2003, PPAM.

[14]  Qing Ling,et al.  A Differential Evolution with Simulated Annealing Updating Method , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[15]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.