Influence of crossover on the behavior of Differential Evolution Algorithms

In Differential Evolution Algorithms the crossover operator allows the construction of a new trial element starting from the current and mutant elements. Thus it controls which and how many components are mutated in each element of the current population. This work aims to analyze the impact the crossover operator and its parameter, the crossover rate, has on the behavior of Differential Evolution. The influence of the crossover rate on the distribution of the number of mutated components and on the probability for a component to be taken from the mutant vector (mutation probability) is theoretically analyzed for several variants of crossover, including classical binomial and exponential strategies. For each crossover variant the relationship between the crossover rate and the mutation probability is identified and its impact on the choice and adaptation of control parameters is analyzed theoretically and numerically. The numerical experiments illustrate the fact that the difference between binomial and exponential crossover variants is mainly due to different distributions of the number of mutated components. On the other hand, the behavior of exponential crossover variants was found to be more sensitive to the problem size than the behavior of variants based on binomial crossover.

[1]  K. Zielinski,et al.  Stopping Criteria for Differential Evolution in Constrained Single-Objective Optimization , 2008 .

[2]  Ivanoe De Falco,et al.  Automatic Classification of Handsegmented Image Parts with Differential Evolution , 2006, EvoWorkshops.

[3]  Andreas C. Nearchou,et al.  Differential evolution for sequencing and scheduling optimization , 2006, J. Heuristics.

[4]  Cajo J. F. ter Braak,et al.  A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces , 2006, Stat. Comput..

[5]  Josef Tvrdík,et al.  Adaptive differential evolution and exponential crossover , 2008, 2008 International Multiconference on Computer Science and Information Technology.

[6]  Janez Brest,et al.  Performance comparison of self-adaptive and adaptive differential evolution algorithms , 2007, Soft Comput..

[7]  Josef Tvrdík,et al.  Differential evolution with competitive setting of control parameters , 2007 .

[8]  Andries Petrus Engelbrecht,et al.  Using the Ring Neighborhood Topology with Self-adaptive Differential Evolution , 2006, ICNC.

[9]  P. Vadstrup,et al.  Parameter identification of induction motors using differential evolution , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  B. V. Babu,et al.  Differential evolution strategies for optimal design of shell-and-tube heat exchangers , 2007 .

[12]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[13]  Amit Konar,et al.  Differential Evolution with Local Neighborhood , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[14]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[15]  Kenneth V. Price,et al.  Eliminating Drift Bias from the Differential Evolution Algorithm , 2008 .

[16]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[17]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[18]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[19]  Arthur C. Sanderson,et al.  Multi-objective differential evolution - algorithm, convergence analysis, and applications , 2005, 2005 IEEE Congress on Evolutionary Computation.

[20]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[21]  Tao Gong,et al.  Differential Evolution for Binary Encoding , 2007 .

[22]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[23]  Sandra Paterlini,et al.  Differential evolution and particle swarm optimisation in partitional clustering , 2006, Comput. Stat. Data Anal..

[24]  Andrew M. Sutton,et al.  Differential evolution and non-separability: using selective pressure to focus search , 2007, GECCO '07.

[25]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[26]  Andries Petrus Engelbrecht,et al.  Differential evolution methods for unsupervised image classification , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[28]  L. P. Fatti,et al.  A Differential Free Point Generation Scheme in the Differential Evolution Algorithm , 2006, J. Glob. Optim..