A differential covariance matrix adaptation evolutionary algorithm for global optimization

Covariance Matrix Adaptation Evolutionary Strategy (CMA-ES) is arguably one of the most powerful stochastic real-parameter optimization algorithms in current use for non-linear non-convex functions with parameter linkages. Differential Evolution (DE) is again a very powerful but simple evolutionary algorithm for real parameter optimization. In this article we propose a simple but very efficient hybrid evolutionary algorithm named Differential Covariance Matrix Adaptation Evolutionary Algorithm (DCMA-EA), where it creates new population members by using controlled share of its target and the population mean, the scaled difference from current population and the step-size generated through the Covariance Matrix Adaptation. It also incorporates the selection and crossover strategies of DE. The proposed hybrid algorithm has more pronounced explorative and exploitative behaviors than its two ancestors (CMA-ES and DE). We compare DCMA-EA with original CMA-ES, some of the most known DE-variants: SaDE and JADE, and a PSO-based state-of-the-art real optimizer: DMS-PSO (Dynamic Multi Swarm Particle Swarm optimization) and DE/Rand/1/Bin over a test-suite of 20 shifted, rotated, and compositional numerical benchmarks.

[1]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[2]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[3]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[4]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[5]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[6]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[7]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[8]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[9]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[10]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[11]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[12]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[13]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..