Covariance Matrix Adaptation Revisited - The CMSA Evolution Strategy -

The covariance matrix adaptation evolution strategy (CMA-ES) rates among the most successful evolutionary algorithms for continuous parameter optimization. Nevertheless, it is plagued with some drawbacks like the complexity of the adaptation process and the reliance on a number of sophisticatedly constructed strategy parameter formulae for which no or little theoretical substantiation is available. Furthermore, the CMA-ES does not work well for large population sizes. In this paper, we propose an alternative --- simpler --- adaptation step of the covariance matrix which is closer to the "traditional" mutative self-adaptation. We compare the newly proposed algorithm, which we term the CMSA-ES, with the CMA-ES on a number of different test functions and are able to demonstrate its superiority in particular for large population sizes.

[1]  Hans-Georg Beyer,et al.  Performance analysis of evolutionary optimization with cumulative step length adaptation , 2004, IEEE Transactions on Automatic Control.

[2]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[3]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[4]  Anne Auger,et al.  LS-CMA-ES: A Second-Order Algorithm for Covariance Matrix Adaptation , 2004, PPSN.

[5]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[6]  Bernhard Sendhoff,et al.  Evolution Strategies for Robust Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[7]  Bernhard Sendhoff,et al.  On the Behavior of (μ/μ1, λ)-ES Optimizing Functions Disturbed by Generalized Noise , 2002, FOGA.

[8]  Nikolaus Hansen,et al.  On the Adaptation of Arbitrary Normal Mutation Distributions in Evolution Strategies: The Generating Set Adaptation , 1995, ICGA.

[9]  Bernhard Sendhoff,et al.  Robust Optimization - A Comprehensive Survey , 2007 .

[10]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[11]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[12]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[14]  Bjarne Amstrup,et al.  Genetic Algorithm with Migration on Topology Conserving Maps for Optimal Control of Quantum Systems , 1995 .

[15]  Hans-Georg Beyer,et al.  Qualms Regarding the Optimality of Cumulative Path Length Control in CSA/CMA-Evolution Strategies , 2003, Evolutionary Computation.