Invariance, Self-Adaptation and Correlated Mutations and Evolution Strategies

A conceptual objective behind the self-adaptation of the mutation distribution is to achieve invariance against certain transformations of the search space. In this paper, a priori invariances of a simple evolution strategy and invariances, which can be introduced by self-adaptation, are identified. In principle, correlated mutations can achieve invariance against any linear transformation of the search space. Correlated mutations, as typically implemented, are investigated with respect to both a priori and new invariances. Simulations reveal that neither all a priori invariances are retained, nor the invariance against linear transformation is achieved.

[1]  Hans-Paul Schwefel,et al.  Numerical optimization of computer models , 1981 .

[2]  G. Unter Rudolph On Correlated Mutations in Evolution Strategies , 1992 .

[3]  Hans-Paul Schwefel,et al.  Evolution and Optimum Seeking: The Sixth Generation , 1993 .

[4]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[5]  Ingo Rechenberg,et al.  Evolutionsstrategie '94 , 1994, Werkstatt Bionik und Evolutionstechnik.

[6]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[7]  Nikolaus Hansen,et al.  On the Adaptation of Arbitrary Normal Mutation Distributions in Evolution Strategies: The Generating Set Adaptation , 1995, ICGA.

[8]  R. Salomon Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[9]  Patrick D. Surry,et al.  Formal Algorithms + Formal Representations = Search Strategies , 1996, PPSN.

[10]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[11]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[12]  Nikolaus Hansen,et al.  Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[13]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[14]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[15]  Nikolaus Hansen,et al.  Verallgemeinerte individuelle Schrittweitenregelung in der Evolutionsstrategie , 1998 .

[16]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[17]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.