Searching for Balance: Understanding Self-adaptation on Ridge Functions

The progress rate of a self-adaptive evolution strategy is sub-optimal on ridge functions because the global step-size, denoted σ, becomes too small. On the parabolic ridge we conjecture that σ will stabilize when selection is unbiased towards larger or smaller step-sizes. On the sharp ridge, where the bias in selection is constant, σ will continue to decrease. We show that this is of practical interest because ridges can cause even the best solutions found by self-adaptation to be of little value on ridge problems where spatially close parameters tend to have similar values.

[1]  Hans-Georg Beyer,et al.  On the performance of (1, Lambda)-evolution strategies for the ridge function class , 2001, IEEE Trans. Evol. Comput..

[2]  Hans-Georg Beyer,et al.  Analysis of the (/, )-ES on the Parabolic Ridge , 2000, Evolutionary Computation.

[3]  A. Denning,et al.  Global observations of the carbon budget: 1. Expected satellite capabilities for emission spectroscopy in the EOS and NPOESS eras , 2001 .

[4]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[5]  Hans-Paul Schwefel,et al.  Where Elitists Start Limping Evolution Strategies at Ridge Functions , 1998, PPSN.

[6]  A I Oyman,et al.  Analysis of the (1, )-ES on the Parabolic Ridge , 2000, Evolutionary Computation.

[7]  Nikolaus Hansen,et al.  Invariance, Self-Adaptation and Correlated Mutations and Evolution Strategies , 2000, PPSN.

[8]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 , 2000 .

[9]  Nikolaus Hansen,et al.  A Derandomized Approach to Self-Adaptation of Evolution Strategies , 1994, Evolutionary Computation.

[10]  Paulo S. Salomon Applying evolutionary algorithms to real-world-inspired problems with physical smoothness constraints , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[11]  L. Darrell Whitley,et al.  Ruffled by Ridges: How Evolutionary Algorithms Can Fail , 2004, GECCO.

[12]  Michael Herdy,et al.  Reproductive Isolation as Strategy Parameter in Hierarichally Organized Evolution Strategies , 1992, PPSN.

[13]  Ralf Salomon,et al.  The curse of high-dimensional search spaces: observing premature convergence in unimodal functions , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[14]  Hans-Georg Beyer,et al.  Evolution strategies with cumulative step length adaptation on the noisy parabolic ridge , 2008, Natural Computing.

[15]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.