Evolution strategies with cumulative step length adaptation on the noisy parabolic ridge

This paper presents an analysis of the performance of the (μ/μ,λ)-ES with isotropically distributed mutations and cumulative step length adaptation on the noisy parabolic ridge. Several forms of dependency of the noise strength on the distance from the ridge axis are considered. Closed form expressions are derived that describe the mutation strength and the progress rate of the strategy in high-dimensional search spaces. It is seen that as for the sphere model, larger levels of noise present lead to cumulative step length adaptation generating increasingly inadequate mutation strengths, and that the problem can be ameliorated to some degree by working with larger populations.

[1]  Haikady N. Nagaraja,et al.  18 Concomitants of order statistics , 1998, Order statistics.

[2]  Hans-Georg Beyer,et al.  Performance analysis of evolutionary optimization with cumulative step length adaptation , 2004, IEEE Transactions on Automatic Control.

[3]  Ralf Salomon,et al.  Evolutionary algorithms and gradient search: similarities and differences , 1998, IEEE Trans. Evol. Comput..

[4]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: Self-Adaptation , 1995, Evolutionary Computation.

[5]  Nikolaus Hansen,et al.  Step-Size Adaption Based on Non-Local Use of Selection Information , 1994, PPSN.

[6]  N. Hansen,et al.  Step-Size Adaptation Based on Non-Local Use Selection Information , 1994 .

[7]  Hans-Georg Beyer,et al.  A New Approach for Predicting the Final Outcome of Evolution Strategy Optimization Under Noise , 2005, Genetic Programming and Evolvable Machines.

[8]  H. Beyer,et al.  Noisy Local Optimization with Evolution Strategies , 2002 .

[9]  A I Oyman,et al.  Analysis of the (1, )-ES on the Parabolic Ridge , 2000, Evolutionary Computation.

[10]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[11]  Dirk V. Arnold,et al.  Noisy Optimization With Evolution Strategies , 2002, Genetic Algorithms and Evolutionary Computation.

[12]  L. Darrell Whitley,et al.  Ruffled by Ridges: How Evolutionary Algorithms Can Fail , 2004, GECCO.

[13]  Hans-Georg Beyer,et al.  Self-adaptation on the Ridge Function Class: First Results for the Sharp Ridge , 2006, PPSN.

[14]  Nikolaus Hansen,et al.  Verallgemeinerte individuelle Schrittweitenregelung in der Evolutionsstrategie , 1998 .

[15]  Hans-Georg Beyer,et al.  A Comparison of Evolution Strategies with Other Direct Search Methods in the Presence of Noise , 2003, Comput. Optim. Appl..

[16]  Hans-Georg Beyer,et al.  Analysis of the (/, )-ES on the Parabolic Ridge , 2000, Evolutionary Computation.

[17]  Hans-Georg Beyer,et al.  Local performance of the (1 + 1)-ES in a noisy environment , 2002, IEEE Trans. Evol. Comput..

[18]  Dirk V. Arnold,et al.  Optimal Weighted Recombination , 2005, FOGA.

[19]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: On the Benefits of Sex the (/, ) Theory , 1995, Evolutionary Computation.

[20]  Reinhard Männer,et al.  Parallel Problem Solving from Nature — PPSN III , 1994, Lecture Notes in Computer Science.

[21]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[22]  Hans-Georg Beyer,et al.  Local Performance of the (μ/μ, μ)-ES in a Noisy Environment , 2000, FOGA.

[23]  Calyampudi R. Rao,et al.  1 Order statistics: An introduction , 1998, Order statistics.

[24]  Ralf Salomon,et al.  The curse of high-dimensional search spaces: observing premature convergence in unimodal functions , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[25]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[26]  Hans-Georg Beyer,et al.  On the performance of (1,l)-Evolution Strategies at the ridge function class , 2001 .

[27]  Ingo Rechenberg,et al.  Evolutionsstrategie '94 , 1994, Werkstatt Bionik und Evolutionstechnik.

[28]  Hans-Georg Beyer,et al.  Expected sample moments of concomitants of selected order statistics , 2005, Stat. Comput..

[29]  Hans-Georg Beyer,et al.  On the performance of (1, Lambda)-evolution strategies for the ridge function class , 2001, IEEE Trans. Evol. Comput..

[30]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[31]  Dirk V. Arnold,et al.  Hierarchically organised evolution strategies on the parabolic ridge , 2006, GECCO '06.

[32]  Michael Herdy,et al.  Reproductive Isolation as Strategy Parameter in Hierarichally Organized Evolution Strategies , 1992, PPSN.

[33]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[34]  Hans-Paul Schwefel,et al.  Where Elitists Start Limping Evolution Strategies at Ridge Functions , 1998, PPSN.