Markov chain analysis of evolution strategies on a linear constraint optimization problem

This paper analyses a (1, λ)-Evolution Strategy, a randomised comparison-based adaptive search algorithm, on a simple constraint optimization problem. The algorithm uses resampling to handle the constraint and optimizes a linear function with a linear constraint. Two cases are investigated: first the case where the step-size is constant, and second the case where the step-size is adapted using path length control. We exhibit for each case a Markov chain whose stability analysis would allow us to deduce the divergence of the algorithm depending on its internal parameters. We show divergence at a constant rate when the step-size is constant. We sketch that with step-size adaptation geometric divergence takes place. Our results complement previous studies where stability was assumed.

[1]  Dirk V. Arnold,et al.  Analysis of a repair mechanism for the (1,λ)-ES applied to a simple constrained problem , 2011, GECCO '11.

[2]  Anne Auger,et al.  Cumulative Step-size Adaptation on Linear Functions: Technical Report , 2012, PPSN 2012.

[3]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[4]  Dirk V. Arnold,et al.  On the behaviour of the (1,λ)-es for a simple constrained problem , 2011, FOGA '11.

[5]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[6]  Dirk V. Arnold,et al.  On the Behaviour of the (1+1)-ES for a Simple Constrained Problem , 2008, PPSN.

[7]  Petros Koumoutsakos,et al.  A Method for Handling Uncertainty in Evolutionary Optimization With an Application to Feedback Control of Combustion , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[9]  Anne Auger,et al.  Cumulative Step-Size Adaptation on Linear Functions , 2012, PPSN.

[10]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[11]  Dirk V. Arnold,et al.  On the Behaviour of the (1, λ)-σSA-ES for a Constrained Linear Problem , 2012, PPSN.

[12]  N. Hansen,et al.  Markov Chain Analysis of Cumulative Step-Size Adaptation on a Linear Constrained Problem , 2015, Evolutionary Computation.