Analysis of the (μ/μI,λ)-CSA-ES with Repair by Projection Applied to a Conically Constrained Problem

Theoretical analyses of evolution strategies are indispensable for gaining a deep understanding of their inner workings. For constrained problems, rather simple problems are of interest in the current research. This work presents a theoretical analysis of a multi-recombinative evolution strategy with cumulative step size adaptation applied to a conically constrained linear optimization problem. The state of the strategy is modeled by random variables and a stochastic iterative mapping is introduced. For the analytical treatment, fluctuations are neglected and the mean value iterative system is considered. Nonlinear difference equations are derived based on one-generation progress rates. Based on that, expressions for the steady state of the mean value iterative system are derived. By comparison with real algorithm runs, it is shown that for the considered assumptions, the theoretical derivations are able to predict the dynamics and the steady state values of the real runs.

[1]  Dirk V. Arnold,et al.  On the Behaviour of the (1, λ)-ES for Conically Constrained Linear Problems , 2014, Evolutionary Computation.

[2]  Hans-Georg Beyer,et al.  Analysis of the (μ/μI, λ)-σ-Self-Adaptation Evolution Strategy with Repair by Projection Applied to a Conically Constrained Problem , 2019, Theor. Comput. Sci..

[3]  Hans-Georg Beyer,et al.  A Covariance Matrix Self-Adaptation Evolution Strategy for Optimization Under Linear Constraints , 2018, IEEE Transactions on Evolutionary Computation.

[4]  Dirk V. Arnold.  On the behaviour of the (1, λ)-es for a conically constrained problem , 2013, GECCO '13.

[5]  Hans-Georg Beyer,et al.  Analysis of the $(\mu/\mu_{I},\lambda)-\sigma$ -Self-Adaptation Evolution Strategy With Repair by Projection Applied to a Conically Constrained Problem , 2020, IEEE Transactions on Evolutionary Computation.

[6]  N. Hansen,et al.  Convergence Properties of Evolution Strategies with the Derandomized Covariance Matrix Adaptation: T , 1997 .

[7]  Dirk V. Arnold,et al.  On the behaviour of the (1,λ)-es for a simple constrained problem , 2011, FOGA '11.

[8]  Dirk V. Arnold,et al.  Towards an Augmented Lagrangian Constraint Handling Approach for the (1+1)-ES , 2015, GECCO.

[9]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Tutorial , 2016, ArXiv.

[10]  Anne Auger,et al.  Linearly Convergent Evolution Strategies via Augmented Lagrangian Constraint Handling , 2017, FOGA '17.

[11]  Dirk V. Arnold,et al.  Comparison of Constraint-Handling Mechanisms for the (1,λ)-ES on a Simple Constrained Problem , 2016, Evolutionary Computation.

[12]  Dirk V. Arnold,et al.  Analysis of a repair mechanism for the (1,λ)-ES applied to a simple constrained problem , 2011, GECCO '11.

[13]  Hans-Georg Beyer,et al.  On the Design of Constraint Covariance Matrix Self-Adaptation Evolution Strategies Including a Cardinality Constraint , 2012, IEEE Transactions on Evolutionary Computation.

[14]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[15]  Anne Auger,et al.  Augmented Lagrangian Constraint Handling for CMA-ES - Case of a Single Linear Constraint , 2016, PPSN.

[16]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.