A matrix adaptation evolution strategy for optimization on general quadratic manifolds

An evolution strategy design is presented that allows for an evolution on general quadratic manifolds. That is, it covers elliptic, parabolic, and hyperbolic equality constraints. The peculiarity of the presented algorithm design is that it is an interior point method. It evaluates the objective function only for feasible search parameter vectors and it evolves itself on the nonlinear constraint manifold. This is achieved by a closed form transformation of an individual's parameter vector, which is in contrast to iterative repair mechanisms. Results of different experiments are presented. A test problem consisting of a spherical objective function and a single hyperbolic/parabolic equality constraint is used. It is designed to be scalable in the dimension and it is used to compare the performance of the developed algorithm with other optimization methods supporting constraints. The experiments show the effectiveness of the proposed algorithm on the considered problems.

[1]  Radka Polakova,et al.  L-SHADE with competing strategies applied to constrained optimization , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[2]  Bernhard Sendhoff,et al.  Simplify Your Covariance Matrix Adaptation Evolution Strategy , 2017, IEEE Transactions on Evolutionary Computation.

[3]  Hans-Georg Beyer,et al.  A Matrix Adaptation Evolution Strategy for Constrained Real-Parameter Optimization , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[4]  Dirk V. Arnold,et al.  Towards an Augmented Lagrangian Constraint Handling Approach for the (1+1)-ES , 2015, GECCO.

[5]  Dipti Srinivasan,et al.  A unified differential evolution algorithm for constrained optimization problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[6]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[7]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[8]  Dirk V. Arnold,et al.  A (1+1)-CMA-ES for constrained optimisation , 2012, GECCO '12.

[9]  Hans-Georg Beyer,et al.  A multi-recombinative active matrix adaptation evolution strategy for constrained optimization , 2019, Soft Comput..

[10]  Steffen Finck,et al.  Worst case search over a set of forecasting scenarios applied to financial stress-testing , 2019, GECCO.

[11]  Ponnuthurai N. Suganthan,et al.  Differential evolution with ensemble of constraint handling techniques for solving CEC 2010 benchmark problems , 2010, IEEE Congress on Evolutionary Computation.

[12]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[13]  Hans-Georg Beyer,et al.  A Covariance Matrix Self-Adaptation Evolution Strategy for Optimization Under Linear Constraints , 2018, IEEE Transactions on Evolutionary Computation.

[14]  Jorge Nocedal,et al.  An interior algorithm for nonlinear optimization that combines line search and trust region steps , 2006, Math. Program..

[15]  Hans-Georg Beyer,et al.  Matrix adaptation evolution strategies for optimization under nonlinear equality constraints , 2020, Swarm Evol. Comput..

[16]  Jorge Nocedal,et al.  An Interior Point Algorithm for Large-Scale Nonlinear Programming , 1999, SIAM J. Optim..

[17]  Dirk V. Arnold,et al.  An Active-Set Evolution Strategy for Optimization with Known Constraints , 2016, PPSN.

[18]  Anne Auger,et al.  Augmented Lagrangian Constraint Handling for CMA-ES - Case of a Single Linear Constraint , 2016, PPSN.

[19]  Jorge Nocedal,et al.  A trust region method based on interior point techniques for nonlinear programming , 2000, Math. Program..

[20]  Anne Auger,et al.  Linearly Convergent Evolution Strategies via Augmented Lagrangian Constraint Handling , 2017, FOGA '17.

[21]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.