Matrix adaptation evolution strategies for optimization under nonlinear equality constraints

Abstract This work concerns the design of matrix adaptation evolution strategies for black-box optimization under nonlinear equality constraints. First, constraints in form of elliptical manifolds are considered. For those constraints, an algorithm is proposed that evolves itself on that manifold while optimizing the objective function. The specialty about the approach is that it is possible to ensure that the population evolves on the manifold with closed-form expressions. Second, an algorithm design for general nonlinear equality constraints is presented. For those constraints considered, an iterative repair approach is presented. This allows the evolution to happen on the nonlinear manifold defined by the equality constraints for this more general case as well. For both cases, the algorithms are interior point methods, i.e., the objective function is only evaluated at feasible points in the parameter space, which is often required in the area of simulation-based optimization. For the experimental evaluation, different test problems are introduced. The proposed algorithms are evaluated on those providing insights into the working principles of the different approaches. It is experimentally shown that correcting the mutation vectors after the repair step is important for an effective evolution strategy. Additional experiments are conducted for providing a comparison to other evolutionary black-box optimization methods, which show that the developed algorithms are competitive.

[1]  P. Tammes On the origin of number and arrangement of the places of exit on the surface of pollen-grains , 1930 .

[2]  J. C. A. Barata,et al.  The Moore–Penrose Pseudoinverse: A Tutorial Review of the Theory , 2011, 1110.6882.

[3]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[4]  Dirk V. Arnold On the Use of Evolution Strategies for Optimization on Spherical Manifolds , 2014, PPSN.

[5]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[6]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[7]  Hans-Georg Beyer,et al.  A Matrix Adaptation Evolution Strategy for Constrained Real-Parameter Optimization , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[8]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[9]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[10]  Radka Polakova,et al.  L-SHADE with competing strategies applied to constrained optimization , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[11]  Steffen Finck,et al.  Worst case search over a set of forecasting scenarios applied to financial stress-testing , 2019, GECCO.

[12]  Hans-Georg Beyer,et al.  Limited-Memory Matrix Adaptation for Large Scale Black-box Optimization , 2017, ArXiv.

[13]  Dirk V. Arnold,et al.  An Active-Set Evolution Strategy for Optimization with Known Constraints , 2016, PPSN.

[14]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[15]  Dirk V. Arnold,et al.  Reconsidering constraint release for active-set evolution strategies , 2017, GECCO.

[16]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[17]  Dipti Srinivasan,et al.  A unified differential evolution algorithm for constrained optimization problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[18]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  Thomas Breuer,et al.  Evolution on trees: On the design of an evolution strategy for scenario-based multi-period portfolio optimization under transaction costs , 2014, Swarm Evol. Comput..

[21]  Hans-Georg Beyer,et al.  A Covariance Matrix Self-Adaptation Evolution Strategy for Optimization Under Linear Constraints , 2018, IEEE Transactions on Evolutionary Computation.

[22]  Bernhard Sendhoff,et al.  Simplify Your Covariance Matrix Adaptation Evolution Strategy , 2017, IEEE Transactions on Evolutionary Computation.

[23]  Ponnuthurai N. Suganthan,et al.  Differential evolution with ensemble of constraint handling techniques for solving CEC 2010 benchmark problems , 2010, IEEE Congress on Evolutionary Computation.