A Covariance Matrix Self-Adaptation Evolution Strategy for Optimization Under Linear Constraints

This paper addresses the development of a covariance matrix self-adaptation evolution strategy (CMSA-ES) for solving optimization problems with linear constraints. The proposed algorithm is referred to as linear constraint CMSA-ES (lcCMSA-ES). It uses a specially built mutation operator together with repair by projection to satisfy the constraints. The lcCMSA-ES evolves itself on a linear manifold defined by the constraints. The objective function is only evaluated at feasible search points (interior point method). This is a property often required in application domains, such as simulation optimization and finite element methods. The algorithm is tested on a variety of different test problems revealing considerable results.

[1]  Sebastien Defoort,et al.  Modified Covariance Matrix Adaptation – Evolution Strategy algorithm for constrained optimization under uncertainty, application to rocket design , 2015 .

[2]  Michael W. Trosset,et al.  I Know It When I See It: Toward a Definition of Direct Search Methods , 1996 .

[3]  Dirk V. Arnold,et al.  An Active-Set Evolution Strategy for Optimization with Known Constraints , 2016, PPSN.

[4]  Margaret H. Wright,et al.  Direct search methods: Once scorned, now respectable , 1996 .

[5]  V. Klee,et al.  HOW GOOD IS THE SIMPLEX ALGORITHM , 1970 .

[6]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[7]  Nimrod Megiddo,et al.  Boundary Behavior of Interior Point Algorithms in Linear Programming , 1989, Math. Oper. Res..

[8]  G. McCormick,et al.  Selected applications of nonlinear programming , 1968 .

[9]  Frank Neumann,et al.  Approximating Covering Problems by Randomized Search Heuristics Using Multi-Objective Models , 2010, Evolutionary Computation.

[10]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[11]  Thomas Bäck,et al.  Solving the G-problems in less than 500 iterations: Improved efficient constrained optimization by surrogate modeling and adaptive parameter control , 2015, ArXiv.

[12]  G. Pflug,et al.  Modeling, Measuring and Managing Risk , 2008 .

[13]  Yang Yu,et al.  On Constrained Boolean Pareto Optimization , 2015, IJCAI.

[14]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[15]  Carsten Witt,et al.  Approximating Covering Problems by Randomized Search Heuristics Using Multi-Objective Models , 2007, Evolutionary Computation.

[16]  Paul V. Preckel,et al.  Risk Modeling via Direct Utility Maximization Using Numerical Quadrature , 1987 .

[17]  Bernhard Sendhoff,et al.  Covariance Matrix Adaptation Revisited - The CMSA Evolution Strategy - , 2008, PPSN.

[18]  Tamás Terlaky,et al.  How good are interior point methods? Klee–Minty cubes tighten iteration-complexity bounds , 2008, Math. Program..

[19]  Tamara G. Kolda,et al.  Optimization by Direct Search: New Perspectives on Some Classical and Modern Methods , 2003, SIAM Rev..

[20]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[21]  Sophia Blau,et al.  Numerical Optimization Of Computer Models , 2016 .

[22]  Anne Auger,et al.  COCO: Performance Assessment , 2016, ArXiv.

[23]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[24]  Anne Auger,et al.  Linearly Convergent Evolution Strategies via Augmented Lagrangian Constraint Handling , 2017, FOGA '17.

[25]  Hans-Georg Beyer,et al.  On the Design of Constraint Covariance Matrix Self-Adaptation Evolution Strategies Including a Cardinality Constraint , 2012, IEEE Transactions on Evolutionary Computation.

[26]  Ponnuthurai N. Suganthan,et al.  Differential evolution with ensemble of constraint handling techniques for solving CEC 2010 benchmark problems , 2010, IEEE Congress on Evolutionary Computation.

[27]  John L. Nazareth,et al.  Introduction to derivative-free optimization , 2010, Math. Comput..

[28]  P. N. Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems , 2011 .

[29]  Wei Yan,et al.  Multi-period semi-variance portfolio selection: Model and numerical solution , 2007, Appl. Math. Comput..

[30]  Mofid Gorji-Bandpy,et al.  Optimization of heat exchanger network , 2011 .

[31]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[32]  Hans-Georg Beyer,et al.  Ein Evolutionsverfahren zur mathematischen Modellierung stationärer Zustände in dynamischen Systemen , 1989 .

[33]  Jordi Castro,et al.  Minimum-distance controlled perturbation methods for large-scale tabular data protection , 2006, Eur. J. Oper. Res..

[34]  Dirk V. Arnold,et al.  A (1+1)-CMA-ES for constrained optimisation , 2012, GECCO '12.

[35]  Stefan M. Wild,et al.  BENEFITS OF DEEPER ANALYSIS IN SIMULATION- BASED GROUNDWATER OPTIMIZATION PROBLEMS , 2012 .

[36]  Bruce A. McCarl,et al.  APPLIED MATHEMATICAL PROGRAMMING USING ALGEBRAIC SYSTEMS by , 1997 .

[37]  B. De Moor,et al.  QUADRATIC PROGRAMMING IN MODEL PREDICTIVE CONTROL FOR LARGE SCALE SYSTEMS , 2002 .