Evolutionary Constrained Optimization: A Hybrid Approach

The holy grail of constrained optimization is the development of an efficient, scale invariant, and generic constraint-handling procedure in single- and multi-objective constrained optimization problems. Constrained optimization is a computationally difficult task, particularly if the constraint functions are nonlinear and nonconvex. As a generic classical approach, the penalty function approach is a popular methodology that degrades the objective function value by adding a penalty proportional to the constraint violation. However, the penalty function approach has been criticized for its sensitivity to the associated penalty parameters. Since its inception, evolutionary algorithms (EAs) have been modified in various ways to solve constrained optimization problems. Of them, the recent use of a bi-objective evolutionary algorithm in which the minimization of the constraint violation is included as an additional objective, has received significant attention. In this chapter, we propose a combination of a bi-objective evolutionary approach with the penalty function methodology in a manner complementary to each other. The bi-objective approach provides an appropriate estimate of the penalty parameter, while the solution of the unconstrained penalized function by a classical method induces a convergence property to the overall hybrid algorithm. We demonstrate the working of the procedure on a number of standard numerical test problems. In most cases, our proposed hybrid methodology is observed to take one or more orders of magnitude lesser number of function evaluations to find the constrained minimum solution accurately than some of the best-reported existing methodologies.

[1]  Carlos A. Coello Coello Constraint-handling techniques used with evolutionary algorithms , 2007, GECCO '07.

[2]  Masao Fukushima,et al.  Simplex Coding Genetic Algorithm for the Global Optimization of Nonlinear Functions , 2003 .

[3]  Kalyanmoy Deb,et al.  Integrating User Preferences into Evolutionary Multi-Objective Optimization , 2005 .

[4]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[5]  John Sessions,et al.  Selection and Penalty Strategies for Genetic Algorithms Designed to Solve Spatial Forest Planning Problems , 2009 .

[6]  Kim Fung Man,et al.  Multiobjective Optimization , 2011, IEEE Microwave Magazine.

[7]  C. Coello TREATING CONSTRAINTS AS OBJECTIVES FOR SINGLE-OBJECTIVE EVOLUTIONARY OPTIMIZATION , 2000 .

[8]  Cleve B. Moler,et al.  Numerical computing with MATLAB , 2004 .

[9]  Ángel Fernando Kuri Morales,et al.  Penalty Function Methods for Constrained Optimization with Genetic Algorithms: A Statistical Analysis , 2002, MICAI.

[10]  Yuren Zhou,et al.  An Adaptive Tradeoff Model for Constrained Evolutionary Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[11]  Kusum Deep,et al.  A self-organizing migrating genetic algorithm for constrained optimization , 2008, Appl. Math. Comput..

[12]  Kalyanmoy Deb,et al.  Multiobjective Problem Solving from Nature: From Concepts to Applications , 2008, Natural Computing Series.

[13]  Jorge Nocedal,et al.  Knitro: An Integrated Package for Nonlinear Optimization , 2006 .

[14]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[15]  Carlos A. Coello Coello,et al.  Boundary Search for Constrained Numerical Optimization Problems , 2009 .

[16]  Yaochu Jin,et al.  Knowledge incorporation in evolutionary computation , 2005 .

[17]  Kalyanmoy Deb,et al.  Optimal design of a welded beam via genetic algorithms , 1991 .

[18]  Elizabeth F. Wanner,et al.  Constrained Optimization Based on Quadratic Approximations in Genetic Algorithms , 2009 .

[19]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[20]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[21]  Kalyanmoy Deb,et al.  Multiobjective Problem Solving from Nature: From Concepts to Applications (Natural Computing Series) , 2008 .

[22]  Heder S. Bernardino,et al.  A hybrid genetic algorithm for constrained optimization problems in mechanical engineering , 2007, 2007 IEEE Congress on Evolutionary Computation.

[23]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[24]  Subbarao Kambhampati,et al.  Evolutionary Computing , 1997, Lecture Notes in Computer Science.

[25]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[26]  Andres Angantyr,et al.  Constrained optimization based on a multiobjective evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[27]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[28]  David W. Coit,et al.  Adaptive Penalty Methods for Genetic Optimization of Constrained Combinatorial Problems , 1996, INFORMS J. Comput..

[29]  M. Roma,et al.  Large-Scale Nonlinear Optimization , 2006 .

[30]  A. Ebenezer Jeyakumar,et al.  A modified hybrid EP–SQP approach for dynamic dispatch with valve-point effect , 2005 .

[31]  Kalyanmoy Deb,et al.  Hybridization of SBX based NSGA-II and sequential quadratic programming for solving multi-objective optimization problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[32]  Xavier Gandibleux,et al.  MultiObjective Programming and Goal Programming , 2003 .

[33]  Kalyanmoy Deb,et al.  A Hybrid Evolutionary Multi-objective and SQP Based Procedure for Constrained Optimization , 2007, ISICA.

[34]  Efrén Mezura-Montes,et al.  Self-adaptive and Deterministic Parameter Control in Differential Evolution for Constrained Optimization , 2009 .

[35]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[36]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[37]  Gary G. Yen,et al.  A Self Adaptive Penalty Function Based Algorithm for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[38]  Pruettha Nanakorn,et al.  An adaptive penalty function in genetic algorithms for structural design optimization , 2001 .

[39]  Yuping Wang,et al.  A Penalty-Based Evolutionary Algorithm for Constrained Optimization , 2006, ICNC.

[40]  Kalyanmoy Deb,et al.  A hybrid multi-objective optimization procedure using PCX based NSGA-II and sequential quadratic programming , 2007, 2007 IEEE Congress on Evolutionary Computation.

[41]  Tapabrata Ray,et al.  Infeasibility Driven Evolutionary Algorithm for Constrained Optimization , 2009 .

[42]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[43]  Yuren Zhou,et al.  Multi-objective and MGG evolutionary algorithm for constrained optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[44]  Kalyanmoy Deb,et al.  A Local Search Based Evolutionary Multi-objective Optimization Approach for Fast and Accurate Convergence , 2008, PPSN.

[45]  Mitsuo Gen,et al.  A survey of penalty techniques in genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[46]  Simon M. Lucas,et al.  Parallel Problem Solving from Nature - PPSN X, 10th International Conference Dortmund, Germany, September 13-17, 2008, Proceedings , 2008, PPSN.

[47]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[48]  Saul I. Gass,et al.  Erratum to "Cycling in linear programming problems" [Computers and Operations Research 31 (2002) 303-311] , 2006, Comput. Oper. Res..

[49]  Jesús María López Lezama,et al.  An efficient constraint handling methodology for multi-objective evolutionary algorithms , 2009 .

[50]  Heder S. Bernardino,et al.  On GA-AIS Hybrids for Constrained Optimization Problems in Engineering , 2009 .

[51]  Edmund K. Burke,et al.  Hybrid evolutionary techniques for the maintenance scheduling problem , 2000 .

[52]  A. Ravindran,et al.  Engineering Optimization: Methods and Applications , 2006 .

[53]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[54]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[55]  Hyun Myung,et al.  Hybrid Interior-Langrangian Penalty Based Evolutionary Optimization , 1998, Evolutionary Programming.

[56]  Angel Eduardo Muñoz Zavala,et al.  Continuous Constrained Optimization with Dynamic Tolerance Using the COPSO Algorithm , 2009 .

[57]  Elmer P. Dadios,et al.  Genetic algorithm with adaptive and dynamic penalty functions for the selection of cleaner production measures: a constrained optimization problem , 2006 .

[58]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[59]  Min Xu,et al.  Applying hybrid genetic algorithm to constrained trajectory optimization , 2011, Proceedings of 2011 International Conference on Electronic & Mechanical Engineering and Information Technology.

[60]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[61]  N. Hansen,et al.  Markov Chain Analysis of Cumulative Step-Size Adaptation on a Linear Constrained Problem , 2015, Evolutionary Computation.

[62]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .

[63]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[64]  Chih-Hao Lin,et al.  A Rough Set Penalty Function for Marriage Selection in Multiple-Evaluation Genetic Algorithms , 2007, RSKT.

[65]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[66]  Ling Wang,et al.  An effective hybrid genetic algorithm with flexible allowance technique for constrained engineering design optimization , 2012, Expert Syst. Appl..

[67]  Patrick D. Surry,et al.  A Multi-objective Approach to Constrained Optimisation of Gas Supply Networks: the COMOGA Method , 1995, Evolutionary Computing, AISB Workshop.

[68]  Zbigniew Michalewicz,et al.  Handling Constraints in Genetic Algorithms , 1991, ICGA.

[69]  Efrn Mezura-Montes,et al.  Constraint-Handling in Evolutionary Optimization , 2009 .

[70]  Jürgen Branke,et al.  Consideration of Partial User Preferences in Evolutionary Multiobjective Optimization , 2008, Multiobjective Optimization.

[71]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[72]  Gary E. Birch,et al.  A hybrid genetic algorithm approach for improving the performance of the LF-ASD brain computer interface , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[73]  Quan Yuan,et al.  A hybrid genetic algorithm for twice continuously differentiable NLP problems , 2010, Comput. Chem. Eng..

[74]  Gunar E. Liepins,et al.  Some Guidelines for Genetic Algorithms with Penalty Functions , 1989, ICGA.