A Hybrid Bi-Objective Evolutionary-Penalty Approach for Computationally Fast and Accurate Constrained Optimization ∗

Constrained optimization is a computationally difficult task, particularly if the constraint functions are non-linear and nonconvex. As a generic classical approach, the penalty function approach is a popular methodology which degrades the objective function value by adding a penalty proportional to the constraint violation. However, the penalty function approach has been criticized for its sensitivity to the associated penalty parameters. Since its inception, evolutionary algorithms (EAs) are modified in various ways to solve constrained optimization problems. Of them, the recent use of a bi-objective evolutionary algorithm in which the minimization of the constraint violation is included as an additional objective, has received a significant attention. In this paper, we propose a combination of a bi-objective evolutionary approach with the penalty function methodology in a manner complementary to each other. The bi-objective approach provides an appropriate estimate of the penalty parameter, while the solution of unconstrained penalized function by a classical method induces a convergence property to the overall hybrid algorithm. We demonstrate the working of the procedure on a number of standard numerical test problems from the EA literature. In most cases, our proposed hybrid methodology is observed to take one or more orders of magnitude lesser number of function evaluations to find the constrained minimum solution accurately than some of the best-reported existing methodologies.

[1]  Elmer P. Dadios,et al.  Genetic algorithm with adaptive and dynamic penalty functions for the selection of cleaner production measures: a constrained optimization problem , 2006 .

[2]  Kalyanmoy Deb,et al.  A Local Search Based Evolutionary Multi-objective Optimization Approach for Fast and Accurate Convergence , 2008, PPSN.

[3]  Gunar E. Liepins,et al.  Some Guidelines for Genetic Algorithms with Penalty Functions , 1989, ICGA.

[4]  Yuren Zhou,et al.  Multi-objective and MGG evolutionary algorithm for constrained optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[5]  John Sessions,et al.  Selection and Penalty Strategies for Genetic Algorithms Designed to Solve Spatial Forest Planning Problems , 2009 .

[6]  Kalyanmoy Deb,et al.  Integrating User Preferences into Evolutionary Multi-Objective Optimization , 2005 .

[7]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[8]  Michael M. Skolnick,et al.  Using Genetic Algorithms in Engineering Design Optimization with Non-Linear Constraints , 1993, ICGA.

[9]  Elizabeth F. Wanner,et al.  Constrained Optimization Based on Quadratic Approximations in Genetic Algorithms , 2009 .

[10]  Ángel Fernando Kuri Morales,et al.  Penalty Function Methods for Constrained Optimization with Genetic Algorithms: A Statistical Analysis , 2002, MICAI.

[11]  Gary E. Birch,et al.  A hybrid genetic algorithm approach for improving the performance of the LF-ASD brain computer interface , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[12]  C. Coello TREATING CONSTRAINTS AS OBJECTIVES FOR SINGLE-OBJECTIVE EVOLUTIONARY OPTIMIZATION , 2000 .

[13]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Mitsuo Gen,et al.  A survey of penalty techniques in genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[15]  Kalyanmoy Deb,et al.  A hybrid multi-objective optimization procedure using PCX based NSGA-II and sequential quadratic programming , 2007, 2007 IEEE Congress on Evolutionary Computation.

[16]  Zbigniew Michalewicz,et al.  Handling Constraints in Genetic Algorithms , 1991, ICGA.

[17]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[18]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[19]  Jesús María López Lezama,et al.  An efficient constraint handling methodology for multi-objective evolutionary algorithms , 2009 .

[20]  Tapabrata Ray,et al.  Society and civilization: An optimization algorithm based on the simulation of social behavior , 2003, IEEE Trans. Evol. Comput..

[21]  Pruettha Nanakorn,et al.  An adaptive penalty function in genetic algorithms for structural design optimization , 2001 .

[22]  Tetsuyuki Takahama,et al.  Solving Difficult Constrained Optimization Problems by the ε Constrained Differential Evolution with Gradient-Based Mutation , 2009 .

[23]  Chih-Hao Lin,et al.  A Rough Set Penalty Function for Marriage Selection in Multiple-Evaluation Genetic Algorithms , 2007, RSKT.

[24]  Angel Eduardo Muñoz Zavala,et al.  Continuous Constrained Optimization with Dynamic Tolerance Using the COPSO Algorithm , 2009 .

[25]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[26]  Andres Angantyr,et al.  Constrained optimization based on a multiobjective evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[27]  Kalyanmoy Deb,et al.  Multiobjective Problem Solving from Nature: From Concepts to Applications , 2008, Natural Computing Series.

[28]  Kalyanmoy Deb,et al.  A Hybrid Evolutionary Multi-objective and SQP Based Procedure for Constrained Optimization , 2007, ISICA.

[29]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .

[30]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[31]  Jürgen Branke,et al.  Consideration of Partial User Preferences in Evolutionary Multiobjective Optimization , 2008, Multiobjective Optimization.

[32]  Patrick D. Surry,et al.  A Multi-objective Approach to Constrained Optimisation of Gas Supply Networks: the COMOGA Method , 1995, Evolutionary Computing, AISB Workshop.

[33]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[34]  Janez Brest,et al.  Constrained Real-Parameter Optimization with ε -Self-Adaptive Differential Evolution , 2009 .

[35]  Yuren Zhou,et al.  An Adaptive Tradeoff Model for Constrained Evolutionary Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[36]  Masao Fukushima,et al.  Simplex Coding Genetic Algorithm for the Global Optimization of Nonlinear Functions , 2003 .

[37]  David W. Coit,et al.  Adaptive Penalty Methods for Genetic Optimization of Constrained Combinatorial Problems , 1996, INFORMS J. Comput..

[38]  A. Ravindran,et al.  Engineering Optimization: Methods and Applications , 2006 .

[39]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[40]  Heder S. Bernardino,et al.  On GA-AIS Hybrids for Constrained Optimization Problems in Engineering , 2009 .

[41]  Hyun Myung,et al.  Hybrid Interior-Langrangian Penalty Based Evolutionary Optimization , 1998, Evolutionary Programming.

[42]  Edmund K. Burke,et al.  Hybrid evolutionary techniques for the maintenance scheduling problem , 2000 .

[43]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[44]  A. Ebenezer Jeyakumar,et al.  A modified hybrid EP–SQP approach for dynamic dispatch with valve-point effect , 2005 .

[45]  Quan Yuan,et al.  A hybrid genetic algorithm for twice continuously differentiable NLP problems , 2010, Comput. Chem. Eng..

[46]  Kalyanmoy Deb,et al.  Hybridization of SBX based NSGA-II and sequential quadratic programming for solving multi-objective optimization problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[47]  Jorge Nocedal,et al.  Knitro: An Integrated Package for Nonlinear Optimization , 2006 .

[48]  Liang Zhang,et al.  An effective hybrid genetic algorithm for flow shop scheduling with limited buffers , 2006, Comput. Oper. Res..