Uniform adaptive scaling of equality and inequality constraints within hybrid evolutionary-cum-classical optimization

The holy grail of constrained optimization is the development of an efficient, scale invariant and generic constraint handling procedure. To address these, the present paper proposes a unified approach of constraint handling, which is capable of handling all inequality, equality and hybrid constraints in a coherent manner. The proposed method also automatically resolves the issue of constraint scaling which is critical in real world and engineering optimization problems. The proposed unified approach converts the single-objective constrained optimization problem into a multi-objective problem. Evolutionary multi-objective optimization is used to solve the modified bi-objective problem and to estimate the penalty parameter automatically. The constrained optimum is further improved using classical optimization. The efficiency of the proposed method is validated on a set of well-studied constrained test problems and compared against without using normalization technique to show the necessity of normalization. The results establish the importance of scaling , especially in constrained optimization and call for further investigation into its use in constrained optimization research.

[1]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[2]  Lakshmi Rajamani,et al.  Parameterless penalty function for solving constrained evolutionary optimization , 2009, 2009 IEEE Workshop on Hybrid Intelligent Models and Applications.

[3]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[4]  Kazuaki Masuda,et al.  A constrained global optimization method based on multi-objective particle swarm optimization , 2012 .

[5]  M. M. Ali,et al.  A penalty function-based differential evolution algorithm for constrained global optimization , 2012, Computational Optimization and Applications.

[6]  R. Fletcher.  An Ideal Penalty Function for Constrained Optimization , 1975 .

[7]  T. Pietrzykowski,et al.  A Penalty Function Method Converging Directly to a Constrained Optimum , 1977 .

[8]  Ruhul A. Sarker,et al.  Self-adaptive differential evolution incorporating a heuristic mixing of operators , 2013, Comput. Optim. Appl..

[9]  Juanjuan He,et al.  A hybrid membrane evolutionary algorithm for solving constrained optimization problems , 2014 .

[10]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[11]  Ivona Brajevic,et al.  An upgraded artificial bee colony (ABC) algorithm for constrained optimization problems , 2012, Journal of Intelligent Manufacturing.

[12]  James Bowen,et al.  Solving constraint satisfaction problems using hybrid evolutionary search , 1998, IEEE Trans. Evol. Comput..

[13]  T. Warren Liao,et al.  Two hybrid differential evolution algorithms for engineering design optimization , 2010, Appl. Soft Comput..

[14]  Erwie Zahara,et al.  Hybrid Nelder-Mead simplex search and particle swarm optimization for constrained engineering design problems , 2009, Expert Syst. Appl..

[15]  Tetsuyuki Takahama,et al.  Constrained Optimization by the epsilon Constrained Hybrid Algorithm of Particle Swarm Optimization and Genetic Algorithm , 2005, Australian Conference on Artificial Intelligence.

[16]  Donald L. Keefer,et al.  Differential Constraint Scaling in Penalty Function Optimization , 1970 .

[17]  Carlos A. Coello Coello,et al.  Constrained Optimization via Multiobjective Evolutionary Algorithms , 2008, Multiobjective Problem Solving from Nature.

[18]  R. Haftka,et al.  Constrained particle swarm optimization using a bi-objective formulation , 2009 .

[19]  M. J. D. Powell,et al.  A fast algorithm for nonlinearly constrained optimization calculations , 1978 .

[20]  Omid Bozorg Haddad,et al.  Finding the shortest path with honey-bee mating optimization algorithm in project management problems with constrained/unconstrained resources , 2010, Comput. Optim. Appl..

[21]  Helio J. C. Barbosa,et al.  A new adaptive penalty scheme for genetic algorithms , 2003, Inf. Sci..

[22]  Subbarao Kambhampati,et al.  Evolutionary Computing , 1997, Lecture Notes in Computer Science.

[23]  Wen Long,et al.  Knowledge-Base Constrained Optimization Evolutionary Algorithm and its Applications , 2014, ICRA 2014.

[24]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[25]  Tapabrata Ray,et al.  Infeasibility Driven Evolutionary Algorithm for Constrained Optimization , 2009 .

[26]  Bang Jun Lei,et al.  Constrained particle swarm algorithms for optimizing coverage of large-scale camera networks with mobile nodes , 2013, Soft Comput..

[27]  Jesús María López Lezama,et al.  An efficient constraint handling methodology for multi-objective evolutionary algorithms , 2009 .

[28]  John W. Chinneck,et al.  Analyzing infeasible nonlinear programs , 1995, Comput. Optim. Appl..

[29]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[30]  Feng-Sheng Wang,et al.  Hybrid differential evolution with multiplier updating method for nonlinear constrained optimization problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[31]  Xin-She Yang,et al.  Constrained optimisation and robust function optimisation with EIWO , 2013, Int. J. Bio Inspired Comput..

[32]  Lino A. Costa,et al.  An adaptive constraint handling technique for evolutionary algorithms , 2010 .

[33]  Ling Wang,et al.  A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization , 2007, Appl. Math. Comput..

[34]  Marco Montemurro,et al.  The Automatic Dynamic Penalisation method (ADP) for handling constraints with genetic algorithms , 2013 .

[35]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[36]  Xinye Cai,et al.  A novel memetic algorithm based on invasive weed optimization and differential evolution for constrained optimization , 2013, Soft Computing.

[37]  P. S. Kannan,et al.  Penalty parameter-less constraint handling scheme based evolutionary algorithm solutions to economic dispatch , 2008 .

[38]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[39]  Jan Paredis,et al.  Co-evolutionary Constraint Satisfaction , 1994, PPSN.

[40]  Ling Wang,et al.  An effective hybrid genetic algorithm with flexible allowance technique for constrained engineering design optimization , 2012, Expert Syst. Appl..

[41]  Patrick D. Surry,et al.  A Multi-objective Approach to Constrained Optimisation of Gas Supply Networks: the COMOGA Method , 1995, Evolutionary Computing, AISB Workshop.

[42]  Muhammad Asif Jan,et al.  A study of two penalty-parameterless constraint handling techniques in the framework of MOEA/D , 2013, Appl. Soft Comput..

[43]  Zbigniew Michalewicz,et al.  Handling Constraints in Genetic Algorithms , 1991, ICGA.

[44]  Kalyanmoy Deb,et al.  A Hybrid Evolutionary Multi-objective and SQP Based Procedure for Constrained Optimization , 2007, ISICA.

[45]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[46]  Patrice Joyeux,et al.  Particle swarm optimization for solving engineering problems: A new constraint-handling mechanism , 2013, Eng. Appl. Artif. Intell..

[47]  N. Hansen,et al.  Markov Chain Analysis of Cumulative Step-Size Adaptation on a Linear Constrained Problem , 2015, Evolutionary Computation.

[48]  Yong Wang,et al.  Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization , 2010, Appl. Soft Comput..

[49]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[50]  Hyun Myung,et al.  Evolian: Evolutionary Optimization Based on Lagrangian with Constraint Scaling , 1997, Evolutionary Programming.

[51]  Gara Miranda,et al.  Using multi-objective evolutionary algorithms for single-objective optimization , 2013, 4OR.

[52]  R. Courant.  Variational methods for the solution of problems of equilibrium and vibrations , 1943 .

[53]  Gregor Papa,et al.  Parameter-less algorithm for evolutionary-based optimization , 2013, Comput. Optim. Appl..

[54]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[55]  Mohamed Haouari,et al.  A bi-objective model for robust resource-constrained project scheduling , 2005 .

[56]  Min Xu,et al.  Applying hybrid genetic algorithm to constrained trajectory optimization , 2011, Proceedings of 2011 International Conference on Electronic & Mechanical Engineering and Information Technology.

[57]  Amir Hossein Gandomi,et al.  Bat algorithm for constrained optimization tasks , 2012, Neural Computing and Applications.

[58]  Yew-Soon Ong,et al.  Hybrid evolutionary algorithm with Hermite radial basis function interpolants for computationally expensive adjoint solvers , 2008, Comput. Optim. Appl..

[59]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[60]  K. Deb,et al.  A bi-objective constrained optimization algorithm using a hybrid evolutionary and penalty function approach , 2013 .

[61]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[62]  Tianyuan Xiao,et al.  Hybrid differential evolution and Nelder–Mead algorithm with re-optimization , 2011, Soft Comput..

[63]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[64]  Heder S. Bernardino,et al.  A hybrid genetic algorithm for constrained optimization problems in mechanical engineering , 2007, 2007 IEEE Congress on Evolutionary Computation.

[65]  Kalyanmoy Deb,et al.  Optimization for Engineering Design: Algorithms and Examples , 2004 .

[66]  Kalyanmoy Deb,et al.  A fast and accurate solution of constrained optimization problems using a hybrid bi-objective and penalty function approach , 2010, IEEE Congress on Evolutionary Computation.

[67]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[68]  C. Coello.  TREATING CONSTRAINTS AS OBJECTIVES FOR SINGLE-OBJECTIVE EVOLUTIONARY OPTIMIZATION , 2000 .

[69]  Efrn Mezura-Montes,et al.  Constraint-Handling in Evolutionary Optimization , 2009 .

[70]  Gary G. Yen,et al.  A Self Adaptive Penalty Function Based Algorithm for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[71]  James Bowen,et al.  Constraint Satisfaction Using A Hybrid Evolutionary Hill-Climbing Algorithm That Performs Opportunistic Arc and Path Revision , 1996, AAAI/IAAI, Vol. 1.

[72]  Yuren Zhou,et al.  Multi-objective and MGG evolutionary algorithm for constrained optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[73]  D. Bertsekas,et al.  A new penalty function method for constrained minimization , 1972, CDC 1972.