THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART

Abstract This paper provides a comprehensive survey of the most popular constraint-handling techniques currently used with evolutionary algorithms. We review approaches that go from simple variations of a penalty function, to others, more sophisticated, that are biologically inspired on emulations of the immune system, culture or ant colonies. Besides describing briefly each of these approaches (or groups of techniques), we provide some criticism regarding their highlights and drawbacks. A small comparative study is also conducted, in order to assess the performance of several penalty-based approaches with respect to a dominance-based technique proposed by the author, and with respect to some mathematical programming approaches. Finally, we provide some guidelines regarding how to select the most appropriate constraint-handling technique for a certain application, and we conclude with some of the most promising paths of future research in this area.

[1]  J. E. Baker,et al.  An analysis of the effects of selection in genetic algorithms , 1989 .

[2]  A. E. Eiben,et al.  Adaptive Penalties for Evolutionary Graph Coloring , 1997, Artificial Evolution.

[3]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[4]  C. Coello,et al.  CONSTRAINT-HANDLING USING AN EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION TECHNIQUE , 2000 .

[5]  Fred Glover,et al.  Critical Event Tabu Search for Multidimensional Knapsack Problems , 1996 .

[6]  James C. Bean,et al.  A Genetic Algorithm for the Multiple-Choice Integer Program , 1997, Oper. Res..

[7]  Zbigniew Michalewicz,et al.  Evolutionary Computation at the Edge of Feasibility , 1996, PPSN.

[8]  Takeshi Yamada,et al.  Conventional Genetic Algorithm for Job Shop Problems , 1991, ICGA.

[9]  G. McCormick,et al.  Extensions of SUMT for Nonlinear Programming: Equality Constraints and Extrapolation , 1966 .

[10]  Nicholas J. Radcliffe,et al.  Equivalence Class Analysis of Genetic Algorithms , 1991, Complex Syst..

[11]  A. E. Eiben,et al.  Self-adaptivity for constraint satisfaction: learning penalty functions , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[12]  Zbigniew Michalewicz,et al.  Evolutionary Planner/Navigator: operator performance and self-tuning , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[13]  Hans-Paul Schwefel,et al.  Numerical optimization of computer models , 1981 .

[14]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[15]  Robert G. Reynolds,et al.  Evolutionary Programming IV: Proceedings of the Fourth Annual Conference on Evolutionary Programming , 1995 .

[16]  Zbigniew Michalewicz,et al.  A Survey of Constraint Handling Techniques in Evolutionary Computation Methods , 1995 .

[17]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[18]  Alice E. Smith,et al.  Penalty guided genetic search for reliability design optimization , 1996 .

[19]  Ian C. Parmee,et al.  Adaptive Computing in Design and Manufacture: The Integration of Evolutionary and Adaptive Computing Technologies with Product/System Design and Reali , 1998 .

[20]  Zbigniew Michalewicz,et al.  Sphere Operators and Their Applicability for Constrained Parameter Optimization Problems , 1998, Evolutionary Programming.

[21]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms in Engineering Applications , 1997, Springer Berlin Heidelberg.

[22]  A. E. Eiben,et al.  Evolutionary Programming VII , 1998, Lecture Notes in Computer Science.

[23]  Alice E. Smith,et al.  A genetic approach to the quadratic assignment problem , 1995, Comput. Oper. Res..

[24]  R. Haftka,et al.  Improved genetic algorithm for minimum thickness composite laminate design , 1995 .

[25]  A. Belegundu,et al.  A Computational Study of Transformation Methods for Optimal Design , 1984 .

[26]  Tom Michael Mitchell.  Version spaces: an approach to concept learning. , 1979 .

[27]  Jongsoo Lee,et al.  Constrained genetic search via schema adaptation: An immune network solution , 1996 .

[28]  F. Glover.  HEURISTICS FOR INTEGER PROGRAMMING USING SURROGATE CONSTRAINTS , 1977 .

[29]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[30]  William A. Crossley,et al.  A study of adaptive penalty functions for constrained genetic algorithm-based optimization , 1997 .

[31]  Zbigniew Michalewicz,et al.  Using Cultural Algorithms for Constraint Handling in GENOCOP , 1995, Evolutionary Programming.

[32]  J. Sobieszczanski-Sobieski,et al.  A technique for locating function roots and for satisfying equality constraints in optimization , 1992 .

[33]  James C. Bean,et al.  Genetic Algorithms and Random Keys for Sequencing and Optimization , 1994, INFORMS J. Comput..

[34]  Daniel Brélaz,et al.  New methods to color the vertices of a graph , 1979, CACM.

[35]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[36]  S. N. Kramer,et al.  An Augmented Lagrange Multiplier Based Method for Mixed Integer Discrete Continuous Optimization and Its Applications to Mechanical Design , 1994 .

[37]  Jean-Claude Latombe,et al.  Robot motion planning , 1991, The Kluwer international series in engineering and computer science.

[38]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[39]  David W. Coit,et al.  Adaptive Penalty Methods for Genetic Optimization of Constrained Combinatorial Problems , 1996, INFORMS J. Comput..

[40]  R. Courant.  Variational methods for the solution of problems of equilibrium and vibrations , 1943 .

[41]  A. E. Eiben,et al.  GA-easy and GA-hard Constraint Satisfaction Problems , 1995, Constraint Processing, Selected Papers.

[42]  Emanuel Falkenauer,et al.  A New Representation and Operators for Genetic Algorithms Applied to Grouping Problems , 1994, Evolutionary Computation.

[43]  G. E. Liepins,et al.  A Genetic Algorithm Approach to Multiple-Fault Diagnosis , 1991 .

[44]  Kalyanmoy Deb,et al.  GeneAS: A Robust Optimal Design Technique for Mechanical Component Design , 1997 .

[45]  C. Darwin.  Charles Darwin The Origin of Species by means of Natural Selection or The Preservation of Favoured Races in the Struggle for Life , 2004 .

[46]  Hyun Myung,et al.  Hybrid Interior-Langrangian Penalty Based Evolutionary Optimization , 1998, Evolutionary Programming.

[47]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[48]  Hyun Myung,et al.  Evolian: Evolutionary Optimization Based on Lagrangian with Constraint Scaling , 1997, Evolutionary Programming.

[49]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[50]  Charles W. Carroll.  The Created Response Surface Technique for Optimizing Nonlinear, Restrained Systems , 1961 .

[51]  Paul Schimmel,et al.  Lamarck's Signature: How Retrogenes are Changing Darwin's Natural Selection Paradigm. Edward J. Steele , Robyn A. Lindley , Robert V. Blanden , 1999 .

[52]  James C. Bean,et al.  Random keys genetic algorithm for scheduling : unabridged version , 1995 .

[53]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[54]  Alan S. Perelson,et al.  Population Diversity in an Immune System Model: Implications for Genetic Search , 1992, FOGA.

[55]  Jack Sklansky,et al.  Constrained Genetic Optimization via Dynarnic Reward-Penalty Balancing and Its Use in Pattern Recognition , 1989, ICGA.

[56]  Alan D. Christiansen,et al.  Using genetic algorithms for optimal design of trusses , 1994, Proceedings Sixth International Conference on Tools with Artificial Intelligence. TAI 94.

[57]  Robert G. Reynolds,et al.  A Testbed for Solving Optimization Problems Using Cultural Algorithms , 1996, Evolutionary Programming.

[58]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[59]  David E. Goldberg,et al.  ENGINEERING OPTIMIZATION VIA GENETIC ALGORITHM, IN WILL , 1986 .

[60]  P. Husbands,et al.  Mapping Based Constraint Handling for Evolutionary Search; Thurston’s Circle Packing and Grid Generation , 1998 .

[61]  R. Kowalczyk,et al.  Constraint consistent genetic algorithms , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[62]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[63]  Jan Paredis,et al.  Co-evolutionary Constraint Satisfaction , 1994, PPSN.

[64]  Susan E. Carlson,et al.  Annealing a genetic algorithm over constraints , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[65]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[66]  Eero Hyvönen,et al.  Constraint Reasoning Based on Interval Arithmetic: The Tolerance Propagation Approach , 1992, Artif. Intell..

[67]  Stephanie Forrest,et al.  Genetic algorithms, operators, and DNA fragment assembly , 1995, Machine Learning.

[68]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[69]  M. Ghiselin,et al.  Coevolution: Genes, Culture, and Human Diversity , 1991, Politics and the Life Sciences.

[70]  Hyun Myung,et al.  Preliminary Investigations into a Two-State Method of Evolutionary Optimization on Constrained Problems , 1995, Evolutionary Programming.

[71]  GUNAR E. LIEPINS,et al.  Representational issues in genetic optimization , 1990, J. Exp. Theor. Artif. Intell..

[72]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[73]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[74]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[75]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[76]  Zbigniew Michalewicz,et al.  A Decoder-Based Evolutionary Algorithm for Constrained Parameter Optimization Problems , 1998, PPSN.

[77]  Mitsuo Gen,et al.  Interval Programming Using Genetic Algorithms , 1996 .

[78]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[79]  Gunar E. Liepins,et al.  Some Guidelines for Genetic Algorithms with Penalty Functions , 1989, ICGA.

[80]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[81]  Patrick D. Surry,et al.  The COMOGA Method: Constrained Optimisation by Multi-Objective Genetic Algorithms , 1997 .

[82]  Raphael T. Haftka,et al.  A Segregated Genetic Algorithm for Constrained Structural Optimization , 1995, ICGA.

[83]  Sam R. Thangiah,et al.  An Adaptive Clustering Method Using a Geometric Shape for Vehicle Routing Problems with Time Windows , 1995, ICGA.

[84]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[85]  James E. Baker,et al.  Adaptive Selection Methods for Genetic Algorithms , 1985, International Conference on Genetic Algorithms.

[86]  Thomas Bäck,et al.  An evolutionary heuristic for the maximum independent set problem , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[87]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[88]  R. Reynolds,et al.  Using knowledge-based evolutionary computation to solve nonlinear constraint optimization problems: a cultural algorithm approach , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[89]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[90]  C. Coello.  TREATING CONSTRAINTS AS OBJECTIVES FOR SINGLE-OBJECTIVE EVOLUTIONARY OPTIMIZATION , 2000 .

[91]  Heinz Mühlenbein,et al.  Parallel Genetic Algorithms in Combinatorial Optimization , 1992, Computer Science and Operations Research.

[92]  G. Syswerda,et al.  Schedule Optimization Using Genetic Algorithms , 1991 .

[93]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[94]  H. Adeli,et al.  Augmented Lagrangian genetic algorithm for structural optimization , 1994 .

[95]  C. Darwin.  On the Origin of Species by Means of Natural Selection: Or, The Preservation of Favoured Races in the Struggle for Life , 2019 .

[96]  R. Haftka,et al.  Optimization of laminate stacking sequence for buckling load maximization by genetic algorithm , 1993 .

[97]  Alice E. Smith,et al.  Genetic Optimization Using A Penalty Function , 1993, ICGA.

[98]  E. Steele,et al.  Lamarck's Signature: How Retrogenes Are Changing Darwin's Natural Selection Paradigm , 1998 .

[99]  David Mautner Himmelblau,et al.  Applied Nonlinear Programming , 1972 .

[100]  Frank Hoffmeister,et al.  Problem-Independent Handling of Constraints by Use of Metric Penalty Functions , 1996, Evolutionary Programming.

[101]  K. M. Ragsdell,et al.  Optimal Design of a Class of Welded Structures Using Geometric Programming , 1976 .

[102]  Marc Schoenauer,et al.  Constrained GA Optimization , 1993, ICGA.

[103]  Vipin Kumar,et al.  Algorithms for Constraint-Satisfaction Problems: A Survey , 1992, AI Mag..

[104]  Lashon B. Booker,et al.  Proceedings of the fourth international conference on Genetic algorithms , 1991 .

[105]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[106]  Zbigniew Michalewicz,et al.  Towards understanding constraint-handling methods in evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[107]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .

[108]  Yuval Davidor,et al.  Genetic Algorithms and Robotics - A Heuristic Strategy for Optimization , 1991, World Scientific Series in Robotics and Intelligent Systems.

[109]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[110]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[111]  Ernest Davis,et al.  Constraint Propagation with Interval Labels , 1987, Artif. Intell..

[112]  Hugo de Garis,et al.  Genetic Programming , 1990, ML.

[113]  Mitsuo Gen,et al.  A survey of penalty techniques in genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[114]  Alan S. Perelson,et al.  Genetic Algorithms and the Immune System , 1990, PPSN.

[115]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[116]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[117]  Cheng-Yan Kao,et al.  A Genetic Algorithm Approach for Set Covering Problems , 1994, International Conference on Evolutionary Computation.

[118]  T. M. English.  Proceedings of the third annual conference on evolutionary programming: A.V. Sebald and L.J. Fogel, River Edge, NJ: World Scientific, ISBN 981-02-1810-9, 371 pages, hardbound, $78 , 1995 .

[119]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[120]  Lawrence Davis,et al.  Using a genetic algorithm to optimize problems with feasibility constraints , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[121]  Edmund M. A. Ronald,et al.  When Selection Meets Seduction , 1995, ICGA.

[122]  Vassilios Petridis,et al.  Varying Fitness Functions in Genetic Algorithms: Studying the Rate of Increase of the Dynamic Penalty Terms , 1998, PPSN.

[123]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[124]  Alan S. Perelson,et al.  Searching for Diverse, Cooperative Populations with Genetic Algorithms , 1993, Evolutionary Computation.

[125]  Kalyanmoy Deb,et al.  Optimal design of a welded beam via genetic algorithms , 1991 .

[126]  Zbigniew Michalewicz,et al.  Adaptive evolutionary planner/navigator for mobile robots , 1997, IEEE Trans. Evol. Comput..

[127]  Michael M. Skolnick,et al.  Using Genetic Algorithms in Engineering Design Optimization with Non-Linear Constraints , 1993, ICGA.

[128]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[129]  Yuval Davidor.  Analogous Crossover , 1989, ICGA.

[130]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[131]  Ian C. Parmee,et al.  The Ant Colony Metaphor for Searching Continuous Design Spaces , 1995, Evolutionary Computing, AISB Workshop.

[132]  Hyun Myung,et al.  Evolutionary programming techniques for constrained optimization problems , 1997, IEEE Trans. Evol. Comput..

[133]  Panos M. Pardalos,et al.  A Collection of Test Problems for Constrained Global Optimization Algorithms , 1990, Lecture Notes in Computer Science.

[134]  Mitsuo Gen,et al.  Optimal design of system reliability by an improved genetic algorithm , 1996 .

[135]  Stephanie Forrest,et al.  Genetic Algorithms for DNA Sequence Assembly , 1993, ISMB.

[136]  Patrick D. Surry,et al.  A Multi-objective Approach to Constrained Optimisation of Gas Supply Networks: the COMOGA Method , 1995, Evolutionary Computing, AISB Workshop.

[137]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[138]  Zbigniew Michalewicz,et al.  Handling Constraints in Genetic Algorithms , 1991, ICGA.

[139]  Z. Michalewicz,et al.  Genocop III: a co-evolutionary algorithm for numerical optimization problems with nonlinear constraints , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[140]  Michael A. Shanblatt,et al.  A two-phase optimization neural network , 1992, IEEE Trans. Neural Networks.

[141]  Jano I. van Hemert,et al.  Graph Coloring with Adaptive Evolutionary Algorithms , 1998, J. Heuristics.

[142]  Z. Michalewicz,et al.  Your brains and my beauty: parent matching for constrained optimisation , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[143]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[144]  Tapabrata Ray,et al.  An Evolutionary Algorithm for Constrained Optimization , 2000, GECCO.

[145]  Charles C. Palmer,et al.  Representing trees in genetic algorithms , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[146]  P. Hajela,et al.  Constraint handling in genetic search using expression strategies , 1996 .