Feasibility Structure Modeling: An Effective Chaperone for Constrained Memetic Algorithms

An important issue in designing memetic algorithms (MAs) is the choice of solutions in the population for local refinements, which becomes particularly crucial when solving computationally expensive problems. With single evaluation of the objective/constraint functions necessitating tremendous computational power and time, it is highly desirable to be able to focus search efforts on the regions where the global optimum is potentially located so as not to waste too many function evaluations. For constrained optimization, the global optimum must either be located at the trough of some feasible basin or some particular point along the feasibility boundary. Presented in this paper is an instance of optinformatics where a new concept of modeling the feasibility structure of inequality-constrained optimization problems-dubbed the feasibility structure modeling-is proposed to perform geometrical predictions of the locations of candidate solutions in the solution space: deep inside any infeasible region, nearby any feasibility boundary, or deep inside any feasible region. This knowledge may be unknown prior to executing an MA but it can be mined as the search for the global optimum progresses. As more solutions are generated and subsequently stored in the database, the feasibility structure can thus be approximated more accurately. As an integral part, a new paradigm of incorporating the classification-rather than the regression-into the framework of MAs is introduced, allowing the MAs to estimate the feasibility boundary such that effective assessments of whether or not the candidate solutions should experience local refinements can be made. This eventually helps preventing the unnecessary refinements and consequently reducing the number of function evaluations required to reach the global optimum.

[1]  W. Hart Adaptive global optimization with local search , 1994 .

[2]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[3]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[4]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[5]  Marc Schoenauer,et al.  ASCHEA: new results using adaptive segregational constraint handling , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[6]  Klaus Schittkowski,et al.  NLPQL: A fortran subroutine solving constrained nonlinear programming problems , 1986 .

[7]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[8]  Wei Zhang,et al.  A point‐charge force field for molecular mechanics simulations of proteins based on condensed‐phase quantum mechanical calculations , 2003, J. Comput. Chem..

[9]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[10]  Bing Zhao,et al.  MHC-Peptide binding prediction for epitope based vaccine design , 2007 .

[11]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[12]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Anthony Chen,et al.  Constraint handling in genetic algorithms using a gradient-based repair method , 2006, Comput. Oper. Res..

[14]  C. Darwin On the Origin of Species by Means of Natural Selection: Or, The Preservation of Favoured Races in the Struggle for Life , 2019 .

[15]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[16]  Peter Merz,et al.  Advanced Fitness Landscape Analysis and the Performance of Memetic Algorithms , 2004, Evolutionary Computation.

[17]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[18]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[19]  M. C. Bartholomew-Biggs,et al.  Algorithms for General Constrained Nonlinear Optimization , 1994 .

[20]  Jon W. Tolle,et al.  A Simplicial Algorithm for the Mixed Nonlinear Complementarity Problem with Application to Convex Programming. , 1974 .

[21]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[22]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[23]  Pei Yee Ho,et al.  Simple addition of ranking method for constrained optimization in evolutionary algorithms , 2005, GECCO '05.

[24]  V. Vapnik Pattern recognition using generalized portrait method , 1963 .

[25]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[26]  E. Spedicato Algorithms for continuous optimization : the state of the art , 1994 .

[27]  David Wales Energy Landscapes: Features of the landscape , 2004 .

[28]  A. Bondi van der Waals Volumes and Radii , 1964 .

[29]  Jim Smith,et al.  A Memetic Algorithm With Self-Adaptive Local Search: TSP as a case study , 2000, GECCO.

[30]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[31]  Yew-Soon Ong,et al.  A Probabilistic Memetic Framework , 2009, IEEE Transactions on Evolutionary Computation.

[32]  Helio J. C. Barbosa,et al.  A new adaptive penalty scheme for genetic algorithms , 2003, Inf. Sci..

[33]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[34]  Hanif D. Sherali,et al.  Methods of Feasible Directions , 2005 .

[35]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[36]  Emilio Spedicato,et al.  Algorithms for Continuous Optimization , 1994 .

[37]  Yew-Soon Ong,et al.  Optinformatics for schema analysis of binary genetic algorithms , 2008, GECCO '08.

[38]  R. Belew,et al.  Evolutionary algorithms with local search for combinatorial optimization , 1998 .

[39]  R. Lewontin ‘The Selfish Gene’ , 1977, Nature.

[40]  Vladimir Vapnik,et al.  Methods of Pattern Recognition , 2000 .

[41]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[42]  Donald Goldfarb,et al.  An O(n3L) primal interior point algorithm for convex quadratic programming , 1991, Math. Program..

[43]  Aravind Srinivasan,et al.  A Population-Based, Parent Centric Procedure for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[44]  Ruhul A. Sarker,et al.  Memetic algorithms for solving job-shop scheduling problems , 2009, Memetic Comput..

[45]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[46]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[47]  Robin Taylor,et al.  Intermolecular Nonbonded Contact Distances in Organic Crystal Structures: Comparison with Distances Expected from van der Waals Radii , 1996 .

[48]  F. Young Biochemistry , 1955, The Indian Medical Gazette.

[49]  Tetsuyuki Takahama,et al.  Constrained Optimization by the ε Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[50]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[51]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[52]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[53]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[54]  Bu-Sung Lee,et al.  Memetic algorithm using multi-surrogates for computationally expensive optimization problems , 2007, Soft Comput..

[55]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[56]  H. Scheraga,et al.  Theory of helix-coil transitions in biopolymers : statistical mechanical theory of order-disorder transitions in biological macromolecules , 1970 .

[57]  Piero P. Bonissone,et al.  Evolutionary algorithms + domain knowledge = real-world evolutionary computation , 2006, IEEE Transactions on Evolutionary Computation.

[58]  Ruhul A. Sarker,et al.  A Simple Ranking and Selection for Constrained Evolutionary Optimization , 2006, SEAL.

[59]  Douglas Poland,et al.  Theory of helix-coil transitions in biopolymers , 1970 .

[60]  Natalio Krasnogor,et al.  Editorial to the first issue , 2009, Memetic Comput..

[61]  G. N. Ramachandran,et al.  Stereochemistry of polypeptide chain configurations. , 1963, Journal of molecular biology.

[62]  Jonathan A. Wright,et al.  Self-adaptive fitness formulation for constrained optimization , 2003, IEEE Trans. Evol. Comput..

[63]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[64]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[65]  Jürgen Teich,et al.  Systematic integration of parameterized local search into evolutionary algorithms , 2004, IEEE Transactions on Evolutionary Computation.