A Probabilistic Memetic Framework

Memetic algorithms (MAs) represent one of the recent growing areas in evolutionary algorithm (EA) research. The term MAs is now widely used as a synergy of evolutionary or any population-based approach with separate individual learning or local improvement procedures for problem search. Quite often, MAs are also referred to in the literature as Baldwinian EAs, Lamarckian EAs, cultural algorithms, or genetic local searches. In the last decade, MAs have been demonstrated to converge to high-quality solutions more efficiently than their conventional counterparts on a wide range of real-world problems. Despite the success and surge in interests on MAs, many of the successful MAs reported have been crafted to suit problems in very specific domains. Given the restricted theoretical knowledge available in the field of MAs and the limited progress made on formal MA frameworks, we present a novel probabilistic memetic framework that models MAs as a process involving the decision of embracing the separate actions of evolution or individual learning and analyzing the probability of each process in locating the global optimum. Further, the framework balances evolution and individual learning by governing the learning intensity of each individual according to the theoretical upper bound derived while the search progresses. Theoretical and empirical studies on representative benchmark problems commonly used in the literature are presented to demonstrate the characteristics and efficacies of the probabilistic memetic framework. Further, comparisons to recent state-of-the-art evolutionary algorithms, memetic algorithms, and hybrid evolutionary-local search demonstrate that the proposed framework yields robust and improved search performance.

[1]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[2]  Jim Smith,et al.  A Memetic Algorithm With Self-Adaptive Local Search: TSP as a case study , 2000, GECCO.

[3]  Mark Sumner,et al.  A Fast Adaptive Memetic Algorithm for Online and Offline Control Design of PMSM Drives , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Jing Tang,et al.  Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems , 2006, Soft Comput..

[5]  Jim E. Smith,et al.  Coevolving Memetic Algorithms: A Review and Progress Report , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[7]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Hisao Ishibuchi,et al.  Special Issue on Memetic Algorithms , 2007, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Xin Yao,et al.  A Memetic Algorithm for VLSI Floorplanning , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Xin Yao,et al.  Simulated annealing with extended neighbourhood , 1991, Int. J. Comput. Math..

[11]  Wan-Chi Siu,et al.  A study of the Lamarckian evolution of recurrent neural networks , 2000, IEEE Trans. Evol. Comput..

[12]  Hitoshi Iba,et al.  Enhancing differential evolution performance with local search for high dimensional function optimization , 2005, GECCO '05.

[13]  Marcus Gallagher,et al.  Experimental results for the special session on real-parameter optimization at CEC 2005: a simple, continuous EDA , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  Francisco Herrera,et al.  Real-Coded Memetic Algorithms with Crossover Hill-Climbing , 2004, Evolutionary Computation.

[15]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[16]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[17]  Anne Auger,et al.  Reconsidering the progress rate theory for evolution strategies in finite dimensions , 2006, GECCO '06.

[18]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[19]  Francisco Herrera,et al.  Adaptive local search parameters for real-coded memetic algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[20]  Kay Chen Tan,et al.  A Multiobjective Memetic Algorithm Based on Particle Swarm Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Zbigniew Michalewicz,et al.  Genetic Algorithms Plus Data Structures Equals Evolution Programs , 1994 .

[22]  Zexuan Zhu,et al.  Wrapper–Filter Feature Selection Algorithm Using a Memetic Framework , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[24]  A. Dickson On Evolution , 1884, Science.

[25]  Tung-Kuan Liu,et al.  Hybrid Taguchi-genetic algorithm for global numerical optimization , 2004, IEEE Transactions on Evolutionary Computation.

[26]  W. Hart Adaptive global optimization with local search , 1994 .

[27]  Jürgen Branke,et al.  Balancing Population- and Individual-Level Adaptation in Changing Environments , 2009, Adapt. Behav..

[28]  Gregory Gutin,et al.  A selection of useful theoretical tools for the design and analysis of optimization heuristics , 2009, Memetic Comput..

[29]  Hans-Paul Schwefel,et al.  Evolution and Optimum Seeking: The Sixth Generation , 1993 .

[30]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[31]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (2nd, extended ed.) , 1994 .

[32]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[33]  Hisao Ishibuchi,et al.  Special issue on emerging trends in soft computing: memetic algorithms , 2009, Soft Comput..

[34]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[35]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[36]  James Smith,et al.  A tutorial for competent memetic algorithms: model, taxonomy, and design issues , 2005, IEEE Transactions on Evolutionary Computation.

[37]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[38]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[39]  Natalio Krasnogor,et al.  Editorial to the first issue , 2009, Memetic Comput..

[40]  G. Croes A Method for Solving Traveling-Salesman Problems , 1958 .

[41]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[42]  David E. Goldberg,et al.  Optimizing Global-Local Search Hybrids , 1999, GECCO.

[43]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[44]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[45]  D. Quagliarella,et al.  Airfoil and wing design through hybrid optimization strategies , 1998 .

[46]  C. Houck,et al.  Utilizing Lamarckian Evolution and the Baldwin Effect in Hybrid Genetic Algorithms , 2007 .

[47]  Ruhul A. Sarker,et al.  Memetic algorithms for solving job-shop scheduling problems , 2009, Memetic Comput..

[48]  Xin Yao,et al.  Fast Evolution Strategies , 1997, Evolutionary Programming.

[49]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[50]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[51]  Yuping Wang,et al.  An orthogonal genetic algorithm with quantization for global numerical optimization , 2001, IEEE Trans. Evol. Comput..

[52]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[53]  Jürgen Teich,et al.  Systematic integration of parameterized local search into evolutionary algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[54]  Carlos García-Martínez,et al.  Hybrid real-coded genetic algorithms with female and male differentiation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[55]  R. Belew,et al.  Evolutionary algorithms with local search for combinatorial optimization , 1998 .

[56]  David E. Goldberg,et al.  Designing Efficient Genetic and Evolutionary Algorithm Hybrids , 2005 .

[57]  Scott Kirkpatrick,et al.  Optimization by Simmulated Annealing , 1983, Sci..

[58]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[59]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..