Linkage Learning via Probabilistic Modeling in the Extended Compact Genetic Algorithm (ECGA)

For a long time, genetic algorithms (GAs) were not very successful in automatically identifying and exchanging structures consisting of several correlated genes. This problem, referred in the literature as the linkage-learning problem, has been the subject of extensive research for many years. This chapter explores the relationship between the linkage-learning problem and that of learning probability distributions over multi-variate spaces. Herein, it is argued that these problems are equivalent. Using a simple but effective approach to learning distributions, and by implication linkage, this chapter reveals the existence of GA-like algorithms that are potentially orders of magnitude faster and more accurate than the simple GA.

[1]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[2]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[4]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[5]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[6]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[7]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[8]  Dirk Thierens,et al.  Mixing in Genetic Algorithms , 1993, ICGA.

[9]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[10]  Paul A. Viola,et al.  MIMIC: Finding Optima by Estimating Probability Densities , 1996, NIPS.

[11]  H. Kargupta.  Search, polynomial complexity, and the fast messy genetic algorithm , 1996 .

[12]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[13]  G. Harik.  Learning gene linkage to efficiently solve problems of bounded difficulty using genetic algorithms , 1997 .

[14]  Fernando G. Lobo,et al.  A parameter-less genetic algorithm , 1999, GECCO.

[15]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[16]  Fernando G. Lobo,et al.  Extended Compact Genetic Algorithm in C , 1999 .

[17]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[18]  Heinz Mühlenbein,et al.  Schemata, Distributions and Graphical Models in Evolutionary Optimization , 1999, J. Heuristics.

[19]  G. Harik.  Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[20]  David E. Goldberg,et al.  Bayesian Optimization Algorithm, Population Sizing, and Time to Convergence , 2000, GECCO.

[21]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[22]  Piotr Wnuk-Lipiński.  Evolutionary data-mining methods in discovering stock market expertise from financial time series , 2001 .

[23]  Kumara Sastry,et al.  Efficient Cluster Optimization Using Extended Compact Genetic Algorithm With Seeded Population , 2001 .

[24]  David E. Goldberg,et al.  Scalability of the Bayesian optimization algorithm , 2002, Int. J. Approx. Reason..

[25]  Bernard De Baets,et al.  Using Linkage Learning for Forest Management Planning , 2002, GECCO Late Breaking Papers.

[26]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[27]  David E. Goldberg,et al.  Designing Competent Mutation Operators Via Probabilistic Model Building of Neighborhoods , 2004, GECCO.

[28]  Franz Rothlauf,et al.  Evaluation-Relaxation Schemes for Genetic and Evolutionary Algorithms , 2004 .

[29]  David E. Goldberg,et al.  Combining competent crossover and mutation operators: a probabilistic model building approach , 2005, GECCO '05.

[30]  Fernando G. Lobo,et al.  Massive parallelization of the compact genetic algorithm , 2005 .

[31]  Martin V. Butz,et al.  Automated Global Structure Extraction for Effective Local Building Block Processing in XCS , 2006, Evolutionary Computation.

[32]  Jan Wessnitzer,et al.  A Model of Non-elemental Associative Learning in the Mushroom Body Neuropil of the Insect Brain , 2007, ICANNGA.