Implicit Niching in a Learning Classifier System: Nature's Way

We approach the difficult task of analyzing the complex behavior of even the simplest learning classifier system (LCS) by isolating one crucial subfunction in the LCS learning algorithm: covering through niching. The LCS must maintain a population of diverse rules that together solve a problem (e.g., classify examples). To maintain a diverse population while applying the GAs selection operator, the LCS must incorporate some kind of niching mechanism. The natural way to accomplish niching in an LCS is to force competing rules to share resources (i.e., rewards). This implicit LCS fitness sharing is similar to the explicit fitness sharing used in many niched GAs. Indeed, the LCS implicit sharing algorithm can be mapped onto explicit fitness sharing with a one-to-one correspondence between algorithm components. This mapping is important because several studies of explicit fitness sharing, and of niching in GAs generally, have produced key insights and analytical tools for understanding the interaction of the niching and selection forces. We can now bring those results to bear in understanding the fundamental type of cooperation (a.k.a. weak cooperation) that an LCS must promote.

[1]  D. J. Cavicchio,et al.  Adaptive search using simulated evolution , 1970 .

[2]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  Lashon B. Booker,et al.  Intelligent Behavior as an Adaptation to the Task Environment , 1982 .

[5]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, CACM.

[6]  John H. Holland,et al.  Properties of the bucket brigade algorithm , 1985 .

[7]  John H. Holland,et al.  Properties of the Bucket Brigade , 1985, ICGA.

[8]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[9]  David E. Goldberg,et al.  Finite Markov Chain Analysis of Genetic Algorithms , 1987, ICGA.

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  Leslie G. Valiant,et al.  Computational limitations on learning from examples , 1988, JACM.

[12]  David E. Goldberg,et al.  A Critical Review of Classifier Systems , 1989, ICGA.

[13]  Robert E. Smith,et al.  A Study of Rule Set Development in a Learning Classifier System , 1989, ICGA.

[14]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[15]  David E. Goldberg,et al.  A Note on Boltzmann Tournament Selection for Genetic Algorithms and Population-Oriented Simulated Annealing , 1990, Complex Syst..

[16]  José Carlos Príncipe,et al.  A Simulated Annealing Like Convergence Theory for the Simple Genetic Algorithm , 1991, ICGA.

[17]  Yuval Davidor,et al.  A Naturally Occurring Niche and Species Phenomenon: The Model and First Results , 1991, ICGA.

[18]  David R. Jefferson,et al.  Selection in Massively Parallel Genetic Algorithms , 1991, ICGA.

[19]  Samir W. Mahfoud Crowding and Preselection Revisited , 1992, PPSN.

[20]  Kalyanmoy Deb,et al.  Massive Multimodality, Deception, and Genetic Algorithms , 1992, PPSN.

[21]  Michael D. Vose,et al.  Modeling Simple Genetic Algorithms , 1992, FOGA.

[22]  Samir W. Mahfoud Simple Analytical Models of Genetic Algorithms for Multimodal Function Optimization , 1993, ICGA.

[23]  Alan S. Perelson,et al.  Searching for Diverse, Cooperative Populations with Genetic Algorithms , 1993, Evolutionary Computation.

[24]  José Carlos Príncipe,et al.  A Markov Chain Framework for the Simple Genetic Algorithm , 1993, Evolutionary Computation.

[25]  Morgan B Kaufmann,et al.  Finite Markov Chain Analysis of Genetic Algorithms with Niching , 1993 .

[26]  David E. Goldberg,et al.  Genetic and evolutionary algorithms come of age , 1994, CACM.

[27]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.