Modeling selection pressure in XCS for proportionate and tournament selection

In this paper, we derive models of the selection pressure in XCS for proportionate (roulette wheel) selection and tournament selection. We show that these models can explain the empirical results that have been previously presented in the literature. We validate the models on simple problems showing that, (i) when the model assumptions hold, the theory perfectly matches the empirical evidence; (ii) when the model assumptions do not hold, the theory can still provide qualitative explanations of the experimental results.

[1]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[2]  Martin V. Butz,et al.  An algorithmic description of XCS , 2000, Soft Comput..

[3]  David E. Goldberg,et al.  Implicit Niching in a Learning Classifier System: Nature's Way , 1994, Evolutionary Computation.

[4]  D. Goldberg,et al.  Bounding Learning Time in XCS , 2004, GECCO.

[5]  Larry Bull,et al.  Revisiting genetic selection in the XCS learning classifier system , 2005, 2005 IEEE Congress on Evolutionary Computation.

[6]  D. Goldberg,et al.  Bounding the Population Size to Ensure Niche Support in XCS , 2004 .

[7]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[8]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[9]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 , 2000 .

[10]  Martin V. Butz,et al.  Toward a theory of generalization and learning in XCS , 2004, IEEE Transactions on Evolutionary Computation.

[11]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.

[12]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[13]  Stewart W. Wilson.  Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[14]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[15]  Larry Bull,et al.  Simple Markov Models of the Genetic Algorithm in Classifier Systems: Accuracy-Based Fitness , 2000, IWLCS.

[16]  Martin V. Butz,et al.  Strong, Stable, and Reliable Fitness Pressure in XCS due to Tournament Selection , 2005, Genetic Programming and Evolvable Machines.

[17]  Martin V. Butz,et al.  Analysis and Improvement of Fitness Exploitation in XCS: Bounding Models, Tournament Selection, and Bilateral Accuracy , 2003, Evolutionary Computation.

[18]  Stewart W. Wilson.  Generalization in the XCS Classifier System , 1998 .