Introducing a Genetic Generalization Pressure to the Anticipatory Classifier System Part 2: Performa

The Anticipatory Classifier System (ACS) is able to form a complete internal representation of an environment. Unlike most other classifier system and reinforcement learning approaches, it is able to learn latently (i.e. to learn in an environment without getting any reward) and to form an internal model of the perceived environment. After the observation that the model is not necessarily maximally general a genetic generalization pressure was introduced to the ACS. This paper focuses on the different mechanisms in the anticipatory learning process, which resembles the specialization pressure, and in the genetic algorithm, which realizes the genetic generalization pressure. The capability of generating maximally general rules and evolving a completely converged population is investigated in detail. Furthermore, the paper approaches a first comparison with the XCS classifier system in different mazes and the multiplexer problem.

[1]  Richard S. Sutton,et al.  Reinforcement learning architectures for animats , 1991 .

[2]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.

[3]  D. Goldberg,et al.  New Challenges for an Anticipatory Classiier System: Hard Problems and Possible Solutions New Challenges for an Anticipatory Classiier System: Hard Problems and Possible Solutions , 2007 .

[4]  Wolfgang Stolzmann Antizipative classifier systems , 1997 .

[5]  Dave Cliff,et al.  Adding Temporary Memory to ZCS , 1994, Adapt. Behav..

[6]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[7]  Martin V. Butz,et al.  Introducing a Genetic Generalization Pressure to the Anticipatory Classifier System - Part 1: Theoretical approach , 2000, GECCO.

[8]  Pier Luca Lanzi,et al.  A Study of the Generalization Capabilities of XCS , 1997, ICGA.

[9]  Stewart W. Wilson ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[10]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[11]  Rick L. Riolo,et al.  Lookahead planning and latent learning in a classifier system , 1991 .

[12]  John H. Holland,et al.  Properties of the Bucket Brigade , 1985, ICGA.

[13]  Gary L. Drescher,et al.  Made-up minds - a constructivist approach to artificial intelligence , 1991 .

[14]  Stewart W. Wilson Generalization in the XCS Classifier System , 1998 .

[15]  John H. Holland,et al.  Properties of the bucket brigade algorithm , 1985 .

[16]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[17]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.