Discovery of subroutines in genetic programming

A fundamentalproblem in learning from observation and interaction with an environment is defining a good representation, that is a representation which captures the underlying structure and functionality of the domain. This chapter discusses an extension of the genetic programming (GP) paradigm based on the idea that subroutines obtained from blocks of good representations act as building blocks and may enable a faster evolution of even better representations. This GP extension algorithm is called adaptive representation through learning (ARL). It has built-in mechanisms for (1) creation of new subroutines through discovery and generalization of blocks of code; (2) deletion of subroutines. The set of evolved subroutines extracts common knowledge emerging during the evolutionary process and acquires the necessary structure for solving the problem. ARL was successfully tested on the problem of controlling an agent in a dynamic and non-deterministic environment. Results with the automatic discovery of subroutines show the potential to better scale up the GP technique to complex problems.

[1]  Justinian P. Rosca,et al.  Causality in Genetic Programming , 1995, International Conference on Genetic Algorithms.

[2]  John R. Koza,et al.  Architecture-Altering Operations for Evolving the Architecture of a Multi-Part Program in Genetic Programming , 1994 .

[3]  Steven Douglas Whitehead,et al.  Reinforcement learning for the adaptive control of perception and action , 1992 .

[4]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[5]  Anton Schwartz,et al.  A Reinforcement Learning Method for Maximizing Undiscounted Rewards , 1993, ICML.

[6]  Walter Alden Tackett,et al.  Mining the Genetic Program , 1995, IEEE Expert.

[7]  Dana H. Ballard,et al.  Genetic Programming with Adaptive Representations , 1994 .

[8]  Trevor Darrell,et al.  Evolving Visual Routines , 1994, Artificial Life.

[9]  Peter J. Angeline,et al.  Genetic programming and emergent intelligence , 1994 .

[10]  Terry Jones,et al.  Crossover, Macromutationand, and Population-Based Search , 1995, ICGA.

[11]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[12]  Una-May O'Reilly,et al.  The Troubling Aspects of a Building Block Hypothesis for Genetic Programming , 1994, FOGA.

[13]  Peter J. Angeline,et al.  Explicitly Defined Introns and Destructive Crossover in Genetic Programming , 1996 .

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Justinian P. Rosca,et al.  An Analysis of Hierarchical Genetic Programming , 1995 .

[16]  Peter A. Whigham,et al.  Grammatically-based Genetic Programming , 1995 .

[17]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[18]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[19]  John R. Koza,et al.  Genetic Programming II , 1992 .

[20]  Craig W. Reynolds.  Evolution of obstacle avoidance behavior: using noise to promote robust solutions , 1994 .

[21]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[22]  Michael L. Littman,et al.  Memoryless policies: theoretical limitations and practical results , 1994 .

[23]  Justinian P. Rosca,et al.  Hierarchical Self-Organization in Genetic programming , 1994, ICML.

[24]  Justinian P. Rosca,et al.  Genetic Programming Exploratory Power and the Discovery of Functions , 1995, Evolutionary Programming.

[25]  David J. Montana,et al.  Strongly Typed Genetic Programming , 1995, Evolutionary Computation.

[26]  David Andre,et al.  The Evolution of Agents that Build Mental Models and Create Simple Plans Using Genetic Programming , 1995, ICGA.

[27]  Stewart W. Wilson.  ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[28]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[29]  L. Altenberg.  The evolution of evolvability in genetic programming , 1994 .

[30]  Andrew McCallum,et al.  Reinforcement learning with selective perception and hidden state , 1996 .