The Evolution of Connectionist Networks

Learning and evolution are two fundamental processes of adaptation. Various models have been proposed to explain their behaviour. Rather than discussing these models in detail, this paper concentrates on the interaction between learning and evolution as well as the interaction between different levels of evolution. We will argue that the evolution of learning rules and its interaction with other evolutionary developments (in either artificial or biological systems) plays a key role in accounting for the creativity of those systems. We will concentrate on two models of learning and evolution: connectionistlearning (artificial neural networks, or ANNs) and genetic algorithms (GAs).

[1]  B. Lewin.  Units of transcription and translation: Sequence components of heterogeneous nuclear RNA and messenger RNA , 1975, Cell.

[2]  John Maynard Smith,et al.  When learning guides evolution , 1987, Nature.

[3]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[4]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[5]  Thomas P. Caudell,et al.  Parametric Connectivity: Training of Constrained Networks using Genetic Algorithms , 1989, ICGA.

[6]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[7]  L. Darrell Whitley,et al.  Optimizing Neural Networks Using FasterMore Accurate Genetic Search , 1989, ICGA.

[8]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[9]  David H. Sharp,et al.  Scaling, machine learning, and genetic neural nets , 1989 .

[10]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[11]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[12]  Mike Rudnick,et al.  A bibliography of the intersection of genetic search and artificial neural networks , 1990 .

[13]  Hiroaki Kitano,et al.  Empirical Studies on the Speed of Convergence of Neural Network Training Using Genetic Algorithms , 1990, AAAI.

[14]  Stewart W. Wilson.  Perceptron redux: emergence of structure , 1990 .

[15]  Richard K. Belew,et al.  Evolution, Learning, and Culture: Computational Metaphors for Adaptive Algorithms , 1990, Complex Syst..

[16]  Larry J. Eshelman,et al.  Using genetic search to exploit the emergent behavior of neural networks , 1990 .

[17]  David J. Chalmers,et al.  The Evolution of Learning: An Experiment in Genetic Connectionism , 1991 .

[18]  N. Dodd,et al.  Optimisation of artificial neural network structure using genetic techniques on multiple transputers , 1991 .

[19]  Robert F. Port,et al.  Fractally configured neural networks , 1991, Neural Networks.

[20]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..