Evolving Neural Networks for the Capture Game

This paper proposes the use of a genetic algorithm to develop neural networks to play the Capture Game, a subgame of Go. The motivation for this is twofold: to evaluate and possibly improve upon current genetic algorithm variants in order to produce a good player and (more importantly) to use this process to examine the properties and processes that are present in evolutionary systems in an attempt to shed some light on the phenomena that are required for an evolutionary process to produce robust, perpetually improving individuals and avoid local minima without any outside interaction. A brief survey of related work in the area is given, which highlights some of the interesting research questions that remain. This is followed by an outline of a distributed system that has been developed for use in the experimental evaluation of some of the proposed ideas and some of the initial results generated by the system.

[1]  Claude E. Shannon,et al.  Programming a computer for playing chess , 1950 .

[2]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[3]  S. Gould,et al.  Punctuated equilibria: the tempo and mode of evolution reconsidered , 1977, Paleobiology.

[4]  R. Dawkins The Blind Watchmaker , 1986 .

[5]  Richard K. Belew,et al.  Evolving networks: using the genetic algorithm with connectionist learning , 1990 .

[6]  Gerald Tesauro,et al.  Temporal difference learning and TD-Gammon , 1995, CACM.

[7]  Lothar Thiele,et al.  A Comparison of Selection Schemes used in Genetic Algorithms , 1995 .

[8]  J. Urgen Branke Evolutionary Algorithms for Neural Network Design and Training , 1995 .

[9]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[10]  Risto Miikkulainen,et al.  Culling and Teaching in Neuro-Evolution , 1997, ICGA.

[11]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[12]  Stefano Nolfi,et al.  Evolving non-trivial behaviors on real robots: A garbage collecting robot , 1997, Robotics Auton. Syst..

[13]  Astro Teller,et al.  Evolving Team Darwin United , 1998, RoboCup.

[14]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[15]  Timothy J. Taylor,et al.  From artificial evolution to artificial life , 1999 .

[16]  Tristan Cazenave,et al.  Abstract Proof Search , 2000, Computers and Games.

[17]  Vasant Honavar,et al.  Evolutionary and Neural Synthesis of Intelligent Agents , 2001 .

[18]  Risto Miikkulainen,et al.  COOPERATIVE COEVOLUTION OF MULTI-AGENT SYSTEMS , 2001 .

[19]  Alex Lubberts and Risto Miikkulainen Co-Evolving a Go-Playing Neural network , 2001 .

[20]  D. M. Hutton,et al.  Advances in the Evolutionary Synthesis of Intelligent Agents , 2002 .

[21]  Risto Miikkulainen,et al.  Evolving Neural Networks to Play Go , 2004, Applied Intelligence.