Improving game-tree search with evolutionary neural networks

Neural networks were evolved to constrain minimax search in the game of Othello. At each level of the search tree, such focus networks decide which moves are to be explored. Based on the evolved knowledge of the minimax algorithm's advantages and limitations the networks hide problem nodes from minimax. Focus networks were encoded in marker-based chromosomes and evolved against a full-width minimax opponent using the same heuristic board evaluation function. The focus network was able to guide the minimax search away from poor information, resulting in stronger play while examining far fewer nodes.<<ETX>>

[1]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[2]  Ronald L. Rivest,et al.  Game Tree Searching by Min/Max Approximation , 1987, Artif. Intell..

[3]  David A. McAllester Conspiracy Numbers for Min-Max Search , 1988, Artif. Intell..

[4]  Donald E. Knuth,et al.  An Analysis of Alpha-Beta Pruning , 1975, Artif. Intell..

[5]  Daniel Edwards,et al.  The Alpha-Beta Heuristic , 1963 .

[6]  Jesfis Peral,et al.  Heuristics -- intelligent search strategies for computer problem solving , 1984 .

[7]  Kai-Fu Lee,et al.  The Development of a World Class Othello Program , 1990, Artif. Intell..

[8]  Murray Campbell,et al.  Singular Extensions: Adding Selectivity to Brute-Force Searching , 1990, Artif. Intell..

[9]  Paul S. Rosenbloom,et al.  A World-Championship-Level Othello Program , 1982, Artif. Intell..

[10]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[11]  R. Korf,et al.  Best-First Minimax Search , 1996, Artif. Intell..

[12]  Claude E. Shannon,et al.  Programming a computer for playing chess , 1950 .

[13]  R. E. Korf,et al.  Search: A survey of recent results , 1988 .

[14]  Risto Miikkulainen,et al.  Evolving Complex Othello Strategies Using Marker-Based Genetic Encoding ofNeural Networks , 1993 .

[15]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[16]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[17]  Claude E. Shannon,et al.  XXII. Programming a Computer for Playing Chess 1 , 1950 .

[18]  Brad Fullmer,et al.  Evolving Finite State Behavior using Marker-Based Genetic Encoding of Neural Networks , 1991 .