Static experts and dynamic enemies in coevolutionary games

The usage of memory in coevolutionary systems offers a wide range of research possibilities, especially when evolving computationally intelligent computer players for games. The research discussed here continues from previous work done to include memory with coevolution for the game of TEMPO. The strategy of inserting a simple human derived rule base to kick start the evolutionary process with memory is investigated further, with tests done on the effectiveness of the expert as a participant in the evolutionary process. There is also further research presented on reproducing the human long term memory mechanism in the coevolutionary process, with a process used to mimic the way humans recall information relevant to the current scenario. This creates a memory that changes as the environmental situation changes, and results in a dynamic opposition to coevolve against.

[1]  Zbigniew Michalewicz,et al.  Coevolutionary optimization of fuzzy logic intelligence for strategic decision support , 2005, IEEE Transactions on Evolutionary Computation.

[2]  Zbigniew Michalewicz,et al.  A Historical Population in a Coevolutionary System , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[3]  Zbigniew Michalewicz,et al.  Coevolutionary TEMPO game , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[4]  David B. Fogel,et al.  Evolving an expert checkers playing program without using human expertise , 2001, IEEE Trans. Evol. Comput..

[5]  Sushil J. Louis,et al.  Playing to learn: case-injected genetic algorithms for learning to play computer games , 2005, IEEE Transactions on Evolutionary Computation.

[6]  A. Baddeley The psychology of memory , 1976 .

[7]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[8]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Pattie Maes,et al.  Dynamics of Co-evolutionary Learning , 1996 .

[10]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[11]  Sushil J. Louis,et al.  Learning with case-injected genetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[12]  David B. Fogel,et al.  Blondie24: Playing at the Edge of AI , 2001 .

[13]  Sushil J. Louis,et al.  Combining Case-Based Memory with Genetic Algorithm Search for Competent Game AI , 2005, ICCBR Workshops.

[14]  Hayao Miyagi,et al.  Competitive Co-evolution Model on the Acquisition of Game Strategy , 1996, SEAL.

[15]  Daryl Essam Book Review: Blondie24: Playing at the Edge of AI , 2004, Genetic Programming and Evolvable Machines.