Constructing complex NPC behavior via multi-objective neuroevolution

It is difficult to discover effective behavior for NPCs automatically. For instance, evolutionary methods can learn sophisticated behaviors based on a single objective, but realistic game playing requires different behaviors at different times. Such complex behavior is difficult to achieve. What is needed are multi-objective methods that reward different behaviors separately, and allow them to be combined to produce multi-modal behavior. While such methods exist, they have not yet been applied to generating multi-modal behavior for NPCs. This paper presents such an application: In a domain with noisy evaluations and contradictory fitness objectives, evolution based on a scalar fitness function is inferior to multi-objective optimization. The multi-objective approach produces agents that excel at the task and develop complex, interesting behaviors.

[1]  Risto Miikkulainen,et al.  COOPERATIVE COEVOLUTION OF MULTI-AGENT SYSTEMS , 2001 .

[2]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[3]  Risto Miikkulainen,et al.  Evolving adaptive neural networks with and without adaptive synapses , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[4]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[5]  Kenneth O. Stanley and Bobby D. Bryant and Risto Miikkulainen,et al.  Evolving Neural Network Agents in the NERO Video Game , 2005 .

[6]  Jason Teo,et al.  Pareto Evolution and Co-evolution in Cognitive Game AI Synthesis , 2006, EMO.

[7]  S. Frank Genetics of mutualism: the evolution of altruism between species. , 1994, Journal of theoretical biology.

[8]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[9]  Edwin D. de Jong,et al.  Reducing bloat and promoting diversity using multi-objective methods , 2001 .

[10]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[11]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[12]  Jonathan Klein,et al.  breve: a 3D environment for the simulation of decentralized systems and artificial life , 2002 .

[13]  Hajime Kita,et al.  Multi-objective optimization by genetic algorithms: a review , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[14]  Risto Miikkulainen,et al.  Retaining Learned Behavior During Real-Time Neuroevolution , 2005, AIIDE.