Emergence of competitive and cooperative behavior using coevolution

In nature there are teams of collaborators and competitors that evolve at the same time, yet computationally they have mostly been studied separately so far. This paper focuses on simultaneous cooperative and competitive coevolution in a complex predator-prey domain. Yong and Miikkulainen's [6] Multi-Agent ESP architecture is extended to a Multi-Component ESP architecture consisting of multiple cooperating neural networks within an agent. This architecture successfully demonstrates hierarchical cooperation and competition in teams of prey and predators. In sustained coevolution in this complex domain, high-level pursuit-evasion behaviors emerge. In this manner, coevolution of neural networks is shown to scale up to an arms race of multiple competing and cooperating populations, more closely modeling coevolution in nature.

[1]  Risto Miikkulainen,et al.  Evolving Soccer Keepaway Players Through Task Decomposition , 2005, Machine Learning.

[2]  Risto Miikkulainen,et al.  Competitive Coevolution through Evolutionary Complexification , 2011, J. Artif. Intell. Res..

[3]  Stefano Nolfi,et al.  Co-evolving predator and prey robots , 2012, Adapt. Behav..

[4]  Philip Hingston,et al.  A Turing Test for Computer Game Bots , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[5]  Minoru Asada,et al.  Incremental Coevolution With Competitive and Cooperative Tasks in a Multirobot Environment , 2006, Proceedings of the IEEE.

[6]  Simon M. Lucas,et al.  Evolution versus Temporal Difference Learning for learning to play Ms. Pac-Man , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[7]  L. Gilbert,et al.  COEVOLUTION OF PLANTS AND HERBIVORES: PASSION FLOWER BUTTERFLIES , 1975, Evolution; international journal of organic evolution.

[8]  Risto Miikkulainen,et al.  Coevolution of Role-Based Cooperation in Multiagent Systems , 2009, IEEE Transactions on Autonomous Mental Development.

[9]  Jordan B. Pollack,et al.  Coevolutionary Learning: A Case Study , 1998, ICML.

[10]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[11]  Dario Floreano,et al.  Effects of Group Composition and Level of Selection in the Evolution of Cooperation in Artificial Ants , 2003, ECAL.

[12]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[13]  Risto Miikkulainen,et al.  Incremental Evolution of Complex General Behavior , 1997, Adapt. Behav..

[14]  Melanie Mitchell,et al.  Investigating the success of spatial coevolution , 2005, GECCO '05.

[15]  Melanie Mitchell,et al.  A Comparison of Evolutionary and Coevolutionary Search , 2002, Int. J. Comput. Intell. Appl..

[16]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[17]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[18]  Michael D. Thomure,et al.  The Role of Space in the Success of Coevolutionary Learning , 2006 .

[19]  Richard K. Belew,et al.  New Methods for Competitive Coevolution , 1997, Evolutionary Computation.