Cultural Algorithms applied to the evolution of robotic soccer team tactics: A novel perspective

Cultural Algorithms have been previously employed to model the emergence of cooperative behaviors of agents in different multi-agent systems. In this paper, a simplified and adaptive version will be used as the basis to generate cooperative behaviors within a team of soccer players using different team formations and effective plays. This system can be used as a tutorial for the application of Cultural Algorithms for the coordination of groups of agents in complex multi-agent dynamic environments. Simplified Cultural Algorithms were successful in effectively learning different types of plays, including active and passive protagonists, within a small number of generations. Successful learning includes the coordination of adjustments of the team members to develop the most suitable team formations for every scenario. Experimental results enable us to conclude that Cultural Algorithms, when configured properly, in order to produce significant results, can perform very competitively when compared to other types of learning strategies and case-based game plays.

[1]  Nuno Lau,et al.  Co-ordination in RoboCup's 2D simulation league: Setplays as flexible, multi-robot plans , 2010, 2010 IEEE Conference on Robotics, Automation and Mechatronics.

[2]  Nuno Lau,et al.  Machine Learning algorithms applied to the classification of robotic soccer formations and opponent teams , 2010, 2010 IEEE Conference on Cybernetics and Intelligent Systems.

[3]  R. Reynolds.  On Modeling the Evolution of Hunter‐Gatherer Decision‐Making Systems , 2010 .

[4]  Luís Paulo Reis,et al.  Using Multivariate Adaptive Regression Splines in the Construction of Simulated Soccer Team's Behavior Models , 2013, Int. J. Comput. Intell. Syst..

[5]  Hiroaki Kitano,et al.  RoboCup: A Challenge Problem for AI , 1997, AI Mag..

[6]  Peter Stone,et al.  Reinforcement Learning for RoboCup Soccer Keepaway , 2005, Adapt. Behav..

[7]  R. Reynolds,et al.  Using knowledge-based evolutionary computation to solve nonlinear constraint optimization problems: a cultural algorithm approach , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[8]  David Steffen Bergman,et al.  Multi‐criteria optimization of ball passing in simulated soccer , 2005 .

[9]  Xianyi Chen,et al.  Design and Implementation of a General Decision-Making Model in RoboCup Simulation , 2004, ArXiv.

[10]  Luís Paulo Reis,et al.  Multi-robot coordination using Setplays in the middle-size and simulation leagues , 2011, Mechatronics.

[11]  R. Reynolds.  AN INTRODUCTION TO CULTURAL ALGORITHMS , 2008 .

[12]  Luís Paulo Reis,et al.  An automatic approach to extract goal plans from soccer simulated matches , 2013, Soft Comput..

[13]  Robert G. Reynolds,et al.  CAEP: An Evolution-Based Tool for Real-Valued Function Optimization Using Cultural Algorithms , 1998, Int. J. Artif. Intell. Tools.

[14]  Luís Paulo Reis,et al.  Performance analysis in soccer: a Cartesian coordinates based approach using RoboCup data , 2012, Soft Comput..

[15]  Paul Levi,et al.  Cooperative Agent Behavior Based on Special Interaction Nets , 2006, IAS.

[16]  Marián Lekavý.  Optimising Multi-Agent Cooperation Using Evolutionary Algorithm , 2005 .

[17]  Sahar Asadi,et al.  Dynamic Positioning Based on Voronoi Cells (DPVC) , 2005, RoboCup.