Emergent Specialization in Biologically Inspired Collective Behavior Systems

Specialization is observable in many complex adaptive systems and is thought by many to be a fundamental mechanism for achieving optimal efficiency within organizations operating within complex adaptive systems. This chapter presents a survey and critique of collective behavior systems designed using biologically inspired principles, where specialization that emerges as a result of system dynamics and is used problem solver or means to increase task performance. The chapter presents an argument for developing design methodologies and principles that facilitate emergent specialization in collective behavior systems. Open problems of current research and future research directions are highlighted for the purpose of encouraging the development of such emergent specialization design methodologies.

[1]  Dietmar Fey,et al.  Realising emergent image preprocessing tasks in cellular-automaton-alike massively parallel hardware , 2007, Int. J. Parallel Emergent Distributed Syst..

[2]  Helge Parzyjegla,et al.  Self-organizing and Self-stabilizing Role Assignment in Sensor/Actuator Networks , 2006, OTM Conferences.

[3]  W. Oechel,et al.  Automatic design and manufacture of robotic lifeforms , 2022 .

[4]  Guy Theraulaz,et al.  Adaptive Task Allocation Inspired by a Model of Division of Labor in Social Insects , 1997, BCEC.

[5]  W. Gotwald,et al.  Army Ants: The Biology of Social Predation , 1995 .

[6]  John E. Laird,et al.  Human-Level AI's Killer Application: Interactive Computer Games , 2000, AI Mag..

[7]  Mitchel Resnick,et al.  Turtles, termites, and traffic jams - explorations in massively parallel microworlds , 1994 .

[8]  Pattie Maes,et al.  Evolving Obstacle Avoidance Behavior in a Robot Arm , 1996 .

[9]  E. Bonabeau,et al.  Quantitative study of the fixed threshold model for the regulation of division of labour in insect societies , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  Robert E. Page,et al.  Genotypic variability in age polyethism and task specialization in the honey bee, Apis mellifera (Hymenoptera: Apidae) , 2004, Behavioral Ecology and Sociobiology.

[11]  James A. Hendler,et al.  Co-evolving Soccer Softbot Team Coordination with Genetic Programming , 1997, RoboCup.

[12]  Mike Hansell,et al.  Social Insects: an Evolutionary Approach to Castes and Reproduction, Wolf Engels (Ed.). Springer-Verlag, Berlin (1990), 275 , 1991 .

[13]  Steven M. Gustafson,et al.  Genetic Programming And Multi-agent Layered Learning By Reinforcements , 2002, GECCO.

[14]  Jordan B. Pollack,et al.  Embodied evolution: embodying an evolutionary algorithm in a population of robots , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[15]  R. E. Page,et al.  The Genetics of Division of Labour in Honey Bee Colonies , 1991 .

[16]  Shisan C. Chen.  The Leaders and Followers among the Ants in Nest-Building , 1937, Physiological Zoology.

[17]  Gerardo Beni,et al.  From Swarm Intelligence to Swarm Robotics , 2004, Swarm Robotics.

[18]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[19]  J. Edmonds.  Paths, Trees, and Flowers , 1965, Canadian Journal of Mathematics.

[20]  Fumiya Iida,et al.  Designing Intelligent Robots , 2006 .

[21]  R. Jeanne,et al.  The organization of work in Polybia occidentalis: costs and benefits of specialization in a social wasp , 1986, Behavioral Ecology and Sociobiology.

[22]  Luca Maria Gambardella,et al.  Collaboration Through the Exploitation of Local Interactions in Autonomous Collective Robotics: The Stick Pulling Experiment , 2001, Auton. Robots.

[23]  Bourke.  Colony size, social complexity and reproductive conflict in social insects , 1999 .

[24]  Guy Theraulaz,et al.  Response Threshold Reinforcement and Division of Labor in Insect Societies , 1998 .

[25]  Steven M. Gustafson,et al.  Layered Learning in Genetic Programming for a Cooperative Robot Soccer Problem , 2001, EuroGP.

[26]  G. Robinson.  Regulation of division of labor in insect societies. , 1992, Annual review of entomology.

[27]  Daniel Solow,et al.  Mathematical models for explaining the emergence of specialization in performing tasks , 2004, Complex..

[28]  Stamatios V. Kartalopoulos,et al.  Biological Neural Networks , 1996 .

[29]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[30]  Yizhen Zhang,et al.  Towards Evolutionary Design of Intelligent Transportation Systems , 2002 .

[31]  Tucker R. Balch,et al.  Measuring robot group diversity , 2002 .

[32]  Edwin Benzel Steen,et al.  Dictionary of biology , 1971 .

[33]  Peter Stone,et al.  The RoboCup Soccer Server and CMUnited Clients: Implemented Infrastructure for MAS Research , 2003, Autonomous Agents and Multi-Agent Systems.

[34]  Risto Miikkulainen,et al.  Evolving Obstacle Avoidance Behavior in a Robot Arm , 1996 .

[35]  Manuela M. Veloso,et al.  Towards collaborative and adversarial learning: a case study in robotic soccer , 1998, Int. J. Hum. Comput. Stud..

[36]  Tucker Balch.  Taxonomies of Multirobot Task and Reward , 2002 .

[37]  W. Wilson,et al.  Dynamics of Age-Structured and Spatially Structured Predator-Prey Interactions: Individual-Based Models and Population-Level Formulations , 1993, The American Naturalist.

[38]  Sandip Sen,et al.  Evolving Beharioral Strategies in Predators and Prey , 1995, Adaption and Learning in Multi-Agent Systems.

[39]  Risto Miikkulainen,et al.  Competitive Coevolution through Evolutionary Complexification , 2011, J. Artif. Intell. Res..

[40]  T. Wenseleers,et al.  Caste fate conflict in swarm‐founding social Hymenoptera: an inclusive fitness analysis , 2003, Journal of evolutionary biology.

[41]  David B. Fogel,et al.  A platform for evolving characters in competitive games , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[42]  Rl Jeanne,et al.  The swarm-founding Polistinae , 1991 .

[43]  José del R. Millán,et al.  Learning Signaling Behaviors and Specialization in Cooperative Agents , 1996, Adapt. Behav..

[44]  Risto Miikkulainen,et al.  Evolving Neural Networks to Play Go , 2004, Applied Intelligence.

[45]  G Theraulaz,et al.  Coordination in Distributed Building , 1995, Science.

[46]  Gary B. Parker,et al.  Competing sample sizes for the co-evolution of heterogeneous agents , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[47]  Wolfgang Trumler,et al.  Self-configuration Via Cooperative Social Behavior , 2006, ATC.

[48]  Luca Maria Gambardella,et al.  The SWARM-BOTS Project , 2004, Künstliche Intell..

[49]  Hiroaki Kitano,et al.  RoboCup Rescue: search and rescue in large-scale disasters as a domain for autonomous agents research , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[50]  E. Bonabeau,et al.  Fixed response thresholds and the regulation of division of labor in insect societies , 1998 .

[51]  Yew-Kwang Ng,et al.  SPECIALIZATION, INFORMATION, AND GROWTH: A SEQUENTIAL EQUILIBRIUM ANALYSIS , 1997 .

[52]  M. O'Riain,et al.  Morphological castes in a vertebrate. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[53]  G. Robinson.  Modulation of alarm pheromone perception in the honey bee: evidence for division of labor based on hormonall regulated response thresholds , 1987, Journal of Comparative Physiology A.

[54]  Alan C. Schultz,et al.  Heterogeneity in the Coevolved Behaviors of Mobile Robots: The Emergence of Specialists , 2001, IJCAI.

[55]  S. Thakoor.  Bioinspired engineering of exploration systems , 2001 .

[56]  Josep Amat,et al.  Cooperative Autonomous Low-Cost Robots for exploring Unknown Environments , 1995, ISER.

[57]  Guy Theraulaz,et al.  Task differentiation in Polistes wasp colonies: a model for self-organizing groups of robots , 1991 .

[58]  Sandip Sen,et al.  Crossover Operators for Evolving A Team , 1997 .

[59]  R. Matthews,et al.  Ants. , 1898, Science.

[60]  G.B. Parker,et al.  Benchmarking Punctuated Anytime Learning for Evolving a Multi-Agent Team's Binary Controllers , 2006, 2006 World Automation Congress.

[61]  Istvan Karsai,et al.  Organization and Regulation of Nest Construction Behavior in Metapolybia Wasps , 2004, Journal of Insect Behavior.

[62]  Risto Miikkulainen,et al.  Evolving Keepaway Soccer Players through Task Decomposition , 2003, GECCO.

[63]  Yizhen Zhang,et al.  Evolutionary engineering design synthesis of on-board traffic monitoring sensors , 2008, AAAI 2008.

[64]  James F. A. Traniello,et al.  Key individuals and the organisation of labor in ants. , 1999 .

[65]  Lee Spector,et al.  Evolving teamwork and coordination with genetic programming , 1996 .

[66]  M. Abercrombie,et al.  A dictionary of biology , 1951 .

[67]  E. Antonsson,et al.  Evolutionary Design of a Collective Sensory System , 2003 .

[68]  Robert McCartney,et al.  Generating war game strategies using a genetic algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[69]  Sanita Thakoor.  Bio-Inspired Engineering of Exploration System , 2000 .

[70]  H. Abdel-Rahman,et al.  When do cities specialize in production , 1996 .

[71]  Guy Theraulaz,et al.  Swarm made architectures , 1992 .

[72]  Zengru Di,et al.  Division of labor as the result of phase transition , 2003 .

[73]  Luca Maria Gambardella,et al.  Swarm-Bots: Swarm of Mobile Robots able to Self-Assemble and Self-Organize , 2003 .

[74]  Hitoshi Matsubara,et al.  Learning of Cooperative actions in multi-agent systems: a case study of pass play in Soccer , 2002 .

[75]  G. Theraulaz,et al.  Response threshold reinforcements and division of labour in insect societies , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[76]  Stefano Nolfi,et al.  Evolution of Collective Behavior in a Team of Physically Linked Robots , 2003, EvoWorkshops.

[77]  D. McShea,et al.  Individual versus social complexity, with particular reference to ant colonies , 2001, Biological reviews of the Cambridge Philosophical Society.

[78]  Ling Li,et al.  Emergent Specialization in Swarm Systems , 2002, IDEAL.

[79]  E. M. Hartwell.  Boston , 1906 .

[80]  Manuela M. Veloso,et al.  Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork , 1999, Artif. Intell..

[81]  Sandip Sen,et al.  Co-adaptation in a Team , 1997 .

[82]  Manuela M. Veloso,et al.  Layered Approach to Learning Client Behaviors in the Robocup Soccer Server , 1998, Appl. Artif. Intell..

[83]  Risto Miikkulainen,et al.  Online Interactive Neuro-evolution , 2000, Neural Processing Letters.

[84]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[85]  J. Grefenstette.  Credit Assignment in Rule Discovery Systems Based on Genetic Algorithms , 2005, Machine Learning.

[86]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[87]  R. Arkin,et al.  Behavioral diversity in learning robot teams , 1998 .

[88]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[89]  Sushil J. Louis,et al.  Using a genetic algorithm to tune first-person shooter bots , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[90]  John Levine,et al.  An evolutionary approach for interactive computer games , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[91]  D. Floreano,et al.  Division of labour and colony efficiency in social insects: effects of interactions between genetic architecture, colony kin structure and rate of perturbations , 2006, Proceedings of the Royal Society B: Biological Sciences.

[92]  J. Traniello,et al.  Caste in a Primitive Ant: Absence of Age Polyethism in Amblyopone , 1978, Science.

[93]  Mandyam V. Srinivasan,et al.  Bioinspired Engineering of Exploration Systems: A Horizon Sensor/Attitude Reference System Based on the Dragonfly Ocelli for Mars Exploration Applications , 2003, J. Field Robotics.

[94]  浅田 稔,et al.  RoboCup-98 : Robot Soccer World Cup II , 1999 .

[95]  Marco Tomassini,et al.  Towards Evolvable Hardware: The Evolutionary Engineering Approach , 1996 .

[96]  Hiroaki Kitano,et al.  The RoboCup humanoid challenge as the millennium challenge for advanced robotics , 1998, Adv. Robotics.

[97]  Guy Theraulaz,et al.  Social Regulation of Foraging Activities in Polistes Dominulus Christ: a Systemic Approach To Behavioural Organization , 1991 .

[98]  Peter Willemsen,et al.  Directable behavior models for virtual driving scenarios , 1997 .

[99]  Edward O. Wilson.  Between-caste aversion as a basis for division of labor in the ant Pheidole pubiventris (Hymenoptera: Formicidae) , 2004, Behavioral Ecology and Sociobiology.

[100]  Dario Floreano,et al.  Influence of the level of polyandry and genetic architecture on division of labour , 2006 .

[101]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[102]  Kenneth O. Stanley and Bobby D. Bryant and Risto Miikkulainen,et al.  Real-Time Evolution in the NERO Video Game (Winner of CIG 2005 Best Paper Award) , 2005, CIG.

[103]  J. Pasteels,et al.  Ontogenetic development and evolution of the worker caste in termites , 1987, Experientia.

[104]  Sean O'Donnell,et al.  Effects of Experimental Forager Removals on Division of Labour in the Primitively Eusocial Wasp Polistes Instabilis (Hymenoptera: Vespidae) , 1998 .

[105]  Gary B. Parker,et al.  Co-Evolving Team Capture Strategies for Dissimilar Robots , 2004, AAAI Technical Report.

[106]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[107]  Josh C. Bongard,et al.  The Legion System: A Novel Approach to Evolving Hetrogeneity for Collective Problem Solving , 2000, EuroGP.

[108]  Hiroaki Kitano,et al.  RoboCup-97: Robot Soccer World Cup I , 1998, Lecture Notes in Computer Science.

[109]  Rodney A. Brooks,et al.  Fast, Cheap and Out of Control: a Robot Invasion of the Solar System , 1989 .

[110]  John E. Laird,et al.  Synthetic Adversaries for Urban Combat Training , 2004, AI Mag..

[111]  Rolf Drechsler,et al.  Applications of Evolutionary Computing, EvoWorkshops 2008: EvoCOMNET, EvoFIN, EvoHOT, EvoIASP, EvoMUSART, EvoNUM, EvoSTOC, and EvoTransLog, Naples, Italy, March 26-28, 2008. Proceedings , 2008, EvoWorkshops.

[112]  Risto Miikkulainen,et al.  Real-Time Evolution of Neural Networks in the NERO Video Game , 2006, AAAI.

[113]  Lynne E. Parker,et al.  Robot Teams: From Diversity to Polymorphism , 2002 .

[114]  I. Karsai,et al.  Productivity, individual-level and colony-level flexibility, and organization of work as consequences of colony size. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[115]  P.J. Nathan,et al.  Evolving Sensor Morphology on a Legged Robot in Niche Environments , 2006, 2006 World Automation Congress.

[116]  Ling Li,et al.  Learning and Measuring Specialization in Collaborative Swarm Systems , 2004, Adapt. Behav..

[117]  C. Noirot,et al.  Sexual Castes and Reproductive Strategies in Termites , 1990 .

[118]  José del R. Millán,et al.  Specialization in multi-agent systems through learning , 1997, Biological Cybernetics.

[119]  Guy Theraulaz,et al.  Dynamic Scheduling and Division of Labor in Social Insects , 2000, Adapt. Behav..

[120]  Christian Müller-Schloer,et al.  Emergence in Organic Computing Systems: Discussion of a Controversial Concept , 2006, ATC.

[121]  W. Engels,et al.  Social Insects: An Evolutionary Approach to Castes and Reproduction , 2011 .

[122]  Gary B. Parker,et al.  Co-evolving model parameters for anytime learning in evolutionary robotics , 2000, Robotics Auton. Syst..

[123]  John J. Grefenstette,et al.  Credit assignment in rule discovery systems based on genetic algorithms , 1988, Machine Learning.

[124]  Astro Teller,et al.  Evolving Team Darwin United , 1998, RoboCup.

[125]  Stefano Nolfi,et al.  Learning to Adapt to Changing Environments in Evolving Neural Networks , 1996, Adapt. Behav..

[126]  Gary B. Parker,et al.  Punctuated anytime learning for evolving multi-agent capture strategies , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[127]  J. Deneubourg,et al.  Emergent polyethism as a consequence of increased colony size in insect societies. , 2002, Journal of theoretical biology.

[128]  Dario Floreano,et al.  Effects of Group Composition and Level of Selection in the Evolution of Cooperation in Artificial Ants , 2003, ECAL.

[129]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[130]  Magdalena D. Bugajska,et al.  Co-Evolution of Form and Function in the Design of Autonomous Agents: Micro Air Vehicle Project , 2000 .

[131]  Robert E. Page,et al.  Genetic determination of guarding and undertaking in honey-bee colonies , 1988, Nature.

[132]  Risto Miikkulainen,et al.  Discovering Complex Othello Strategies through Evolutionary Neural Networks , 1995, Connect. Sci..

[133]  Jordan B. Pollack,et al.  Embodied Evolution: Distributing an evolutionary algorithm in a population of robots , 2002, Robotics Auton. Syst..

[134]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[135]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[136]  Guy Theraulaz,et al.  Role and variability of response thresholds in the regulation of division of labor in insect societies , 1999 .

[137]  J. Deneubourg,et al.  Self-organization mechanisms in ant societies. II: Learning in foraging and division of labor , 1987 .

[138]  Sung-Bae Cho,et al.  Evolution of emergent behaviors for shooting game characters in Robocode , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[139]  Michael J. B. Krieger,et al.  The call of duty: Self-organised task allocation in a population of up to twelve mobile robots , 2000, Robotics Auton. Syst..

[140]  Risto Miikkulainen,et al.  Neuroevolution for adaptive teams , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[141]  Risto Miikkulainen,et al.  Robust non-linear control through neuroevolution , 2003 .

[142]  Manuela M. Veloso,et al.  Using decision tree confidence factors for multi-agent control , 1998, AGENTS '98.

[143]  H. Seligmann,et al.  Resource partition history and evolutionary specialization of subunits in complex systems. , 1999, Bio Systems.

[144]  Stefano Nolfi,et al.  Evolving Mobile Robots Able to Display Collective Behaviors , 2003, Artificial Life.

[145]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[146]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[147]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[148]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[149]  Inman Harvey,et al.  Unconstrained Evolution and Hard Consequences , 1995, Towards Evolvable Hardware.

[150]  Eric Bonabeau,et al.  Cooperative transport by ants and robots , 2000, Robotics Auton. Syst..

[151]  David J. Hawthorne,et al.  Genetic linkage of ecological specialization and reproductive isolation in pea aphids , 2001, Nature.

[152]  Shisan C. Chen.  Social Modification of the Activity of Ants in Nest-Building , 1937, Physiological Zoology.

[153]  Fumiya Iida,et al.  Designing Intelligent Robots--On the Implications of Embodiment (特集 実世界の性質を利用した知覚と制御) , 2006 .

[154]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[155]  G. Robinson,et al.  Regulation of honey bee division of labor by colony age demography , 1996, Behavioral Ecology and Sociobiology.

[156]  Geoff S. Nitschke,et al.  Emergence of Cooperation: State of the Art , 2005, Artificial Life.

[157]  Lincoln Smith,et al.  Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.