Learning Locomotion Skills in Evolvable Robots

The challenge of robotic reproduction -- making of new robots by recombining two existing ones -- has been recently cracked and physically evolving robot systems have come within reach. Here we address the next big hurdle: producing an adequate brain for a newborn robot. In particular, we address the task of targeted locomotion which is arguably a fundamental skill in any practical implementation. We introduce a controller architecture and a generic learning method to allow a modular robot with an arbitrary shape to learn to walk towards a target and follow this target if it moves. Our approach is validated on three robots, a spider, a gecko, and their offspring, in three real-world scenarios.

[1]  Kyrre Glette,et al.  Real-World Reproduction of Evolved Robot Morphologies: Automated Categorization and Evaluation , 2015, EvoApplications.

[2]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[3]  John Rieffel,et al.  EvoFab: A Fully Embodied Evolutionary Fabricator , 2010, ICES.

[4]  Ludovic Righetti,et al.  Pattern generators with sensory feedback for the control of quadruped locomotion , 2008, 2008 IEEE International Conference on Robotics and Automation.

[5]  Inman Harvey,et al.  The Horizons of Evolutionary Robotics , 2014 .

[6]  Akio Ishiguro,et al.  A Quadruped Robot Exhibiting Spontaneous Gait Transitions from Walking to Trotting to Galloping , 2017, Scientific Reports.

[7]  Howie Choset,et al.  Workspace CPG with Body Pose Control for Stable, Directed Vision during Omnidirectional Locomotion , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[8]  Shuai Wang,et al.  Evolving Efficient Deep Neural Networks for Real-time Object Recognition , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[9]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[10]  Alexander Mendiburu,et al.  Bayesian optimization for parameter tuning in evolutionary algorithms , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[11]  A. E. Eiben,et al.  The ARE Robot Fabricator: How to (Re)produce Robots that Can Evolve in the Real World , 2019, Artificial Life Conference Proceedings.

[12]  Darwin G. Caldwell,et al.  A reactive controller framework for quadrupedal locomotion on challenging terrain , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  A. Eiben,et al.  Embodied artificial evolution Artificial evolutionary systems in the 21 st Century , 2012 .

[14]  Pierre A. Guertin,et al.  Central pattern generators in the brainstem and spinal cord: an overview of basic principles, similarities and differences , 2019, Reviews in the neurosciences.

[15]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[16]  Joshua Evan Auerbach,et al.  Environmental Influence on the Evolution of Morphological Complexity in Machines , 2014, PLoS Comput. Biol..

[17]  Kyrre Glette,et al.  Evolved embodied phase coordination enables robust quadruped robot locomotion , 2019, GECCO.

[18]  Dario Floreano,et al.  RoboGen: Robot Generation through Artificial Evolution , 2014, ALIFE.

[19]  Xiaodong Wu,et al.  Neurally Controlled Steering for Collision-Free Behavior of a Snake Robot , 2013, IEEE Transactions on Control Systems Technology.

[20]  A. Eiben,et al.  The triangle of life: evolving robots in real-time and real-space The Triangle of Life: Evolving Robots in Real-time and Real-space , 2013 .

[21]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[22]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[23]  A. E. Eiben,et al.  From evolutionary computation to the evolution of things , 2015, Nature.

[24]  Greg Kochanski,et al.  Black Box Optimization via a Bayesian-Optimized Genetic Algorithm , 2017 .

[25]  Fumiya Iida,et al.  Evolutionary Developmental Robotics: Improving Morphology and Control of Physical Robots , 2017, Artificial Life.

[26]  Josh Bongard,et al.  A scalable pipeline for designing reconfigurable organisms , 2020, Proceedings of the National Academy of Sciences.

[27]  Zdzislaw Bubnicki,et al.  Modern Control Theory , 2005 .

[28]  John Rieffel,et al.  Automatically Designing and Printing 3-D Objects with EvoFab 0.2 , 2012, ALIFE.

[29]  A. E. Eiben,et al.  Real-Time Robot Vision on Low-Performance Computing Hardware , 2018, 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[30]  Soon-Jo Chung,et al.  CPG-based control of a turtle-like underwater vehicle , 2008, Auton. Robots.

[31]  Howie Choset,et al.  Central Pattern Generator With Inertial Feedback for Stable Locomotion and Climbing in Unstructured Terrain , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Auke Jan Ijspeert,et al.  Learning to Move in Modular Robots using Central Pattern Generators and Online Optimization , 2008, Int. J. Robotics Res..

[33]  F. Iida,et al.  Morphological Evolution of Physical Robots through Model-Free Phenotype Development , 2015, PloS one.

[34]  Yasuhiro Fukuoka,et al.  Adaptive Dynamic Walking of a Quadruped Robot on Natural Ground Based on Biological Concepts , 2007, Int. J. Robotics Res..

[35]  D. Owaki,et al.  Simple robot suggests physical interlimb communication is essential for quadruped walking , 2013, Journal of The Royal Society Interface.

[36]  Auke Jan Ijspeert,et al.  Central Pattern Generators augmented with virtual model control for quadruped rough terrain locomotion , 2013, 2013 IEEE International Conference on Robotics and Automation.

[37]  Peter J. Kyberd,et al.  A survey on evolutionary-aided design in robotics , 2018, Robotica.

[38]  K. Weigmann,et al.  Does intelligence require a body? , 2012, EMBO reports.

[39]  A. E. Eiben,et al.  Real-World Evolution of Robot Morphologies: A Proof of Concept , 2017, Artificial Life.

[40]  H. Hultborn,et al.  Spinal control of locomotion – from cat to man , 2007, Acta physiologica.

[41]  H. Kurokawa,et al.  Automatic locomotion design and experiments for a Modular robotic system , 2005, IEEE/ASME Transactions on Mechatronics.

[42]  A. E. Eiben,et al.  Evolutionary Robotics: What, Why, and Where to , 2015, Front. Robot. AI.

[43]  Jordan B. Pollack,et al.  Automatic design and manufacture of robotic lifeforms , 2000, Nature.

[44]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[45]  A. E. Eiben,et al.  Evolving embodied intelligence from materials to machines , 2019, Nature Machine Intelligence.

[46]  A. E. Eiben,et al.  Revolve: A Versatile Simulator for Online Robot Evolution , 2018, EvoApplications.

[47]  Antoine Cully,et al.  Limbo: A Flexible High-performance Library for Gaussian Processes modeling and Data-Efficient Optimization , 2018, J. Open Source Softw..

[48]  A. Ijspeert,et al.  From Swimming to Walking with a Salamander Robot Driven by a Spinal Cord Model , 2007, Science.

[49]  Long Wang,et al.  Motion control of a robot fish based on CPG , 2005, 2005 IEEE International Conference on Industrial Technology.

[50]  S. Tebbich Beyond the Brain: How Body and Environment Shape Animal and Human Minds Beyond the Brain: How Body and Environment Shape Animal and Human Minds. By Louise Barrett. Princeton, New Jersey: Princeton University Press (2011). Pp. x+270. Price $29.95 , 2012, Animal Behaviour.

[51]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[52]  Shital S. Chiddarwar,et al.  ReBiS - Reconfigurable Bipedal Snake robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.