Evolving Obstacle Avoidance Behavior in a Robot Arm

Existing approaches for learning to control a robot arm rely on supervised methods where correct behavior is explicitly given. It is di cult to learn to avoid obstacles using such methods, however, because examples of obstacle avoidance behavior are hard to generate. This paper presents an alternative approach that evolves neural network controllers through genetic algorithms. No input/output examples are necessary, since neuroevolution learns from a single performance measurement over the entire task of grasping an object. The approach is tested in a simulation of the OSCAR-6 robot arm which receives both visual and sensory input. Neural networks evolved to e ectively avoid obstacles at various locations to reach random target locations.

[1]  Lee E. Weiss,et al.  Adaptive Visual Servo Control of Robots , 1983 .

[2]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[3]  Vladimir J. Lumelsky,et al.  Algorithmic and complexity issues of robot motion in an uncertain environment , 1987, J. Complex..

[4]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[5]  W. Thomas Miller,et al.  Real-time application of neural networks for sensor-based control of robots with vision , 1989, IEEE Trans. Syst. Man Cybern..

[6]  C. S. George Lee,et al.  Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated camera , 1990, IEEE Trans. Syst. Man Cybern..

[7]  MICHAEL KUPERSTEIN,et al.  INFANT neural controller for adaptive sensory-motor coordination , 1991, Neural Networks.

[8]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[9]  Inman Harvey,et al.  Explorations in Evolutionary Robotics , 1993, Adapt. Behav..

[10]  W. Sardha Wijesoma,et al.  Eye-to-Hand Coordination for Vision-Guided Robot Control Applications , 1993, Int. J. Robotics Res..

[11]  Nikolaos Papanikolopoulos,et al.  Adaptive robotic visual tracking: theory and experiments , 1993, IEEE Trans. Autom. Control..

[12]  Randall D. Beer,et al.  Sequential Behavior and Learning in Evolved Dynamical Neural Networks , 1994, Adapt. Behav..

[13]  Stefano Nolfi,et al.  How to Evolve Autonomous Robots: Different Approaches in Evolutionary Robotics , 1994 .

[14]  Patrick van der Smagt,et al.  Simderella: a robot simulator for neuro-controller design , 1994 .

[15]  Richard S. Sutton,et al.  Computational Schemes and Neural Network Models for Formation and Control of Multijoint Arm Trajectory , 1995 .

[16]  Stefano Nolfi,et al.  Learning to Adapt to Changing Environments in Evolving Neural Networks , 1996, Adapt. Behav..

[17]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[18]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 1996, Machine Learning.

[19]  Risto Miikkulainen,et al.  Hierarchical evolution of neural networks , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[20]  L. D. Whitley,et al.  Genetic Reinforcement Learning for Neurocontrol Problems , 2004, Machine Learning.