Learning from demonstration: repetitive movements for autonomous service robotics

This paper presents a method for learning and generating rhythmic movement patterns based on a simple central oscillator. It can be used to generate cyclic movements for a robot system which has to solve complex tasks. The system is laid out in such a way that multiple motion dimensions, or degrees of freedom of the robot, are represented independent of each other; therefore, an extension to higher-dimensional problems is easily possible. Guiding the robot by holding its end-effector, the user teaches simple movement primitives forming the basis for a more complex task. Each movement primitive is represented in the system using an oscillator combined with a learned nonlinear mapping. These primitives are then optimally combined to a complete solution to the posed problem. Said optimality is obtained using simulated annealing with the A* global search algorithm. Our approach is demonstrated on the problem of wiping a table, but can be used for many typical problems in service and household robotics.

[1]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3]  Kenji Doya,et al.  Adaptive Synchronization of Neural and Physical Oscillators , 1991, NIPS.

[4]  Bard Ermentrout,et al.  Learning of Phase Lags in Coupled Neural Oscillators , 1994, Neural Computation.

[5]  Victor J. Milenkovic Rotational polygon overlap minimization , 1997, SCG '97.

[6]  Jun Nishii,et al.  A learning model for oscillatory networks , 1998, Neural Networks.

[7]  Jun Nakanishi,et al.  Learning Attractor Landscapes for Learning Motor Primitives , 2002, NIPS.

[8]  Jun Nakanishi,et al.  Movement imitation with nonlinear dynamical systems in humanoid robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[9]  Jun Nakanishi,et al.  Learning rhythmic movements by demonstration using nonlinear oscillators , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  R. Dillmann,et al.  Programming service tasks in household environments by human demonstration , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[11]  Alin Albu-Schäffer,et al.  Cartesian impedance control techniques for torque controlled light-weight robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[12]  Jun Morimoto,et al.  Learning from demonstration and adaptation of biped locomotion , 2004, Robotics Auton. Syst..

[13]  Darrin C. Bentivegna,et al.  Learning From Observation and Practice Using Primitives , 2004 .