Learning to Unscrew a Light Bulb from Demonstrations

In this paper we show a way of learning how to sequence predefined basic movements in order to reproduce a previously demonstrated skill. Connections between subsequently executed movements are learned and represented in a graph structure. Learning the switching behavior between connected movements is treated as classification problem. Due to the graph, the overall accuracy of the system can be improved by restricting the possible outcomes of the classification to connected movements. We show how the graph representation can be learned from the observations and evaluate Support Vector Machines as classifier. The approach is evaluated with an experiment in which a 7-DOF Barrett WAM robot learns to unscrew a light bulb.

[1]  Scott Niekum,et al.  Incremental Semantically Grounded Learning from Demonstration , 2013, Robotics: Science and Systems.

[2]  Jun Morimoto,et al.  On-line motion synthesis and adaptation using a trajectory database , 2012, Robotics Auton. Syst..

[3]  Danica Kragic,et al.  Learning Task Models from Multiple Human Demonstrations , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[4]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Stefan Schaal,et al.  Encoding of periodic and their transient motions by a single dynamic movement primitive , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[6]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[7]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[8]  Dana Kulic,et al.  Incremental learning of full body motion primitives and their sequencing through human motion observation , 2012, Int. J. Robotics Res..

[9]  K. Dautenhahn,et al.  Imitation in Animals and Artifacts , 2002 .

[10]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[11]  Tobias Luksch,et al.  Adaptive movement sequences and predictive decisions based on hierarchical dynamical systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Tamar Flash,et al.  Motor primitives in vertebrates and invertebrates , 2005, Current Opinion in Neurobiology.

[13]  Stefan Schaal,et al.  Towards Associative Skill Memories , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[14]  Vladimir Pavlovic,et al.  Learning Switching Linear Models of Human Motion , 2000, NIPS.

[15]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[16]  T. Martin McGinnity,et al.  Automatically composing and parameterizing skills by evolving Finite State Automata , 2012, Robotics Auton. Syst..

[17]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[18]  Ulrike Thomas,et al.  Error-tolerant execution of complex robot tasks based on skill primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Aude Billard,et al.  Discriminative and adaptive imitation in uni-manual and bi-manual tasks , 2006, Robotics Auton. Syst..

[20]  Jan Peters,et al.  Machine Learning for motor skills in robotics , 2008, Künstliche Intell..