Conceptual Imitation Learning Based on Perceptual and Functional Characteristics of Action

This paper presents a conceptual model for imitation learning to abstract spatio-temporal demonstrations based on their perceptual and functional characteristics. To this end, the concepts are represented by prototypes irregularly scattered in the perceptual space but sharing the same functionality. Functional similarity between demonstrations is understood by reinforcements of the teacher or recognizing the effects of actions. Abstraction, concept acquisition, and self-organization of prototypes are performed through incremental and gradual learning algorithms. In these algorithms, hidden Markov models are used to prototype perceptually similar demonstrations. In addition, a mechanism is introduced to integrate perceptions of different modalities for multimodal concept recognition. Performance of the proposed model is evaluated in two different tasks. The first one is imitation learning of some hand gestures through interaction with the teachers. In this task, the perceptions from different modalities, including vision, motor, and audition, are used in a variety of experiments. The second task is to learn a set of actions by recognizing their emotional effects. Results of the experiments on a humanoid robot show the efficacy of our model for conceptual imitation learning.

[1]  Michael A. Arbib,et al.  Mirror neurons and imitation: A computationally guided review , 2006, Neural Networks.

[2]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  Yoshihiko Nakamura,et al.  Humanoid Robot's Autonomous Acquisition of Proto-Symbols through Motion Segmentation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[5]  Debbie M. Kelly,et al.  Successive two-item same-different discrimination and concept learning by pigeons , 2003, Behavioural Processes.

[6]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[7]  Yoshihiko Nakamura,et al.  Segmentation, Memorization, Recognition and Abstraction of Humanoid Motions Based on Correlations and Associative Memory , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[8]  Majid Nili Ahmadabadi,et al.  Conceptual Imitation Learning: An Application to Human-robot Interaction , 2010, ACML.

[9]  Stefan Wermter,et al.  Towards multimodal neural robot learning , 2004, Robotics Auton. Syst..

[10]  Kerstin Dautenhahn,et al.  Challenges in Building Robots That Imitate People , 2002 .

[11]  S. Bocionek,et al.  Robot programming by Demonstration (RPD): Supporting the induction by human interaction , 1996, Machine Learning.

[12]  Aude Billard,et al.  Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM , 2005, ICML.

[13]  Dana Kulic,et al.  Incremental Learning, Clustering and Hierarchy Formation of Whole Body Motion Patterns using Adaptive Hidden Markov Chains , 2008, Int. J. Robotics Res..

[14]  C. Breazeal,et al.  Challenges in building robots that imitate people , 2002 .

[15]  Stefan Wermter,et al.  Towards integrating learning by demonstration and learning by instruction in a multimodal robotic , 2003 .

[16]  G. Rizzolatti,et al.  Visuomotor neurons: ambiguity of the discharge or 'motor' perception? , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  Majid Nili Ahmadabadi,et al.  Fast Hand gesture recognition based on saliency maps: An application to interactive robotic marionette playing , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[18]  Aude Billard,et al.  Goal-Directed Imitation in a Humanoid Robot , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  Douglas D. O'Shaughnessy.  Speech Communications: Human and Machine , 2012 .

[20]  Richard Kelley,et al.  Context-Based Bayesian Intent Recognition , 2012, IEEE Transactions on Autonomous Mental Development.

[21]  Hossein Mobahi,et al.  Concept Oriented Imitation Towards Verbal Human-Robot Interaction , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[22]  G. Collins,et al.  Transcending inductive category formation in learning , 1986, Behavioral and Brain Sciences.

[23]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[24]  Aude Billard,et al.  Stochastic gesture production and recognition model for a humanoid robot , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[25]  Aude Billard,et al.  Discriminative and adaptive imitation in uni-manual and bi-manual tasks , 2006, Robotics Auton. Syst..

[26]  Douglas D. O'Shaughnessy,et al.  Speech communications - human and machine, 2nd Edition , 2000 .

[27]  Brian Scassellati,et al.  How to build robots that make friends and influence people , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[28]  Majid Nili Ahmadabadi,et al.  Conceptual Imitation Learning in a Human-Robot Interaction Paradigm , 2012, TIST.

[29]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[30]  Cynthia Breazeal,et al.  Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots , 2005, Artificial Life.

[31]  M. Donald.  Origins of the modern mind , 1991 .

[32]  Fabian Chersi,et al.  Learning Through Imitation: a Biological Approach to Robotics , 2012, IEEE Transactions on Autonomous Mental Development.

[33]  Yoshihiko Nakamura,et al.  Embodied Symbol Emergence Based on Mimesis Theory , 2004, Int. J. Robotics Res..

[34]  Dana Kulic,et al.  Incremental on-line hierarchical clustering of whole body motion patterns , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[35]  Dana Kulic,et al.  Online Segmentation and Clustering From Continuous Observation of Whole Body Motions , 2009, IEEE Transactions on Robotics.

[36]  Dana Kulic,et al.  Missing motion data recovery using factorial hidden Markov models , 2008, 2008 IEEE International Conference on Robotics and Automation.

[37]  K. Dautenhahn,et al.  The Mirror System, Imitation, and the Evolution of Language , 1999 .

[38]  Hossein Hajimirsadeghi.  Conceptual imitation learning based on functional effects of action , 2011, 2011 IEEE EUROCON - International Conference on Computer as a Tool.

[39]  Hossein Mobahi,et al.  A BIOLOGICALLY INSPIRED METHOD FOR CONCEPTUAL IMITATION USING REINFORCEMENT LEARNING , 2007, Appl. Artif. Intell..

[40]  Shanq-Jang Ruan,et al.  A Simple and Accurate Color Face Detection Algorithm in Complex Background , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[41]  T. Zentall,et al.  Categorization, concept learning, and behavior analysis: an introduction. , 2002, Journal of the experimental analysis of behavior.