Movement extraction by detecting dynamics switches and repetitions

Many time-series such as human movement data consist of a sequence of basic actions, e.g., forehands and backhands in tennis. Automatically extracting and characterizing such actions is an important problem for a variety of different applications. In this paper, we present a probabilistic segmentation approach in which an observed time-series is modeled as a concatenation of segments corresponding to different basic actions. Each segment is generated through a noisy transformation of one of a few hidden trajectories representing different types of movement, with possible time re-scaling. We analyze three different approximation methods for dealing with model intractability, and demonstrate how the proposed approach can successfully segment table tennis movements recorded using a robot arm as haptic input device.

[1]  Katsu Yamane,et al.  Capture Database through Symbolization, Recognition and Generation of Motion Patterns , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[2]  S. Frühwirth-Schnatter Data Augmentation and Dynamic Linear Models , 1994 .

[3]  Radford M. Neal,et al.  Bayesian Detection of Infrequent Differences in Sets of Time Series with Shared Structure , 2006, NIPS.

[4]  Katsu Yamane,et al.  Simultaneous tracking and balancing of humanoid robots for imitating human motion capture data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Hans-Peter Seidel,et al.  Marker-less human motion tracking — opportunities for field testing in sports , 2006 .

[7]  Jun Nakanishi,et al.  Learning Attractor Landscapes for Learning Motor Primitives , 2002, NIPS.

[8]  Pieter Abbeel,et al.  Learning for control from multiple demonstrations , 2008, ICML '08.

[9]  Ronan Boulic,et al.  Versatile walk engine , 2004, J. Game Dev..

[10]  Siem Jan Koopman,et al.  Time Series Analysis by State Space Methods , 2001 .

[11]  Daniel Thalmann,et al.  Full-Body Avatar Control with Environment Awareness , 2009, IEEE Computer Graphics and Applications.

[12]  Marc Toussaint,et al.  Modelling motion primitives and their timing in biologically executed movements , 2007, NIPS.

[13]  Wei Pan,et al.  Unsupervised hierarchical modeling of locomotion styles , 2009, ICML '09.

[14]  Radford M. Neal,et al.  Multiple Alignment of Continuous Time Series , 2004, NIPS.

[15]  Jessica K. Hodgins,et al.  Evaluating the effect of motion and body shape on the perceived sex of virtual characters , 2009, TAP.

[16]  Jan Peters,et al.  Using Bayesian Dynamical Systems for Motion Template Libraries , 2008, NIPS.