An empirical exploration of phase resetting for robust biped locomotion with dynamical movement primitives

We propose a framework for learning biped locomotion using dynamical movement primitives based on nonlinear oscillators. In our previous work, we suggested dynamical movement primitives as a central pattern generator (CPG) to learn biped locomotion from demonstration. We introduced an adaptation algorithm for the frequency of the oscillators based on phase resetting at the instance of heel strike and entrainment between the phase oscillator and mechanical system using feedback from the environment. In this paper, we empirically explore the role of phase resetting in the proposed algorithm for robust biped locomotion. We demonstrate that phase resetting contributes to robustness against external perturbations and environmental changes by numerical simulations and experiments with a physical biped robot.

[1]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[2]  Masami Ito,et al.  A mathematical model of adaptation in rhythmic motion to environmental changes , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[3]  M. Kawato Transient and steady state phase response curves of limit cycle oscillators , 1982 .

[4]  Stefan Schaal,et al.  Reinforcement Learning for Humanoid Robotics , 2003 .

[5]  Shinya Aoi,et al.  Locomotion control of a biped locomotion robot using nonlinear oscillators , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[6]  Jun Nakanishi,et al.  Learning Attractor Landscapes for Learning Motor Primitives , 2002, NIPS.

[7]  Taiga Yamasaki,et al.  Possible functional roles of phase resetting during walking , 2003, Biological Cybernetics.

[8]  Daniel E. Koditschek,et al.  Phase Regulation of Decentralized Cyclic Robotic Systems , 2002, Int. J. Robotics Res..

[9]  Kazuo Tsuchiya,et al.  Adaptive gait pattern control of a quadruped locomotion robot , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[10]  Auke Jan Ijspeert,et al.  A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander , 2001, Biological Cybernetics.

[11]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[12]  Jessica K. Hodgins,et al.  Biped gait transitions , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[13]  Jun Morimoto,et al.  Minimax differential dynamic programming: application to a biped walking robot , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[14]  Jun Morimoto,et al.  Learning from demonstration and adaptation of biped locomotion , 2004, Robotics Auton. Syst..

[15]  Jun Nakanishi,et al.  Self-organizing control of urban traffic signal network , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).