Learning to Control Highly Accelerated Ballistic Movements on Muscular Robots

High-speed and high-acceleration movements are inherently hard to control. Applying learning to the control of such motions on anthropomorphic robot arms can improve the accuracy of the control but might damage the system. The inherent exploration of learning approaches can lead to instabilities and the robot reaching joint limits at high speeds. Having hardware that enables safe exploration of high-speed and high-acceleration movements is therefore desirable. To address this issue, we propose to use robots actuated by Pneumatic Artificial Muscles (PAMs). In this paper, we present a four degrees of freedom (DoFs) robot arm that reaches high joint angle accelerations of up to 28000 deg/s^2 while avoiding dangerous joint limits thanks to the antagonistic actuation and limits on the air pressure ranges. With this robot arm, we are able to tune control parameters using Bayesian optimization directly on the hardware without additional safety considerations. The achieved tracking performance on a fast trajectory exceeds previous results on comparable PAM-driven robots. We also show that our system can be controlled well on slow trajectories with PID controllers due to careful construction considerations such as minimal bending of cables, lightweight kinematics and minimal contact between PAMs and PAMs with the links. Finally, we propose a novel technique to control the the co-contraction of antagonistic muscle pairs. Experimental results illustrate that choosing the optimal co-contraction level is vital to reach better tracking performance. Through the use of PAM-driven robots and learning, we do a small step towards the future development of robots capable of more human-like motions.

[1]  J. Mockus Bayesian Approach to Global Optimization: Theory and Applications , 1989 .

[2]  Ching-Ping Chou,et al.  Static and dynamic characteristics of McKibben pneumatic artificial muscles , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  E. Zehr,et al.  Ballistic movement: muscle activation and neuromuscular adaptation. , 1994, Canadian journal of applied physiology = Revue canadienne de physiologie appliquee.

[4]  Darwin G. Caldwell,et al.  Control of pneumatic muscle actuators , 1995 .

[5]  Blake Hannaford,et al.  Measurement and modeling of McKibben pneumatic artificial muscles , 1996, IEEE Trans. Robotics Autom..

[6]  Nikolaos G. Tsagarakis,et al.  Pneumatic muscle actuator technology: a light weight power system for a humanoid robot , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[7]  Blake Hannaford,et al.  McKibben artificial muscles: pneumatic actuators with biomechanical intelligence , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[8]  Pierre Lopez,et al.  Modeling and control of McKibben artificial muscle robot actuators , 2000 .

[9]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[10]  Babu Joseph,et al.  Techniques of Model-Based Control , 2002 .

[11]  Andreas Schulz,et al.  A Human-Like Robot Hand and Arm with Fluidic Muscles: Biologically Inspired Construction and Functionality , 2003, Embodied Artificial Intelligence.

[12]  Bertrand Tondu,et al.  A Seven-degrees-of-freedom Robot-arm Driven by Pneumatic Artificial Muscles for Humanoid Robots , 2005, Int. J. Robotics Res..

[13]  O. Sawodny,et al.  Cascaded control concept of a robot with two degrees of freedom driven by four artificial pneumatic muscle actuators , 2005, Proceedings of the 2005, American Control Conference, 2005..

[14]  B. Tondu,et al.  McKibben artificial muscle can be in accordance with the Hill skeletal muscle model , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[15]  Kyoung Kwan Ahn,et al.  Nonlinear PID control to improve the control performance of 2 axes pneumatic artificial muscle manipulator using neural network , 2006 .

[16]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[17]  Bram Vanderborght,et al.  Proxy-based Sliding Mode Control of a Planar Pneumatic Manipulator , 2009, Int. J. Robotics Res..

[18]  Kyoung Kwan Ahn,et al.  Design and implementation of an adaptive recurrent neural networks (ARNN) controller of the pneumatic artificial muscle (PAM) manipulator , 2009 .

[19]  Jan Peters,et al.  A biomimetic approach to robot table tennis , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Oussama Khatib,et al.  Design and Control of a Bio-inspired Human-friendly Robot , 2010 .

[21]  Koh Hosoda,et al.  Direct teaching method for musculoskeletal robots driven by pneumatic artificial muscles , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  Bertrand Tondu,et al.  Modelling of the McKibben artificial muscle: A review , 2012 .

[23]  Nicholas Roy,et al.  Real-Time Inverse Dynamics Learning for Musculoskeletal Robots Based on Echo State Gaussian Process Regression , 2013 .

[24]  Yanhe Zhu,et al.  One Nonlinear PID Control to Improve the Control Performance of a Manipulator Actuated by a Pneumatic Muscle Actuator , 2014 .

[25]  Mustapha Hamerlain,et al.  Experimental Study of Nonsingular Terminal Sliding Mode Controller for Robot Arm Actuated by Pneumatic Artificial Muscles , 2014 .

[26]  B. Tondu Robust and Accurate Closed-Loop Control of McKibben Artificial Muscle Contraction with a Linear Single Integral Action , 2014 .

[27]  George Nikolakopoulos,et al.  Piecewise Affine Modeling and Constrained Optimal Control for a Pneumatic Artificial Muscle , 2014, IEEE Transactions on Industrial Electronics.

[28]  Jan Peters,et al.  Bayesian optimization for learning gaits under uncertainty , 2015, Annals of Mathematics and Artificial Intelligence.

[29]  Christopher G. Atkeson,et al.  Sample efficient optimization for learning controllers for bipedal locomotion , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[30]  Peters Jan,et al.  Jointly learning trajectory generation and hitting point prediction in robot table tennis , 2016 .

[31]  Jan Peters,et al.  A lightweight robotic arm with pneumatic muscles for robot learning , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Olivier Stasse,et al.  Controlling a multi-joint arm actuated by pneumatic muscles with quasi-DDP optimal control , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Marc Toussaint,et al.  Learning to Control Redundant Musculoskeletal Systems with Neural Networks and SQP: Exploiting Muscle Properties , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Bernhard Schölkopf,et al.  Control of Musculoskeletal Systems Using Learned Dynamics Models , 2018, IEEE Robotics and Automation Letters.