A Comparison of Autoregressive Hidden Markov Models for Multimodal Manipulations With Variable Masses

In contact-based manipulations, the effects of the robot's actions change as contacts are made or broken. For example, if a robot applies an increasing upward force to an object, then the force will eventually overcome the object's weight and break the object–table contact. The robot can subsequently raise or lower the height of the object. The transition from resting on the table to not being in contact with the table is an example of a mode switch. The conditions for this mode switch depend on the mass of the object being manipulated. By modeling the mode switch, the robot can estimate the mass of the object based on the conditions when the mode switch occurs. The robot can also use the model to predict when the object will break contact given its mass. We evaluated four different autoregressive hidden Markov models for representing manipulations with mass-dependent mode switches. The models were successfully evaluated on pushing and lifting tasks. The evaluations show that the predicted object trajectories and estimated object masses are more accurate when using models that interpolate between different masses, and that consider the observed state for estimating the mode switches.

[1]  Oliver Kroemer,et al.  Probabilistic Segmentation and Targeted Exploration of Objects in Cluttered Environments , 2014, IEEE Transactions on Robotics.

[2]  Dana Kulic,et al.  Incremental learning of full body motion primitives and their sequencing through human motion observation , 2012, Int. J. Robotics Res..

[3]  Sergey Levine,et al.  Unsupervised Learning for Physical Interaction through Video Prediction , 2016, NIPS.

[4]  Peter Stone,et al.  Learning to Order Objects Using Haptic and Proprioceptive Exploratory Behaviors , 2016, IJCAI.

[5]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[6]  Gaurav S. Sukhatme,et al.  Active articulation model estimation through interactive perception , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Hong Liu,et al.  Experimental study on impedance control for the five-finger dexterous robot hand DLR-HIT II , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Scott Niekum,et al.  Learning grounded finite-state representations from unstructured demonstrations , 2015, Int. J. Robotics Res..

[9]  Connor Schenck,et al.  Learning relational object categories using behavioral exploration and multimodal perception , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Jan Peters,et al.  Model Learning in Robotics: a Survey , 2011 .

[11]  L. Baum,et al.  An inequality and associated maximization technique in statistical estimation of probabilistic functions of a Markov process , 1972 .

[12]  John Hollerbach,et al.  Rigid body load identification for manipulators , 1985, 1985 24th IEEE Conference on Decision and Control.

[13]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[14]  Victor Ng-Thow-Hing,et al.  Randomized multi-modal motion planning for a humanoid robot manipulation task , 2011, Int. J. Robotics Res..

[15]  Jaime Valls Miró,et al.  Learning object, grasping and manipulation activities using hierarchical HMMs , 2014, Auton. Robots.

[16]  Leslie Pack Kaelbling,et al.  A hierarchical approach to manipulation with diverse actions , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Carme Torras,et al.  A robot learning from demonstration framework to perform force-based manipulation tasks , 2013, Intelligent Service Robotics.

[18]  Oliver Brock,et al.  Learning to Manipulate Articulated Objects in Unstructured Environments Using a Grounded Relational Representation , 2008, Robotics: Science and Systems.

[19]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[20]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[21]  Oliver Kroemer,et al.  Learning to predict phases of manipulation tasks as hidden states , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Oliver Kroemer,et al.  Towards learning hierarchical skills for multi-phase manipulation tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Gaurav S. Sukhatme,et al.  Learning to Switch Between Sensorimotor Primitives Using Multimodal Haptic Signals , 2016, SAB.

[24]  Siddhartha S. Srinivasa,et al.  Pre- and post-contact policy decomposition for planar contact manipulation under uncertainty , 2014, Int. J. Robotics Res..

[25]  Alan D. Christiansen,et al.  Learning reliable manipulation strategies without initial physical models , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[26]  Wolfram Burgard,et al.  Tactile Sensing for Mobile Manipulation , 2011, IEEE Transactions on Robotics.

[27]  Sethu Vijayakumar,et al.  Active estimation of object dynamics parameters with tactile sensors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Jiajun Wu,et al.  Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning , 2015, NIPS.

[29]  Jan Peters,et al.  Model learning for robot control: a survey , 2011, Cognitive Processing.

[30]  Mark R. Cutkosky,et al.  Estimating friction using incipient slip sensing during a manipulation task , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.