Grip Stabilization of Novel Objects Using Slip Prediction

Controlling contact with arbitrary, unknown objects defines a fundamental problem for robotic grasping and in-hand manipulation. In real-world scenarios, where robots interact with a variety of objects, the sheer number of possible contact interactions prohibits acquisition of the necessary models for all objects of interest. As an alternative to traditional control approaches that require accurate models, predicting the onset of slip can enable controlling contact interactions without explicit model knowledge. In this article, we propose a grip stabilization approach for novel objects based on slip prediction. Using tactile information, such as applied pressure and fingertip deformation, our approach predicts the emergence of slip and modulates the contact forces accordingly. We formulate a supervised-learning problem to predict the future occurrence of slip from high-dimensional tactile information provided by a BioTac sensor. This slip mapping generalizes across objects, including objects absent during training. We evaluate how different input features, slip prediction time horizons, and available tactile information channels, impact prediction accuracy. By mounting the sensor on a PA-10 robotic arm, we show that employing prediction in a controller's feedback loop yields an object grip stabilization controller that can successfully stabilize multiple, previously unknown objects by counteracting slip events.

[1]  Nikolaos G. Tsagarakis,et al.  Reflex control of the Pisa/IIT SoftHand during object slippage , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Mark R. Cutkosky,et al.  Slip interface classification through tactile signal coherence , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Peter K. Allen,et al.  Stable grasping under pose uncertainty using tactile feedback , 2014, Auton. Robots.

[4]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[5]  Claudio Melchiorri,et al.  Slip detection and control using tactile and force sensors , 2000 .

[6]  Mark R. Cutkosky,et al.  Estimating friction using incipient slip sensing during a manipulation task , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[7]  Gaurav S. Sukhatme,et al.  Force Estimation and Slip Detection for Grip Control using a Biomimetic Tactile Sensor , 2015 .

[8]  Tsukasa Ogasawara,et al.  Grip force control for an elastic finger using vision-based incipient slip feedback , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Danica Kragic,et al.  ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Danica Kragic,et al.  Learning of grasp adaptation through experience and tactile sensing , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[12]  Edward H. Adelson,et al.  Improved GelSight tactile sensor for measuring geometry and slip , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[14]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .

[15]  Van Anh Ho,et al.  What can be inferred from a tactile arrayed sensor in autonomous in-hand manipulation? , 2012, 2012 IEEE International Conference on Automation Science and Engineering (CASE).

[16]  Alexander Dietrich,et al.  Experimental comparison of slip detection strategies by tactile sensing with the BioTac® on the DLR hand arm system , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Jeremy A. Fishel,et al.  Design and use of a biomimetic tactile microvibration sensor with human-like sensitivity and its application in texture discrimination using Bayesian exploration , 2012 .

[18]  Michael Beetz,et al.  Improving robot manipulation through fingertip perception , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  David L. Brock,et al.  Enhancing the dexterity of a robot hand using controlled slip , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[20]  G.E. Loeb,et al.  Grip Control Using Biomimetic Tactile Sensing Systems , 2009, IEEE/ASME Transactions on Mechatronics.

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[22]  Mark R. Cutkosky,et al.  Sensing skin acceleration for slip and texture perception , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[23]  Gerald E. Loeb,et al.  Multimodal Tactile Sensor , 2014, The Human Hand as an Inspiration for Robot Hand Development.

[24]  Koh Hosoda,et al.  Acquisition of Multi-Modal Expression of Slip through Pick-Up Experiences , 2006, IROS.

[25]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[26]  Matteo Campanella,et al.  Detection of incipient object slippage by skin-like sensing and neural network processing , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[27]  Danica Kragic,et al.  Predicting slippage and learning manipulation affordances through Gaussian Process regression , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[28]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[29]  Jan Peters,et al.  Stabilizing novel objects by learning to predict tactile slip , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[31]  Helge J. Ritter,et al.  Using a Piezo-Resistive Tactile Sensor for Detection of Incipient Slippage , 2010, ISR/ROBOTIK.

[32]  Nawid Jamali,et al.  Slip prediction using Hidden Markov models: Multidimensional sensor data to symbolic temporal pattern learning , 2012, 2012 IEEE International Conference on Robotics and Automation.

[33]  Kaspar Althoefer,et al.  A novel dynamic slip prediction and compensation approach based on haptic surface exploration , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  J. Shotton,et al.  Decision Forests for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2011 .

[35]  Trevor Darrell,et al.  Using robotic exploratory procedures to learn the meaning of haptic adjectives , 2013, 2013 IEEE International Conference on Robotics and Automation.

[36]  Mark R. Cutkosky,et al.  Incipient Slip Detection and Recovery for Controllable Gecko-Inspired Adhesion , 2017, IEEE Robotics and Automation Letters.

[37]  Minoru Asada,et al.  Anthropomorphic robotic soft fingertip with randomly distributed receptors , 2006, Robotics Auton. Syst..

[38]  I. Fujimoto,et al.  Development of artificial finger skin to detect incipient slip for realization of static friction sensation , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[39]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .