SEED: Series Elastic End Effectors in 6D for Visuotactile Tool Use

We propose the framework of Series Elastic End Effectors in 6D (SEED), which combines a spatially compliant element with visuotactile sensing to grasp and manipulate tools in the wild. Our framework generalizes the benefits of series elasticity to 6-dof, while providing an abstraction of control using visuotactile sensing. We propose an algorithm for relative pose estimation from visuotactile sensing, and a spatial hybrid forceposition controller capable of achieving stable force interaction with the environment. We demonstrate the effectiveness of our framework on tools that require regulation of spatial forces. Video link: https://youtu.be/2-YuIfspDrk

[1]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[2]  Marc Toussaint,et al.  Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning , 2018, Robotics: Science and Systems.

[3]  Neville Hogan,et al.  High bandwidth force regulation and inertia reduction using a macro/micro manipulator system , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[4]  Alin Albu-Schäffer,et al.  A Unified Passivity-based Control Framework for Position, Torque and Impedance Control of Flexible Joint Robots , 2007, Int. J. Robotics Res..

[5]  Jorge Angeles,et al.  On the Nature of the Cartesian Stiffness Matrix , 2010 .

[6]  David W. Robinson,et al.  Design and analysis of series elasticity in closed-loop actuator force control , 2000 .

[7]  Rachel Holladay,et al.  Force-and-Motion Constrained Planning for Tool Use , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Maria Bauza,et al.  Tactile Object Pose Estimation from the First Touch with Geometric Contact Rendering , 2020, CoRL.

[9]  W. Gevarter.  Basic relations for control of flexible vehicles , 1969 .

[10]  Alberto Rodriguez,et al.  Tactile Dexterity: Manipulation Primitives with Tactile Feedback , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[11]  S. Sastry,et al.  Task oriented optimal grasping by multifingered robot hands , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[12]  Jung-Su Ha,et al.  Describing Physics For Physical Reasoning: Force-Based Sequential Manipulation Planning , 2020, IEEE Robotics and Automation Letters.

[13]  Russ Tedrake,et al.  Soft-bubble: A highly compliant dense geometry tactile sensor for robot manipulation , 2019, 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft).

[14]  E. Adelson,et al.  Cable manipulation with a tactile-reactive gripper , 2019, Robotics: Science and Systems.

[15]  Sami Haddadin,et al.  Unified passivity-based Cartesian force/impedance control for rigid and flexible joint robots via task-energy tanks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Devesh K. Jha,et al.  Tactile-RL for Insertion: Generalization to Objects of Unknown Geometry , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Edward H. Adelson,et al.  GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force , 2017, Sensors.

[18]  Matthew M. Williamson,et al.  Series elastic actuators , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[19]  E. Adelson,et al.  SwingBot: Learning Physical Features from In-hand Tactile Exploration for Dynamic Swing-up Manipulation , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Maya Cakmak,et al.  Making objects graspable in confined environments through push and pull manipulation with a tool , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Stephen Paul Buerger,et al.  Stable, high-force, low-impedance robotic actuators for human-interactive machines , 2005 .

[22]  Silvio Savarese,et al.  Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[23]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[24]  Russ Tedrake,et al.  Soft-bubble grippers for robust and perceptive manipulation , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Russ Tedrake,et al.  Fast Model-Based Contact Patch and Pose Estimation for Highly Deformable Dense-Geometry Tactile Sensors , 2020, IEEE Robotics and Automation Letters.

[26]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[27]  Jianhua Li,et al.  GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Finger , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Joel W. Burdick,et al.  Finding antipodal point grasps on irregularly shaped objects , 1992, IEEE Trans. Robotics Autom..

[29]  B. Beck.  Animal Tool Behavior: The Use and Manufacture of Tools by Animals , 1980 .

[30]  Russ Tedrake,et al.  The Surprising Effectiveness of Linear Models for Visual Foresight in Object Pile Manipulation , 2020, WAFR.

[31]  Bruno Siciliano,et al.  Spatial impedance control of redundant manipulators , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[32]  Russ Tedrake,et al.  Bundled Gradients through Contact via Randomized Smoothing , 2021, IEEE Robotics and Automation Letters.