Efficient and Reactive Planning for High Speed Robot Air Hockey

Highly dynamic robotic tasks require high-speed and reactive robots. These tasks are particularly challenging due to the physical constraints, hardware limitations, and the high uncertainty of dynamics and sensor measures. To face these issues, it’s crucial to design robotics agents that generate precise and fast trajectories and react immediately to environmental changes. Air hockey is an example of this kind of task. Due to the environment’s characteristics, it is possible to formalize the problem and derive clean mathematical solutions. For these reasons, this environment is perfect for pushing to the limit the performance of currently available general-purpose robotic manipulators. Using two Kuka Iiwa 14, we show how to design a policy for general-purpose robotic manipulators for the air hockey game. We demonstrate that a real robot arm can perform fast-hitting movements and that the two robots can play against each other on a medium-size air hockey table in simulation.

[1]  Mark W. Spong,et al.  Control of Planar Rigid Body Sliding with Impacts and Friction , 2000, Int. J. Robotics Res..

[2]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[3]  Giulio Sandini,et al.  Manipulability analysis , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[4]  Harold J. Kushner,et al.  A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise , 1964 .

[5]  Mark W. Spong,et al.  Vision-based control of an air hockey playing robot , 1999 .

[6]  Claudio Melchiorri,et al.  Trajectory Planning for Automatic Machines and Robots , 2010 .

[7]  Hao Jianye,et al.  An Empirical Study of Assumptions in Bayesian Optimisation , 2021 .

[8]  P. Kumaraswamy.  A generalized probability density function for double-bounded random processes , 1980 .

[9]  Takashi Suehiro,et al.  A two-layer tactical system for an air-hockey-playing robot , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Majid Nili Ahmadabadi,et al.  Automatic calibration of an air hockey robot , 2013, 2013 First RSI/ISM International Conference on Robotics and Mechatronics (ICRoM).

[11]  Nahum Shimkin,et al.  Learning Control for Air Hockey Striking Using Deep Reinforcement Learning , 2017, 2017 International Conference on Control, Artificial Intelligence, Robotics & Optimization (ICCAIRO).

[12]  Petar Kormushev,et al.  Autonomous Air-Hockey Playing Cobot Using Optimal Control and Vision-Based Bayesian Tracking , 2019, TAROS.

[13]  Kenzo Nonami,et al.  Hierarchical processing architecture for an air-hockey robot system , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Chelsea Finn,et al.  Learning Latent Representations to Influence Multi-Agent Interaction , 2020, CoRL.

[15]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[16]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[17]  Akio Namiki,et al.  Algorithm for optimizing attack motions for air-hockey robot by two-step look ahead prediction , 2016, 2016 IEEE/SICE International Symposium on System Integration (SII).

[18]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[19]  Jonas Mockus,et al.  On Bayesian Methods for Seeking the Extremum , 1974, Optimization Techniques.