ProMPs Robot Trajectory Intention Prediction Belief Tracker Imitation Learning Intention Aware ProMP Adaptation Spatial Deformation Mode Temporal Scaling Mode Robot Goal Tracker Human observations Motion Goals Trajectory Predictions

In order to operate close to non-experts, future robots require both an intuitive form of instruction accessible to laymen and the ability to react appropriately to a human co-worker. Instruction by imitation learning with probabilistic movement primitives (ProMPs) allows capturing tasks by learning robot trajectories from demonstrations including the motion variability. However, appropriate responses to human co-workers during the execution of the learned movements are crucial for fluent task execution, perceived safety, and subjective comfort. To facilitate such appropriate responsive behaviors in humanrobot interaction, the robot needs to be able to react to its human workspace co-inhabitant online during the execution of the ProMPs. Thus, we learn a goal-based intention prediction model from human motions. Using this probabilistic model, we introduce intention-aware online adaptation to ProMPs. We compare two different novel approaches: First, online spatial deformation, which avoids collisions by changing the shape of the ProMP trajectories dynamically during execution while staying close to the demonstrated motions and second, online temporal scaling, which adapts the velocity profile of a ProMP to avoid time-dependent collisions. We evaluate both approaches in experiments with non-expert users. The subjects reported a higher level of perceived safety and felt less disturbed during intention aware adaptation, in particular during spatial deformation, compared to non-adaptive behavior of the robot.

[1]  Dana Kulic,et al.  Safe planning for human-robot interaction , 2005 .

[2]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Stefan Schaal,et al.  Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[4]  Stefan Schaal,et al.  Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance , 2009, 2009 IEEE International Conference on Robotics and Automation.

[5]  Andreas Krause,et al.  Unfreezing the robot: Navigation in dense, interacting crowds , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Paulo Martins Engel,et al.  Incremental Learning of Multivariate Gaussian Mixture Models , 2010, SBIA.

[7]  Tamio Arai,et al.  Assessment of operator stress induced by robot collaboration in assembly , 2010 .

[8]  Rachid Alami,et al.  Synthesizing Robot Motions Adapted to Human Presence , 2010 .

[9]  Mark H. Overmars,et al.  Simulating Human Collision Avoidance Using a Velocity-Based Approach , 2010, VRIPHYS.

[10]  Alexandra Kirsch,et al.  Legible robot navigation in the proximity of moving humans , 2012, 2012 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO).

[11]  Aude Billard,et al.  A dynamical system approach to realtime obstacle avoidance , 2012, Autonomous Robots.

[12]  Takayuki Kanda,et al.  Modeling and Prediction of Pedestrian Behavior based on the Sub-goal Concept , 2012, Robotics: Science and Systems.

[13]  Rachid Alami,et al.  A Human-Aware Manipulation Planner , 2012, IEEE Transactions on Robotics.

[14]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[16]  Aude Billard,et al.  Safety issues in human-robot interactions , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Dmitry Berenson,et al.  Human-robot collaborative manipulation planning using early prediction of human motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Stefan Glasauer,et al.  Adjustments of Speed and Path when Avoiding Collisions with Another Pedestrian , 2014, PloS one.

[19]  Carlos Morato,et al.  Toward Safe Human Robot Collaboration by Using Multiple Kinects Based Real-Time Human Tracking , 2014, J. Comput. Inf. Sci. Eng..

[20]  Przemyslaw A. Lasota,et al.  Analyzing the Effects of Human-Aware Motion Planning on Close-Proximity Human–Robot Collaboration , 2015, Hum. Factors.

[21]  Ashwin P. Dani,et al.  Human intention inference through interacting multiple model filtering , 2015, 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[22]  David Hsu,et al.  Intention-aware online POMDP planning for autonomous driving in a crowd , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Dmitry Berenson,et al.  Predicting human reaching motion in collaborative tasks using Inverse Optimal Control and iterative re-planning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Dmitry Berenson,et al.  Considering avoidance and consistency in motion planning for human-robot manipulation in a shared workspace , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Jan Peters,et al.  Demonstration based trajectory optimization for generalizable robot motions , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[26]  Carme Torras,et al.  Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Peter Nickel,et al.  Effects of movement speed and predictability in human–robot collaboration , 2017 .

[28]  Tom Ziemke,et al.  User Experience in Social Human-Robot Interaction , 2017, Int. J. Ambient Comput. Intell..

[29]  Matteo Saveriano,et al.  Human-aware motion reshaping using dynamical systems , 2017, Pattern Recognit. Lett..

[30]  Oliver Kroemer,et al.  Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks , 2017, Auton. Robots.

[31]  Felipe Garcia Lopez,et al.  A predictive online path planning and optimization approach for cooperative mobile service robot navigation in industrial applications , 2017, 2017 European Conference on Mobile Robots (ECMR).

[32]  Sven Behnke,et al.  Efficient stochastic multicriteria arm trajectory optimization , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Manuel Lopes,et al.  Postural optimization for an ergonomic human-robot interaction , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  François Charpillet,et al.  Prediction of Intention during Interaction with iCub with Probabilistic Movement Primitives , 2017, Front. Robot. AI.

[35]  Pieter Abbeel,et al.  An Algorithmic Perspective on Imitation Learning , 2018, Found. Trends Robotics.

[36]  Dylan P. Losey,et al.  Trajectory Deformations From Physical Human–Robot Interaction , 2017, IEEE Transactions on Robotics.

[37]  Dmitry Berenson,et al.  Unsupervised early prediction of human reaching for human–robot collaboration in shared workspaces , 2018, Auton. Robots.

[38]  Jan Peters,et al.  Using probabilistic movement primitives in robotics , 2018, Auton. Robots.

[39]  Barbara Deml,et al.  Human-Aware Robotic Assistant for Collaborative Assembly: Integrating Human Motion Prediction With Planning in Time , 2018, IEEE Robotics and Automation Letters.