Mixed-Initiative Human-Robot Interaction: Definition, Taxonomy, and Survey

The objectives of this article are: 1) to present a taxonomy for mixed-initiative human-robot interaction and 2) to survey its state of practice through the examination of past research along each taxonomical dimension. The paper starts with some definitions of mixed-initiative interaction (MII) from the perspective of human-computer interaction (HCI) to introduce the basic concepts of MII. We then synthesize these definitions to the robotic context for mixed-initiative human robot teams. A taxonomy for mixed-initiative in human-robot interaction is then presented. The goal of the taxonomy is to inform the design of mixed-initiative human-robot systems by identifying key elements of these systems. The state of practice of mixed-initiative human-robot interaction is then surveyed and examined along each taxonomical dimension.

[1]  Robin Cohen,et al.  A Constraint Satisfaction Framework for Managing Mixed-Initiative Discourse , 1997 .

[2]  Paul H. Morris,et al.  Mixed-Initiative Planning in Space Mission Operations , 2007, AI Mag..

[3]  Douglas A. Few,et al.  Improved Human-Robot Teaming through Facilitated Initiative , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[4]  Michael A. Goodrich,et al.  On using mixed-initiative control: A perspective for managing large-scale robotic teams , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Vikram Manikonda,et al.  A Mixed Initiative Controller and Testbed for Human Robot Teams in Tactical Operations , 2007, AAAI Fall Symposium: Regarding the Intelligence in Distributed Intelligent Systems.

[6]  Jaime R. Carbonell,et al.  AI in CAI : An artificial intelligence approach to computer-assisted instruction , 1970 .

[7]  Angela Davids,et al.  Urban Search and Rescue Robots: From Tragedy to Technology , 2002, IEEE Intell. Syst..

[8]  Eduardo Salas,et al.  Distributed coordination space: Toward a theory of distributed team process and performance , 2003 .

[9]  Cynthia Breazeal,et al.  An Empirical Analysis of Team Coordination Behaviors and Action Planning With Application to Human–Robot Teaming , 2010, Hum. Factors.

[10]  Dan Ryan,et al.  Traded Control with Autonomous Robots as Mixed Initiative Interaction , 1997 .

[11]  Gheorghe Tecuci,et al.  Seven Aspects of Mixed-Initiative Reasoning: An Introduction to this Special Issue on Mixed-Initiative Assistants , 2007, AI Mag..

[12]  Curry I. Guinn,et al.  An Analysis of Initiative Selection in Collaborative Task-Oriented Discourse , 1998, User Modeling and User-Adapted Interaction.

[13]  João Borges de Sousa,et al.  Reallocations in teams of UAVs using dynamic programming and mixed initiative interactions , 2010, 2010 International Conference on Autonomous and Intelligent Systems, AIS 2010.

[14]  N. Sarkar,et al.  Mixed-Initiative Interaction and Robotic Systems , 2004 .

[15]  D. Serfaty,et al.  Adaption processes in team decisionmaking and coordination , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[16]  Ronald C. Arkin,et al.  Multiagent Teleautonomous Behavioral Control , 1997 .

[17]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[18]  Alberto Finzi,et al.  A Mixed-Initiative Approach to Human-Robot Interaction in Rescue Scenarios , 2005 .

[19]  Eric Horvitz,et al.  Reflections on Challenges and Promises of Mixed-Initiative Interaction , 2007, AI Mag..

[20]  Mary L. Cummings,et al.  Mixed-initiative strategies for real-time scheduling of multiple unmanned vehicles , 2012, 2012 American Control Conference (ACC).

[21]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[22]  Robin R. Murphy,et al.  Moonlight in Miami : A Field Study of Human-Robot Interaction in the Context of an Urban Search and Rescue Disaster Response Training Exercise , 2003 .

[23]  Robin R. Murphy,et al.  Mixed-initiative control of multiple hetrogeneous robots for urban search and rescue , 2000 .

[24]  Robin R. Murphy,et al.  Disaster Robotics , 2014, Springer Handbook of Robotics, 2nd Ed..

[25]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[26]  Bowen Hui,et al.  What is Initiative? , 1998, User Modeling and User-Adapted Interaction.

[27]  José Orlando Gomes,et al.  Handoff strategies in settings with high consequences for failure: lessons for health care operations. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[28]  James F. Allen,et al.  Integrating agent-based mixed-initiative control with an existing multi-agent planning system , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[29]  Roberto Pieraccini,et al.  The use of belief networks for mixed-initiative dialog modeling , 2000, IEEE Trans. Speech Audio Process..

[30]  C. Gibson,et al.  Team Implicit Coordination Processes: A Team Knowledge–Based Approach , 2008 .

[31]  Tetsuo Sawaragi,et al.  Naturalistic human-robot collaboration based upon mixed-initiative interactions in teleoperating environment , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[32]  Jennifer Chu-Carroll,et al.  An Evidential Model for Tracking Initiative in Collaborative Dialogue Interactions , 1998, User Modeling and User-Adapted Interaction.

[33]  Magnus Egerstedt,et al.  Less Is More: Mixed-Initiative Model-Predictive Control With Human Inputs , 2013, IEEE Transactions on Robotics.

[34]  Curry Guinn,et al.  Mixed-initiative interaction , 1999 .

[35]  A. McEwan,et al.  Patient handover from surgery to intensive care: using Formula 1 pit‐stop and aviation models to improve safety and quality , 2007, Paediatric anaesthesia.

[36]  Vijay Kumar,et al.  Mixed Initiative Control of Autonomous Vehicles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[37]  Holly A. Yanco,et al.  Classifying human-robot interaction: an updated taxonomy , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[38]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[39]  Richard M Frankel,et al.  Lost in Translation: Challenges and Opportunities in Physician-to-Physician Communication During Patient Handoffs , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[40]  C.W. Nielsen,et al.  Using mixed-initiative human-robot interaction to bound performance in a search task , 2008, 2008 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[41]  Robin R. Murphy,et al.  Moonlight in Miami: a field study of human-robot interaction in the context of an urban search and rescue disaster response training exercise , 2004 .

[42]  Michael Lewis,et al.  Mixed-initiative multirobot control in USAR , 2007 .

[43]  Robin R. Murphy,et al.  Human-robot interaction in rescue robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[44]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[45]  James F. Allen,et al.  TRIPS: An Integrated Intelligent Problem-Solving Assistant , 1998, AAAI/IAAI.

[46]  Sung-Bae Cho,et al.  Mixed-Initiative Human–Robot Interaction Using Hierarchical Bayesian Networks , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[47]  Barbara G. Kanki,et al.  Best Practices in Shift Turnovers: Implications for Reducing Aviation Maintenance Turnover Errors as Revealed in ASRS Reports , 2008 .

[48]  Jeffrey M. Bradshaw,et al.  Dimensions of Adjustable Autonomy and Mixed-Initiative Interaction , 2003, Agents and Computational Autonomy.

[49]  Elliot E. Entin,et al.  Adaptive Team Coordination , 1999, Hum. Factors.

[50]  Donald D. Dudenhoeffer,et al.  Mixed-initiative control for remote characterization of hazardous environments , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.