Usability evaluation of high-level user assistance for robot mission specification

MissionLab is a mission specification system that implements a hybrid deliberative and reactive control architecture for autonomous mobile robots. The user creates and executes the robot mission plans through its graphical user interface. As robot deployments become more common in highly stressful situations, such as in dealing with explosives or biohazards, the usability of their mission specification system becomes critical. To address this need, a mission-planning "wizard" has been recently integrated into MissionLab. By retrieving and adapting past successful mission plans stored in its database, this new feature is designed to simplify the user's planning process. The latest formal usability experiments, reported in this paper, testing for usability improvements in terms of speed of the mission planning process, accuracy of the produced mission plans, and ease of use is conducted. This paper introduces the mission-planning wizard, describes the usability experiments (including design), and discusses the results in detail.

[1]  Tucker R. Balch,et al.  AuRA: principles and practice in review , 1997, J. Exp. Theor. Artif. Intell..

[2]  Joelle Pineau,et al.  Experiences with a mobile robotic guide for the elderly , 2002, AAAI/IAAI.

[3]  Simeon Keates,et al.  Designing a usable interface for an interactive robot , 1999 .

[4]  Ronald C. Arkin,et al.  Tactical mobile robot mission specification and execution , 1999, Optics East.

[5]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[6]  A VirziRobert.  Refining the test phase of usability evaluation , 1992 .

[7]  Bradley G. DeRoos,et al.  Law enforcement robot technology assessment , 2001, SPIE Optics East.

[8]  Jonathan Kies,et al.  User and task analysis for interface design , 1998 .

[9]  Paul R. Cohen,et al.  Empirical methods for artificial intelligence , 1995, IEEE Expert.

[10]  Hoa G. Nguyen,et al.  Robotics for law enforcement: applications beyond explosive ordnance disposal , 2001, SPIE Optics East.

[11]  John V. Draper,et al.  Human factors in telemanipulation: perspectives from the Oak Ridge National Laboratory experience , 1993, Other Conferences.

[12]  Ronald C. Arkin,et al.  Multiagent telerobotics: matching systems to tasks , 1999 .

[13]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[14]  Jakob Nielsen,et al.  Guerrilla HCI: using discount usability engineering to penetrate the intimidation barrier , 1994 .

[15]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[16]  Helmut Hoyer,et al.  Autonomous robot technology for advanced wheelchair and robotic aids for people with disabilities , 1995, Robotics Auton. Syst..

[17]  Ronald C. Arkin,et al.  Evaluating the Usability of Robot Programming Toolsets , 1998, Int. J. Robotics Res..

[18]  Carol M. Barnum,et al.  Usability testing and research , 2001 .

[19]  Julie A. Adams,et al.  Human Management of a Hierarchical System for the Control of Multiple Mobile Robots ( Dissertation Proposal ) MS-CIS-95-17 GRASP Lab 392 , 1994 .

[20]  R.C. Simpson,et al.  The Hephaestus Smart Wheelchair system , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Jan H. Spyridakis,et al.  Conducting Research in Technical Communication: The Application of True Experimental Designs. , 1992 .

[22]  John V. Draper,et al.  Teleoperators for advanced manufacturing: Applications and human factors challenges , 1995 .

[23]  Ronald C. Arkin,et al.  Field Results for Tactical Mobile Robot Missions , 2000 .

[24]  Robert A. Virzi,et al.  Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? , 1992 .

[25]  Ronald C. Arkin,et al.  Multiagent Mission Specification and Execution , 1997, Auton. Robots.

[26]  J.V. Draper,et al.  Workload, flow, and telepresence during teleoperation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[27]  Anthony S. White,et al.  An adaptable user interface and controller for a rehabilitation robotic arm , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[28]  Richard C. Simpson,et al.  EVALUATION OF THE HEPHAESTUS SMART WHEELCHAIR SYSTEM , 1999 .