Performance verification for robot missions in uncertain environments

Abstract Establishing a-priori mission performance guarantees is crucial if autonomous robots are to be used with confidence in missions where failure could incur high costs in life and property damage. Automatic mission software verification, in addition to simulation and experimental benchmarking, is a key component of the solution for establishing performance guarantees. This component requires automatically verifying that the software constructed by the mission designer when executed in a partially known environment will adhere to the performance guarantee. In prior work we developed VIPARS, a unique approach to verifying performance guarantees for autonomous behavior-based robot software based on a combination of static analysis and Bayesian networks. While that approach produced fast and accurate verification of single robot missions with robot motion uncertainty, it did not address multiple-robot missions or any form of uncertainty related to environment geometry. This paper addresses the challenges involved in building a software tool for verifying the behavior of a multi-robot waypoint mission that includes uncertainly located obstacles and uncertain environment geometry as well as uncertainty in robot motion. An approach is presented to the problem of a-priori specification of uncertain environments for robot program verification. Two approaches to modeling probabilistic localization for verification are presented: a high-level approach and an approach that allows run-time localization code to be embedded in verification. Verification and experimental validation results are presented for several autonomous robot missions, demonstrating the accuracy of verification and the mission-specific benefit of localization

[1]  Christoph Lüth,et al.  Experiences in Applying Formal Verification in Robotics , 2010, SAFECOMP.

[2]  Clare Dixon,et al.  Formal Verification of an Autonomous Personal Robotic Assistant , 2014, AAAI Spring Symposia.

[3]  Damian M. Lyons,et al.  Performance Verification for Behavior-Based Robot Missions , 2015, IEEE Trans. Robotics.

[4]  Karl Henrik Johansson,et al.  Revising motion planning under Linear Temporal Logic specifications in partially known workspaces , 2013, 2013 IEEE International Conference on Robotics and Automation.

[5]  Karsten Berns,et al.  Formal verification of safety behaviours of the outdoor robot ravon , 2007, ICINCO-RA.

[6]  Rajeev Joshi,et al.  Verifying Multi-threaded C Programs with SPIN , 2008, SPIN.

[7]  Michael A. Arbib,et al.  Port Automata and the Algebra of Concurrent Processes , 1983, J. Comput. Syst. Sci..

[8]  Michael Fisher,et al.  Verifying autonomous systems , 2013, CACM.

[9]  Dieter Fox,et al.  KLD-Sampling: Adaptive Particle Filters , 2001, NIPS.

[10]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[11]  Robert J. Szczerba,et al.  Bounding overwatch operations for robotic and semi-robotic ground vehicles , 1998, Defense, Security, and Sensing.

[12]  Karsten Berns,et al.  Formal verification of behaviour networks including sensor failures , 2015 .

[13]  Anthony Cowley,et al.  Towards language-based verification of robot behaviors , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Damian M. Lyons,et al.  Probabilistic Verification of Multi-robot Missions in Uncertain Environments , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[15]  Klaus Havelund,et al.  Verification and validation meet planning and scheduling , 2013, International Journal on Software Tools for Technology Transfer.

[16]  Ronald C. Arkin,et al.  Verifying Performance for Autonomous Robot Missions with Uncertainty , 2013 .

[17]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[18]  Ronald C. Arkin,et al.  An Analysis of Displays for Probabilistic Robotic Mission Verification Results , 2017 .

[19]  Ronald C. Arkin,et al.  Multiagent Mission Specification and Execution , 1997, Auton. Robots.

[20]  Hadas Kress-Gazit,et al.  Automatic synthesis of robot controllers for tasks with locative prepositions , 2010, 2010 IEEE International Conference on Robotics and Automation.

[21]  Damian M. Lyons,et al.  Automatic Verification of Autonomous Robot Missions , 2014, SIMPAR.

[22]  Nikolaj Bjørner,et al.  Satisfiability modulo theories , 2011, Commun. ACM.

[23]  Kerstin Eder,et al.  Verification and testing of mobile robot navigation algorithms: A case study in SPARK , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Karsten Berns,et al.  Verification of Behavior-Based Networks - Using Satisfiability Modulo Theories , 2014, ISR 2014.

[25]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[26]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[27]  Qing Hu,et al.  Does deterrence work in reducing information security policy abuse by employees? , 2011, Commun. ACM.

[28]  Tommaso Bolognesi,et al.  Tableau methods to describe strong bisimilarity on LOTOS processes involving pure interleaving and enabling , 1994, FORTE.

[29]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[30]  Hyoungki Lee,et al.  Formal Verification of Robot Movements - a Case Study on Home Service Robot SHR100 , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[31]  Ronald C. Arkin,et al.  SLAM-Based Spatial Memory for Behavior-Based Robots , 2015 .

[32]  Andrew William Roscoe,et al.  The Theory and Practice of Concurrency , 1997 .

[33]  Alastair F. Donaldson,et al.  Software Model Checking , 2014, Computing Handbook, 3rd ed..

[34]  Ronald C. Arkin,et al.  Evaluating the Usability of Robot Programming Toolsets , 1998, Int. J. Robotics Res..

[35]  Nicholas Roy,et al.  Guaranteeing High-Level Behaviors While Exploring Partially Known Maps , 2013 .