Active Visual SLAM with Independently Rotating Camera

In active Visual-SLAM (V-SLAM), a robot relies on the information retrieved by its cameras to control its own movements for autonomous mapping of the environment. Cameras are usually statically linked to the robot’s body, limiting the extra degrees of freedom for visual information acquisition. In this work, we overcome the aforementioned problem by introducing and leveraging an independently rotating camera on the robot base. This enables us to continuously control the heading of the camera, obtaining the desired optimal orientation for active V-SLAM, without rotating the robot itself. However, this additional degree of freedom introduces additional estimation uncertainties, which need to be accounted for. We do this by extending our robot’s state estimate to include the camera state and jointly estimate the uncertainties. We develop our method based on a state-of-the-art active V-SLAM approach for omnidirectional robots and evaluate it through rigorous simulation and real robot experiments. We obtain more accurate maps, with lower energy consumption, while maintaining the benefits of the active approach with respect to the baseline. We also demonstrate how our method easily generalizes to other non-omnidirectional robotic platforms, which was a limitation of the previous approach. Code and implementation details are provided as open-source.

[1]  Alberto Del Bimbo,et al.  Continuous recovery for real time pan tilt zoom localization and mapping , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[2]  Peter Carr,et al.  Hybrid robotic/virtual pan-tilt-zom cameras for autonomous event recording , 2013, ACM Multimedia.

[3]  Simone Frintrop,et al.  Attentional Landmarks and Active Gaze Control for Visual SLAM , 2008, IEEE Transactions on Robotics.

[4]  Javier Ruiz-del-Solar,et al.  A Dynamic and Efficient Active Vision System for Humanoid Soccer Robots , 2015, RoboCup.

[5]  Moritz Diehl,et al.  ACADO toolkit—An open‐source framework for automatic control and dynamic optimization , 2011 .

[6]  Martin Buss,et al.  Combined Trajectory Planning and Gaze Direction Control for Robotic Exploration , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Avinash C. Kak,et al.  Person Tracking with a Mobile Robot using Two Uncalibrated Independently Moving Cameras , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Andrej Zdesar,et al.  Vision-based Localization of a Wheeled Mobile Robot with a Stereo Camera on a Pan-tilt Unit , 2019, ICINCO.

[9]  Thomas Moore,et al.  A Generalized Extended Kalman Filter Implementation for the Robot Operating System , 2014, IAS.

[10]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[11]  François Michaud,et al.  RTAB‐Map as an open‐source lidar and visual simultaneous localization and mapping library for large‐scale and long‐term online operation , 2018, J. Field Robotics.

[12]  Ryan M. Eustice,et al.  Active visual SLAM for robotic area coverage: Theory and experiment , 2015, Int. J. Robotics Res..

[13]  Gregory Dudek,et al.  Texture-Aware SLAM Using Stereo Imagery and Inertial Information , 2016, 2016 13th Conference on Computer and Robot Vision (CRV).

[14]  John K. Tsotsos,et al.  The Effect of Color Space Selection on Detectability and Discriminability of Colored Objects , 2017, ArXiv.

[15]  David W. Murray,et al.  Mobile Robot Localisation Using Active Vision , 1998, ECCV.

[16]  Joachim Hertzberg,et al.  Automatic Reconstruction of Colored 3D Models , 2004 .

[17]  Christos Papachristos,et al.  Uncertainty-aware receding horizon exploration and mapping using aerial robots , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Michael J. Black,et al.  iRotate: Active Visual SLAM for Omnidirectional Robots , 2021, ArXiv.

[19]  Roland Siegwart,et al.  Comparing ICP variants on real-world data sets , 2013, Auton. Robots.

[20]  Roland Siegwart,et al.  An Efficient Sampling-Based Method for Online Informative Path Planning in Unknown Environments , 2020, IEEE Robotics and Automation Letters.