Place recognition with deep superpixel features for brain-inspired navigation.

Navigation in primates is generally supported by cognitive maps. Such a map endows an animal with navigational planning capabilities. Numerous methods have been proposed to mimic these natural navigation capabilities in artificial systems. Based on self-navigation and learning strategies in animals, we propose in this work a place recognition strategy for brain-inspired navigation. First, a place recognition algorithm structure based on convolutional neural networks (CNNs) is introduced, which can be applied in the field of intelligent navigation. Second, sufficient images are captured at each landmark and then stored as a reference image library. Simple linear iterative clustering (SLIC) is used to segment each image into superpixels with multi-scale viewpoint-invariant landmarks. Third, highly representative appearance-independent features are extracted from these landmarks through CNNs. In addition, spatial pyramid pooling (SPP) layers are introduced to generate a fixed-length CNN representation, regardless of the image size. This representation boosts the quality of the extracted landmark features. The proposed SLIC-SPP-CNN place recognition algorithm is evaluated on one collected dataset and two public datasets with viewpoint and appearance variations.

[1]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[2]  Jianwei Liu,et al.  A novel Rauch-Tung-Streibel smoothing scheme based on the factor graph for autonomous underwater vehicles. , 2020, The Review of scientific instruments.

[3]  Francisco Javier Ariza-López,et al.  Analysis of Thematic Similarity Using Confusion Matrices , 2018, ISPRS Int. J. Geo Inf..

[4]  Liu Jianye,et al.  Inner Attitude Integration Algorithm Based on Fault Detection for Strapdown Inertial Attitude and Heading Reference System , 2010 .

[5]  Rafael Muñoz-Salinas,et al.  Robust identification of fiducial markers in challenging conditions , 2018, Expert Syst. Appl..

[6]  Chong Shen,et al.  Comprehensive Heading Error Processing Technique Using Image Denoising and Tilt-Induced Error Compensation for Polarization Compass , 2020, IEEE Access.

[7]  Michael Milford,et al.  Biologically-inspired visual place recognition with adaptive multiple scales , 2017, Robotics Auton. Syst..

[8]  Yan Su,et al.  Graph-Based Place Recognition in Image Sequences with CNN Features , 2018, Journal of Intelligent & Robotic Systems.

[9]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Konstantin Eckle,et al.  A comparison of deep networks with ReLU activation function and linear spline-type methods , 2018, Neural Networks.

[11]  Weiwei Huang,et al.  Cognitive memory and mapping in a brain-like system for robotic navigation , 2017, Neural Networks.

[12]  Danping Zou,et al.  Optimal Heading Estimation Based Multidimensional Particle Filter for Pedestrian Indoor Positioning , 2018, IEEE Access.

[13]  Margarita Chli,et al.  Real-Time Wide-Baseline Place Recognition Using Depth Completion , 2019, IEEE Robotics and Automation Letters.

[14]  Josef Sivic,et al.  NetVLAD: CNN Architecture for Weakly Supervised Place Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Chong Shen,et al.  Seamless integration of polarization compass and inertial navigation data with a self-learning multi-rate residual correction algorithm , 2020 .

[16]  Yanqing Wang,et al.  Real-Time Visual Place Recognition Based on Analyzing Distribution of Multi-scale CNN Landmarks , 2019, J. Intell. Robotic Syst..

[17]  Anantha P. Chandrakasan,et al.  CONV-SRAM: An Energy-Efficient SRAM With In-Memory Dot-Product Computation for Low-Power Convolutional Neural Networks , 2019, IEEE Journal of Solid-State Circuits.

[18]  D. Heeger,et al.  Position–theta-phase model of hippocampal place cell activity applied to quantification of running speed modulation of firing rate , 2019, Proceedings of the National Academy of Sciences.

[19]  Gerald E. Sobelman,et al.  Memory Segment Matching Network Based Image Geo-Localization , 2019, IEEE Access.

[20]  Peter E. D. Love,et al.  A deep learning-based approach for mitigating falls from height with computer vision: Convolutional neural network , 2019, Adv. Eng. Informatics.

[21]  Tao Zhang,et al.  A vision-based navigation approach with multiple radial shape marks for indoor aircraft locating , 2014 .

[22]  Jiazhen Lu,et al.  False star detection and isolation during star tracking based on improved chi-square tests. , 2017, The Review of scientific instruments.

[23]  Chaoyang Zhu,et al.  Place recognition: An Overview of Vision Perspective , 2017, Applied Sciences.

[24]  Javier González,et al.  Appearance-invariant place recognition by discriminatively training a convolutional neural network , 2017, Pattern Recognit. Lett..

[25]  Michael Bosse,et al.  Trajectory-Based Place-Recognition for Efficient Large Scale Localization , 2017, International Journal of Computer Vision.

[26]  Jiannong Cao,et al.  Superpixel-based imaging for residential area detection of high spatial resolution remote sensing imagery , 2020 .