Topological map learning from outdoor image sequences

We propose an approach to building topological maps of environments based on image sequences. The central idea is to use manifold constraints to find representative feature prototypes, so that images can be related to each other, and thereby to camera poses in the environment. Our topological map is built incrementally, performing well after only a few visits to a location. We compare our method to several other approaches to representing images. During tests on novel images from the same environment, our method attains the highest accuracy in finding images depicting similar camera poses, including generalizing across considerable seasonal variations. © 2007 Wiley Periodicals, Inc.

[1]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Illah R. Nourbakhsh,et al.  Appearance-based place recognition for topological localization , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[4]  Peter L. Bartlett,et al.  Functional Gradient Techniques for Combining Hypotheses , 2000 .

[5]  Geoffrey E. Hinton,et al.  Stochastic Neighbor Embedding , 2002, NIPS.

[6]  Benjamin Kuipers,et al.  Bootstrap learning for place recognition , 2002, AAAI/IAAI.

[7]  Wolfram Burgard,et al.  Using an Image Retrieval System for Vision-Based Mobile Robot Localization , 2002, CIVR.

[8]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[9]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Nicolas Le Roux,et al.  Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering , 2003, NIPS.

[11]  James Theiler,et al.  Grafting: Fast, Incremental Feature Selection by Gradient Descent in Function Space , 2003, J. Mach. Learn. Res..

[12]  Roberto Cipolla,et al.  An Image-Based System for Urban Navigation , 2004, BMVC.

[13]  Ieee Robotics.  2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, September 28 - October 2, 2004 , 2004, IROS.

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  Gregory Dudek,et al.  Learning Generative Models of Scene Features , 2004, International Journal of Computer Vision.

[16]  Gregory Dudek,et al.  Self-Organizing Visual Maps , 2004, AAAI.

[17]  Jana Kosecka,et al.  Location Recognition and Global Localization Based on Scale-Invariant Keypoints , 2004 .

[18]  David M. Bradley,et al.  Real-time image-based topological localization in large outdoor environments , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Michael H. Bowling,et al.  Subjective Localization with Action Respecting Embedding , 2005, ISRR.

[20]  James J. Little,et al.  Vision-based global localization and mapping for mobile robots , 2005, IEEE Transactions on Robotics.

[21]  Gregory Z. Grudic,et al.  Topological Mapping with Multiple Visual Manifolds , 2005, Robotics: Science and Systems.

[22]  Trevor Darrell,et al.  Learning appearance manifolds from video , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[24]  Gustavo Carneiro,et al.  The distinctiveness, detectability, and robustness of local image features , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Daniel D. Lee,et al.  Learning nonlinear appearance manifolds for robot localization , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Ali Shokoufandeh,et al.  Landmark Selection for Vision-Based Navigation , 2006, IEEE Trans. Robotics.

[27]  M. Hebert,et al.  Finding Images of Landmarks in Video Sequences , .