Detection of ascending stairs using stereo vision

Environment perception is an important task in computer vision for many applications in robotics. Especially for robots navigating through different levels of a building, stair detection constitutes an important perception task. In this paper, we propose a stair detection algorithm using range data. Firstly, we introduce a parameter, which describes local surface orientations w.r.t. a global reference. Secondly, a matched filter is used to detect relevant edges in the orientation data. Afterwards, line segments are determined using these edge data which are further used to estimate stairs. The proposed method is invariant against rotations of the sensor. We show that the system can handle typical outdoor stair types and outperforms the accuracy of state-of-the-art stair detection methods. Moreover, the method is used in real time to assist visually impaired people who wear the camera system on a helmet.

[1]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[2]  Jörg Stückler,et al.  Efficient Multi-resolution Plane Segmentation of 3D Point Clouds , 2011, ICIRA.

[3]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Thomas K. Peucker,et al.  2. Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or its Caricature , 2011 .

[5]  Michael Brady,et al.  Vision-based Detection of Stair-cases , 2003 .

[6]  Julius Ziegler,et al.  Accuracy analysis of surface normal reconstruction in stereo vision , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[7]  Sven Behnke,et al.  Real-Time Plane Segmentation Using RGB-D Cameras , 2012, RoboCup.

[8]  Philip David,et al.  Ascending stairway modeling from dense depth imagery for traversability analysis , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Junsong Yuan,et al.  Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera , 2011, ACM Multimedia.

[10]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[11]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[12]  Wei Wang,et al.  Stairway detection using Gabor Filter and FFPG , 2011, 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[13]  Roberto Manduchi,et al.  Detection and Localization of Curbs and Stairways Using Stereo Vision , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[14]  Nassir Navab,et al.  Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[17]  T. Kanade,et al.  Fast and accurate computation of surface normals from range images , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[19]  G. Medioni,et al.  Piecewise Planar Modeling for Step Detection using Stereo Vision , 2008 .

[20]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[21]  D. O. North,et al.  An Analysis of the factors which determine signal/noise discrimination in pulsed-carrier systems , 1963 .

[22]  Josechu J. Guerrero,et al.  Detection and Modelling of Staircases Using a Wearable Depth Sensor , 2014, ECCV Workshops.

[23]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[24]  Maren Bennewitz,et al.  From 3D point clouds to climbing stairs: A comparison of plane segmentation approaches for humanoids , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.