Automatic Generation of Training Data for Image Classification of Road Scenes

There is an ever increasing demand for semantically annotated images to train and evaluate image classifiers. Currently this data is obtained by manually labeling each individual image thus making the process labor intensive and costly. We therefore present an approach that generates semantically annotated images for classes road and curb in a fully automatic way. The advantage of our method is that it relies on cues from range sensors only thus making its output suitable for training and evaluating image classifiers. We use a normal based curb detector and extract the road by running an active contour on these detections. Since our algorithm does not rely on parametric models it is possible to detect a wide range of road geometries in different environments. Sequences of up to a minute can be accurately labeled without any user interference in less than a minute.

[1]  Paul H. Lewis,et al.  An automated algorithm for extracting road edges from terrestrial mobile LiDAR data , 2013 .

[2]  Fernando Santos Osório,et al.  Robust curb detection and vehicle localization in urban environments , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[3]  Christian Heipke,et al.  Using snakes for the registration of topographic road database objects to ALS features , 2011 .

[4]  Zhidong Deng,et al.  Road curb detection using 3D lidar and integral laser points for intelligent vehicles , 2012, The 6th International Conference on Soft Computing and Intelligent Systems, and The 13th International Symposium on Advanced Intelligence Systems.

[5]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[6]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[7]  George Vosselman,et al.  Mapping curbstones in airborne and mobile laser scanning data , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[8]  Chenglu Wen,et al.  Patch-Based Semantic Labeling of Road Scene Using Colorized Mobile LiDAR Point Clouds , 2016, IEEE Transactions on Intelligent Transportation Systems.

[9]  Martin Lauer,et al.  Grid Map based Free Space Estimation using Stereo Vision , 2015 .

[10]  P. Peixoto,et al.  Road Detection Using High Resolution LIDAR , 2014, 2014 IEEE Vehicle Power and Propulsion Conference (VPPC).

[11]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[12]  Aleksey Boyko,et al.  Extracting roads from dense point clouds in large scale urban environment , 2011 .

[13]  Wende Zhang,et al.  LIDAR-based road and road-edge detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[14]  Bisheng Yang,et al.  Semi-automated extraction and delineation of 3D roads of street scene from mobile laser scanning point clouds , 2013 .

[15]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[16]  Wolfgang Förstner,et al.  Curb reconstruction using Conditional Random Fields , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[17]  Sergiu Nedevschi,et al.  Curb detection for driving assistance systems: A cubic spline-based approach , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[18]  Ming-Ting Sun,et al.  Semantic Instance Annotation of Street Scenes by 3D to 2D Label Transfer , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Xiaonian Wang,et al.  A real-time curb detection and tracking method for UGVs by using a 3D-LIDAR sensor , 2015, 2015 IEEE Conference on Control Applications (CCA).

[20]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[21]  Darius Burschka,et al.  Efficient occupancy grid computation on the GPU with lidar and radar for road boundary detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[22]  David Fernández Llorca,et al.  Curvature-based curb detection method in urban environments using stereo and laser , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[23]  Jörg Stückler In-Lane Localization in Road Networks Using Curbs Detected in Omnidirectional Height Images , 2008 .

[24]  Cheng Wang,et al.  Automated Road Information Extraction From Mobile Laser Scanning Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  W. Sardha Wijesoma,et al.  Road-boundary detection and tracking using ladar sensing , 2004, IEEE Transactions on Robotics and Automation.

[26]  Bahman Soheilian,et al.  Road side detection and reconstruction using LIDAR sensor , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).