Robust road detection in shadow conditions

Abstract. Image-based road detection is a vital task for many real-world applications, such as autonomous driving and obstacle detection. We propose a method for segmenting road regions from a single image based on horizon line estimation and clustering technology. The key idea is to leverage normalized cross correlation to search for the line separating the road image. Additionally, we divide the lower part of the road image into several identical parts horizontally and utilize a density-peak clustering algorithm in terms of gray and HSV value of each pixel. Clustering results are further labeled as road and nonroad based on the assumption that two adjacent horizontal parts share similar clustering size and average gray value. For road images with shadows, we also propose a new shadow-free space derived from HSV space. By calculating maximum entropy and reconstructing images, we show that shadows are eliminated to achieve better road detection. Experimental results on four datasets and shadow images demonstrate the effectiveness and robustness of our method.

[1]  Huosheng Hu,et al.  Visual Campus Road Detection for an UGV Using Fast Scene Segmentation and Rapid Vanishing Point Estimation , 2014 .

[2]  Yong-Ren Huang,et al.  Fast Algorithm for Structured and Unstructured Road Detection , 2009, 2009 2nd International Congress on Image and Signal Processing.

[3]  He Zhen,et al.  Simple road detection based on vanishing point , 2014, J. Electronic Imaging.

[4]  Antonio Torralba,et al.  Nonparametric Scene Parsing via Label Transfer , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Mahasak Ketcham,et al.  The analysis of lane detection algorithms using histogram shapes and Hough transform , 2015, Int. J. Intell. Comput. Cybern..

[6]  Patrick Y. Shinzato,et al.  Fast visual road recognition and horizon detection using multiple artificial neural networks , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[7]  Fei Wang,et al.  A robust road segmentation method based on graph cut with learnable neighboring link weights , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[8]  Yufeng Chen,et al.  Multi-scale Ill-Structured Road Detection , 2014, 2014 International Conference on Computational Intelligence and Communication Networks.

[9]  Xiao Liu,et al.  Unstructured road detection based on fuzzy clustering arithmetic , 2014, 2014 11th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[10]  Vincent Frémont,et al.  Color-based road detection and its evaluation on the KITTI road benchmark , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[11]  Franz Kummert,et al.  Monocular Road Terrain Detection by Combining Visual and Spatial Information , 2014, IEEE Transactions on Intelligent Transportation Systems.

[12]  Degui Xiao,et al.  Road detection based on superpixels and anisotropic heat diffusion , 2014, 2014 Fourth International Conference on Digital Information and Communication Technology and its Applications (DICTAP).

[13]  Seiichi Mita,et al.  Drivable Road Boundary Detection for Intelligent Vehicles based on Stereovision with Plane-induced Homography , 2013 .

[14]  Joan Serrat,et al.  Road Detection via On-line Label Transfer , 2014, ArXiv.

[15]  Harish Yenala,et al.  ROBOG an autonomously navigating vehicle based on road detection for unstructured road , 2015, 2015 International Conference on Signal Processing and Communication Engineering Systems.

[16]  Nick Barnes,et al.  Data-driven road detection , 2014, IEEE Winter Conference on Applications of Computer Vision.

[17]  Choong-Shik Park,et al.  Lane Detection using Fuzzy C-Means Clustering , 2009 .

[18]  L. Rittner,et al.  A simple and efficient Road Detection Algorithm for Real Time Autonomous Navigation based on Monocular Vision , 2006, 2006 IEEE 3rd Latin American Robotics Symposium.

[19]  Jannik Fritsch,et al.  A new performance measure and evaluation benchmark for road detection algorithms , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[20]  Si-Yu Xia,et al.  Road detection via unsupervised feature learning , 2015, 2015 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[21]  Christopher Rasmussen,et al.  Combining laser range, color, and texture cues for autonomous road following , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[22]  Qi Wang,et al.  Adaptive road detection towards multiscale-multilevel probabilistic analysis , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[23]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[24]  Jianwu Fang,et al.  Adaptive road detection via context-aware label transfer , 2015, Neurocomputing.

[25]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[26]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  丁伟利 Ding Weili,et al.  Depth Estimation of Urban Road Image Based on Contour Understanding , 2014 .

[28]  Suya You,et al.  Delineation and geometric modeling of road networks , 2010 .

[29]  Kaiyue Lu,et al.  Clustering based road detection method , 2015, 2015 34th Chinese Control Conference (CCC).

[30]  Zhang Wanzhi,et al.  Rural Road Detection of Color Image in Complicated Environment , 2013 .

[31]  F. SergioA.Rodriguez,et al.  A multi-modal system for road detection and segmentation , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[32]  N. N. Ahmed Salim,et al.  A Robust Approach for Road Detection with Shadow Detection Removal Technique , 2014 .

[33]  Jae-Hyun Cho,et al.  Improved lane detection system using Hough transform with super-resolution reconstruction algorithm and multi-ROI , 2014, 2014 International Conference on Electronics, Information and Communications (ICEIC).

[34]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[35]  Mingwu Ren,et al.  Road detection via superpixels and interactive image segmentation , 2014, The 4th Annual IEEE International Conference on Cyber Technology in Automation, Control and Intelligent.

[36]  Jing-Yu Yang,et al.  A vision based road detection algorithm , 2004, IEEE Conference on Robotics, Automation and Mechatronics, 2004..

[37]  Huosheng Hu,et al.  Real-time road detection and description for robot navigation in an unstructured campus environment , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[38]  Fei Zheng,et al.  A New Method of Unstructured Road Detection Based on HSV Color Space and Road Features , 2007, 2007 International Conference on Information Acquisition.

[39]  Konrad Schindler,et al.  Towards Scene Understanding with Detailed 3D Object Representations , 2014, International Journal of Computer Vision.

[40]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[41]  Bin Dai,et al.  Vision-based long-distance lane perception and front vehicle location for full autonomous vehicles on highway roads , 2012 .

[42]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[43]  Jean Ponce,et al.  Vanishing point detection for road detection , 2009, CVPR.

[44]  Cheng Xu,et al.  A Fast and Robust Heuristic Road Detection Algorithm , 2014 .

[45]  Vassili V. Postnikov,et al.  Road shape recognition based on scene self-similarity , 2015, Other Conferences.

[46]  Yong Zhu,et al.  Improved river flow and random sample consensus for curve lane detection , 2015 .

[47]  J.M. Alvarez,et al.  Illuminant-invariant model-based road segmentation , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[48]  Danilo Alves de Lima,et al.  A 2D/3D Vision Based Approach Applied to Road Detection in Urban Environments , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[49]  Theo Gevers,et al.  Road Detection by One-Class Color Classification: Dataset and Experiments , 2014, ArXiv.

[50]  P. Peixoto,et al.  Road Detection Using High Resolution LIDAR , 2014, 2014 IEEE Vehicle Power and Propulsion Conference (VPPC).

[51]  Zhang Guo-ying,et al.  A Road Detection Algorithm by Boosting Using Feature Combination , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[52]  Wen Gao,et al.  Image Matching by Normalized Cross-Correlation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[53]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[54]  Abdesselam Bouzerdoum,et al.  Lane Detection in Unstructured Environments for Autonomous Navigation Systems , 2014, ACCV.

[55]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[56]  Marina Gashinova,et al.  Road Edge Recognition Using the Stripe Hough Transform From Millimeter-Wave Radar Images , 2015, IEEE Transactions on Intelligent Transportation Systems.

[57]  Fernando A. Mujica,et al.  An Empirical Evaluation of Deep Learning on Highway Driving , 2015, ArXiv.

[58]  Theo Gevers,et al.  Combining Priors, Appearance, and Context for Road Detection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[59]  Minho Lee,et al.  Robust Lane Detection Based On Convolutional Neural Network and Random Sample Consensus , 2014, ICONIP.

[60]  Si-Yu Xia,et al.  Unstructured road detection from a single image , 2015, 2015 10th Asian Control Conference (ASCC).