Fast Pedestrian Recognition Based on Multisensor Fusion

A fast pedestrian recognition algorithm based on multisensor fusion is presented in this paper. Firstly, potential pedestrian locations are estimated by laser radar scanning in the world coordinates, and then their corresponding candidate regions in the image are located by camera calibration and the perspective mapping model. For avoiding time consuming in the training and recognition process caused by large numbers of feature vector dimensions, region of interest-based integral histograms of oriented gradients (ROI-IHOG) feature extraction method is proposed later. A support vector machine (SVM) classifier is trained by a novel pedestrian sample dataset which adapt to the urban road environment for online recognition. Finally, we test the validity of the proposed approach with several video sequences from realistic urban road scenarios. Reliable and timewise performances are shown based on our multisensor fusing method.

[1]  A. Fascioli,et al.  Pedestrian Protection Systems : Issues , Survey , and Challenges , 2007 .

[2]  A. Broggi,et al.  Low-level Pedestrian Detection by means of Visible and Far Infra-red Tetra-vision , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[3]  V. Willhoeft,et al.  Laser scanners for obstacle detection in automotive applications , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[4]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Marc-Michael Meinecke,et al.  Enhancing Pedestrian Safety by using the SAVE-U Pre-Crash System , 2005 .

[6]  U. Lages,et al.  A multi-sensor approach for the protection of vulnerable traffic participants the PROTECTOR project , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[7]  A. Broggi,et al.  A modular tracking system for far infrared pedestrian recognition , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[8]  Lie Guo,et al.  Pedestrian detection for intelligent transportation systems combining AdaBoost algorithm and support vector machine , 2012, Expert Syst. Appl..

[9]  M.-M. Meinecke,et al.  Radar sensors and sensor platform used for pedestrian protection in the EC-funded project SAVE-U , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[10]  緒方 淳,et al.  Real-time pedestrian detection using LIDAR and convolutional neural networks (特集 安全技術) , 2007 .

[11]  J. Scholz,et al.  Reliable pedestrian protection using laserscanners , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[12]  G. Wanielik,et al.  Multi sensor based tracking of pedestrians: a survey of suitable movement models , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[13]  Omer Tsimhoni,et al.  Pedestrian Detection with Night Vision Systems Enhanced by Automatic Warnings , 2005 .

[14]  Wuhong Wang,et al.  A safety-based approaching behavioural model with various driving characteristics , 2011 .

[15]  Ho Gi Jung,et al.  A New Approach to Urban Pedestrian Detection for Automatic Braking , 2009, IEEE Transactions on Intelligent Transportation Systems.

[16]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  D.M. Gavrila,et al.  Vision-based pedestrian detection: the PROTECTOR system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[19]  Michael McCarthy,et al.  The advanced protection of vulnerable road users (APVRU) - project information sheet , 2004 .

[20]  Y. Le Guilloux,et al.  PAROTO project: the benefit of infrared imagery for obstacle avoidance , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[21]  Dariu Gavrila,et al.  Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle , 2007, International Journal of Computer Vision.