Environmental Perception for Intelligent Vehicles Using Catadioptric Stereo Vision Systems

This paper presents advantages of catadioptric camera systems for robotic applications using the example of autonomous vehicles and driver assistance systems. We propose two different catadioptric stereo camera systems to improve environmental perception. Both stereo camera systems consist of at least one catadioptric camera, which combines a lens with a hyperbolic mirror and provides a panoramic view of the surrounding. This allows a 360◦ field of view of the vehicle’s surrounding and ultimately allows e.g. object detection around the vehicle or the detection of lane markings next to the vehicle. We discuss the advantages of both camera systems for stereo vision and 3D reconstruction. Furthermore, we show results for depth estimation with sparse features in a simulated environment as well as on a real data set.

[1]  Martin Lauer,et al.  A generative model for 3D urban scene understanding from movable platforms , 2011, CVPR 2011.

[2]  Markus Glaser,et al.  Omnidirectional Cameras as Backing-Up Aid , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Zhigang Zhu.  Omnidirectional Stereo Vision , 2001 .

[4]  Stefano Cagnoni,et al.  Stereo Obstacle Detection Method for a Hybrid Omni-directional/Pin-Hole Vision System , 2001, RoboCup.

[5]  Tomás Pajdla,et al.  Eliminating Blind Spots for Assisted Driving , 2008, IEEE Transactions on Intelligent Transportation Systems.

[6]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[7]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  P. Sturm.  Mixing catadioptric and perspective cameras , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[10]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[11]  Jon Rigelsford.  Panoramic Vision: Sensors, Theory and Applications , 2002 .

[12]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[13]  Shree K. Nayar,et al.  Real-Time Omnidirectional and Panoramic Stereo , 1998 .

[14]  Martin Lauer,et al.  3D-objecttracking with a mixed omnidirectional stereo camera system , 2011 .

[15]  Roland Siegwart,et al.  Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles , 2008, ICVS.

[16]  M. Trivedi,et al.  Toward a Comparative Study of Lane Tracking using Omni-directional and Rectilinear Images for Driver Assistance Systems , 2007 .

[17]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[18]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[19]  Roland Siegwart,et al.  Monocular omnidirectional visual odometry for outdoor ground vehicles , 2008, ICVS 2008.

[20]  Tarak Gandhi,et al.  Vehicle Surround Capture: Survey of Techniques and a Novel Omni-Video-Based Approach for Dynamic Panoramic Surround Maps , 2006, IEEE Transactions on Intelligent Transportation Systems.

[21]  Narendra Ahuja,et al.  An Omnidirectional Stereo Vision System Using a Single Camera , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  Tomás Svoboda,et al.  Epipolar Geometry for Central Catadioptric Cameras , 2002, International Journal of Computer Vision.