Online stereo camera calibration from scratch

Stereo cameras are among the most promising sensors for automated driving. For their deployment, however, calibration should be automated and possible in-situ. We propose a restructuring of bundle adjustment into an incremental online calibration system. It allows us to estimate all observable camera parameters on the fly. Both simulations and experiments with real world cameras show its capability to calibrate stereo rigs in real time while driving. With this method, cameras can be employed with almost no calibration overhead. Only the non-observable parameter of scale has to be defined in advance.

[1]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Thao Dang,et al.  Self-calibration for Active Automotive Stereo Vision , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[4]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[5]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[6]  Roland Siegwart,et al.  Unified temporal and spatial calibration for multi-sensor systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[8]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[9]  Christian Hoffmann,et al.  Continuous Stereo Self-Calibration by Camera Parameter Tracking , 2009, IEEE Transactions on Image Processing.

[10]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[11]  Julius Ziegler,et al.  Calibrating multiple cameras with non-overlapping views using coded checkerboard targets , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[12]  Sinisa Segvic,et al.  Improving the Egomotion Estimation by Correcting the Calibration Bias , 2015, VISAPP.

[13]  Peirong Ji.  StereoScan : Dense 3 D Reconstruction in Real-time , 2016 .

[14]  Benjamin Ranft,et al.  Modeling arbitrarily oriented slanted planes for efficient stereo vision based on block matching , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[15]  I. Reid,et al.  Metric calibration of a stereo rig , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[16]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.