The self-referenced DLR 3D-modeler

In the context of 3-D scene modeling, this work aims at the accurate estimation of the pose of a close-range 3-D modeling device, in real-time and passively from its own images. This novel development makes it possible to abandon using inconvenient, expensive external positioning systems. The approach comprises an ego-motion algorithm tracking natural, distinctive features, concurrently with customary 3-D modeling of the scene. The use of stereo vision, an inertial measurement unit, and robust cost functions for pose estimation further increases performance. Demonstrations and abundant video material validate the approach.

[1]  Mumin Song,et al.  Overview of three-dimensional shape measurement using optical methods , 2000 .

[2]  Gerald Roth,et al.  Using projective vision to find camera positions in an image sequence , 2000 .

[3]  Gerd Hirzinger,et al.  The 3D-Modeller: A Multi-Purpose Vision Platform , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Eric Wahl,et al.  The DLR multisensory Hand-Guided Device: the Laser Stripe Profiler , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  Patrick Hébert A self-referenced hand-held range sensor , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[6]  Jeffrey K. Uhlmann,et al.  A counter example to the theory of simultaneous localization and map building , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  H. Hirschmüller Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Stereo Processing by Semi-global Matching and Mutual Information , 2022 .

[8]  K. Ikeuchi,et al.  Self-position estimation for virtual 3D city model construction with the use of horizontal line laser scanning , 2008 .

[9]  Darius Burschka,et al.  V-GPS - image-based control for 3D guidance systems , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Gerd Hirzinger,et al.  A laser-triangulation based miniaturized 2-d range-scanner as integral part of a multisensory robot-gripper. , 1997 .

[11]  Piotr Jasiobedzki,et al.  Stereo-Vision Based 3D Modeling and Localization for Unmanned Vehicles , 2008 .

[12]  Darius Burschka,et al.  Efficient camera-based pose estimation for real-time applications , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Pietro Perona,et al.  3D Photography Using Shadows in Dual-Space Geometry , 1999, International Journal of Computer Vision.

[14]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[16]  Florian Schmidt,et al.  Rollin' Justin - Mobile platform with variable base , 2009, 2009 IEEE International Conference on Robotics and Automation.

[17]  Gerd Hirzinger,et al.  Optimal Hand-Eye Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Brian G Richmond,et al.  Early Hominin Foot Morphology Based on 1.5-Million-Year-Old Footprints from Ileret, Kenya , 2009, Science.

[19]  Richard Khoury An Enhanced Positioning Algorithm for a Self-Referencing Hand-Held 3D Sensor , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[20]  François Blais Review of 20 years of range sensor development , 2004, J. Electronic Imaging.