Tackling multi-sensory 3D data acquisition and fusion

The development of applications for multi-sensor data fusion typically faces heterogeneous hardware components, a variety of sensing principles and limited computational resources. We present a concept for synchronization and communication which tackles these challenges in multi-sensor systems in a unified manner. Here, a combination of hardware synchronization and deterministic software signals is promoted for global synchronization. Patterns of event-driven communication ensure that sensor data processing and evaluation are not bound to runtime constraints induced by data acquisition anymore. The combination of unified range and pose data description, event-driven communication, and global synchronization allows to build 3D sensing applications for various tasks. The proposed concept is implemented and evaluated for a variety of applications based on the DLR multisensory 3D-modeller. Extendability to other range and pose sensors is straightforward.

[1]  Richard T. Vaughan,et al.  On device abstractions for portable, reusable robot code , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[2]  R. Chapuis,et al.  A Real-Time , Multi-Sensor Architecture for fusion of delayed observations : Application to Vehicle Localisation , 2006 .

[3]  Heiko Hirschmüller,et al.  Stereo Vision in Structured Environments by Consistent Semi-Global Matching , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Christoph Borst,et al.  A Humanoid Two-Arm System for Dexterous Manipulation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[5]  G. Hirzinger,et al.  A Novel System Approach to Multisensory Data Acquisition , 2004 .

[6]  Gerd Hirzinger,et al.  A laser-triangulation based miniaturized 2-d range-scanner as integral part of a multisensory robot-gripper. , 1997 .

[7]  Don Mitchell Wilkes,et al.  A software architecture for integrated service robot development , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[8]  G. Hirzinger,et al.  Online surface reconstruction from unorganized 3D-points for the DLR hand-guided scanner system , 2004 .

[9]  Gerd Hirzinger,et al.  Online surface reconstruction from unorganized 3D-points for the DLR hand-guided scanner system , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[10]  Hendrik Van Brussel,et al.  A software framework for control of multi-sensor, multi-actuator systems , 2003 .

[11]  Gerd Hirzinger,et al.  C-space exploration using noisy sensor models , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Gerd Hirzinger,et al.  The 3D-Modeller: A Multi-Purpose Vision Platform , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Eric Wahl,et al.  The DLR multisensory Hand-Guided Device: the Laser Stripe Profiler , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  Christophe Debain,et al.  A real-time, multi-sensor architecture for fusion of delayed observations: application to vehicle localization , 2006, 2006 IEEE Intelligent Transportation Systems Conference.