Data fusion for robotic assembly tasks based on human skills

This work describes a data fusion architecture for robotic assembly tasks based on human sensory-motor skills. These skills are transferred to the robot through geometric and dynamic perception signals. Artificial neural networks are used in the learning process. The data fusion paradigm is addressed. It consists of two independent modules for optimal fusion and filtering. Kalman techniques linked to stochastic signal evolutions are used in the fusion algorithm. Compliant motion signals obtained from vision and pose sense are fused, enhancing the task performance. Simulations and peg-in-hole experiments are reported.

[1]  Ralf Heinrich Koeppe.  Robot Compliant Motion based on Human Skill , 2001 .

[2]  P. Verlinde,et al.  Decision fusion using a multi-linear classifier , 1998 .

[3]  R. Cortesao,et al.  Multisensor data fusion for skill transfer systems , 1999, Proceedings. 1999 IEEE/SICE/RSJ. International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI'99 (Cat. No.99TH8480).

[4]  Ren C. Luo,et al.  Multisensor fusion and integration: approaches, applications, and future research directions , 2002 .

[5]  Gerd Hirzinger,et al.  Proven Techniques for Robust Visual Servo Control , 1998 .

[6]  Krishna R. Pattipati,et al.  Efficient multisensor fusion using multidimensional data association , 2001 .

[7]  Ralf Koeppe,et al.  Skill representation and acquisition of compliant motions using a teach device , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[8]  Ralf Koeppe,et al.  Compliant motion control with stochastic active observers , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[9]  James Llinas,et al.  Handbook of Multisensor Data Fusion , 2001 .

[10]  Gregory D. Hager,et al.  Robust Vision for Vision-Based Control of Motion , 1999 .

[11]  Ren C. Luo,et al.  Multisensor integration and fusion in intelligent systems , 1989, IEEE Trans. Syst. Man Cybern..

[12]  Devika Subramanian,et al.  Robust localization algorithms for an autonomous campus tour guide , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  P. Hartana,et al.  Sensor data fusion using Kalman filter , 2000, Proceedings of the Third International Conference on Information Fusion.

[14]  S. M. Bozic.  Digital and Kalman filtering , 1979 .

[15]  I. R. Goodman,et al.  Mathematics of Data Fusion , 1997 .

[16]  Ralf Koeppe,et al.  Data fusion for compliant motion tasks based on human skills , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[18]  Ralf Koeppe,et al.  Explicit force control for manipulators with active observers , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[19]  G. Hirzinger,et al.  Sensorimotor Skill Transfer of Compliant Motion , 2000 .

[20]  H. Vincent Poor,et al.  Decentralized Sequential Detection with a Fusion Center Performing the Sequential Test , 1992, 1992 American Control Conference.

[21]  Ali Mohammad,et al.  Probabilistic Methods for Data Fusion , 2001 .

[22]  Jerzy Z. Sasiadek,et al.  Sensor fusion based on fuzzy Kalman filtering for autonomous robot vehicle , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[23]  François Michaud,et al.  Adaptable sensor fusion using multiple Kalman filters , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[24]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Y. Bar-Shalom,et al.  On optimal track-to-track fusion , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[26]  Belur V. Dasarathy,et al.  Decision fusion , 1994 .

[27]  Ralf Koeppe,et al.  Sensor fusion for skill transfer systems , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[28]  C. J. Harris,et al.  Comparison of two measurement fusion methods for Kalman-filter-based multisensor data fusion , 2001 .