Feature-based visual servoing and its application to telerobotics

Advances in visual servoing theory and practice now make it possible to accurately and robustly position a robot manipulator relative to a target. Both the vision and control algorithms are extremely simple, however they must be initialized on task-relevant features in order to be applied. Consequently, they are particularly well-suited to telerobotics systems where an operator can initialize the system but round-trip delay prohibits direct operator feedback during motion. This paper describes the basic theory behind feature-based visual servoing, and discusses the issues involved in integrating visual servoing into the ROTEX space teleoperation system.<<ETX>>

[1]  Emanuele Trucco,et al.  Geometric Invariance in Computer Vision , 1995 .

[2]  Gregory D. Hager,et al.  Robot feedback control based on stereo vision: towards calibration-free hand-eye coordination , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[4]  Gregory D. Hager Real-time feature tracking and projective invariance as a basis for hand-eye coordination , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Klaus Landzettel,et al.  ROTEX - The First Robot in Space , 1994 .

[6]  Thomas S. Huang,et al.  Motion and structure from orthographic projections , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[7]  Klaus Landzettel,et al.  Multisensory Shared Autonomy - A Key Issue In The Space Robot Technology Experiment ROTEX , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Gerd Hirzinger,et al.  A Sensor-based Telerobotic System for the Space Robot Experiment ROTEX , 1991, ISER.

[9]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[10]  David J. Kriegman,et al.  Structure and motion from line segments in multiple images , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[11]  Klaus Landzettel,et al.  Multisensory shared autonomy and tele-sensor-programming-Key issues in the space robot technology experiment ROTEX , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).