Deictic human/robot interaction

Abstract This paper discusses adeictic strategy for human/robot interaction based on models of human motor control. The human operator uses gestures to momentarily bind autonomous robot routines to a goal behavior and spatial context. As a result, the operator communicates symbolically, rather than literally control the robot, and the robot benefits from the operator's on-line reasoning. The strategy calledteleassistance, has been implemented for dexterous manipulation. A review of the results demonstrates that teleassistance requires executive operator control for only a fraction of the total task time and can accommodate natural variations in tasks better than what the autonomous routines alone can.

[1]  C. Sherrington.  Integrative Action of the Nervous System , 1907 .

[2]  Jonathan H. Connell,et al.  A colony architecture for an artificial creature , 1989 .

[3]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[4]  Paul Backes,et al.  The modular telerobot task execution system for space telerobotics , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[5]  S. Ullman.  Against direct perception , 1980, Behavioral and Brain Sciences.

[6]  Rodney A. Brooks,et al.  A layered intelligent control system for a mobile robot , 1986 .

[7]  Eileen Kowler,et al.  Reading twisted text: Implications for the role of saccades , 1987, Vision Research.

[8]  Fumio Kishino,et al.  Virtual Space Teleconferencing System - Real Time Detection and Reproduction of 3-D Human Images , 1993, HCI.

[9]  Vladimir J. Lumelsky,et al.  On human performance in telerobotics , 1991, IEEE Trans. Syst. Man Cybern..

[10]  David Chapman,et al.  Pengi: An Implementation of a Theory of Activity , 1987, AAAI.

[11]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[12]  Tsuneo Yoshikawa,et al.  Operation modes for cooperating with autonomous functions in intelligent teleoperation systems , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[13]  Rodney A. Brooks,et al.  A robot that walks; emergent behaviors from a carefully evolved network , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[14]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[16]  C. Gallistel.  The Organization of Action: A New Synthesis , 1982 .

[17]  Dana H. Ballard,et al.  Recognizing teleoperated manipulations , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[18]  Katsushi Ikeuchi,et al.  Grasp recognition and manipulative motion characterization from human hand motion sequences , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[19]  N. A. Bernshteĭn.  The co-ordination and regulation of movements , 1967 .

[20]  Dana H. Ballard,et al.  Sensing qualitative events to control manipulation , 1992, Other Conferences.

[21]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[22]  Thomas B. Sheridan,et al.  Supervisory control of remote manipulation , 1967, IEEE Spectrum.

[23]  J. Gibson.  The perception of the visual world , 1951 .

[24]  J. Kelso.  Human Motor Behavior: An Introduction , 1982 .

[25]  Shigeoki Hirai,et al.  Intelligent and cooperative control of telerobot tasks , 1992 .

[26]  Masayuki Inaba,et al.  Seeing, understanding and doing human task , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.