Neurorobotics 62. Neurorobotics: From Vision to Action

The lay view of a robot is a mechanical human,and thus robotics has always been inspired by at-tempts to emulate biology. In this Chapter, weextend this biological motivation from humans toanimals more generally, but with a focus on thecentral nervous systems rather than the bodies ofthese creatures. In particular, we investigate thesensorimotor loop in the execution of sophisti-cated behavior. Some of these sections concentrateon cases where vision provides key sensory data.Neuroethology is the study of the brain mecha-nisms underlying animal behavior, and Sect.62.2exemplifies the lessons it has to offer robotics bylooking at optic flow in bees, visually guided be-havior in frogs, and navigation in rats, turningthen to the coordination of behaviors and the roleof attention. Brains are composed of diverse sub-systems, many of which are relevant to robotics,but we have chosen just two regions of the mam-malian brain for detailed analysis. Section 62.3presents the cerebellum. While we can plan andexecute actions without a cerebellum, the actionsare no longer graceful and become uncoordinated.We reveal how a cerebellum can provide a keyingredient in an adaptive control system, tun-ing parameters both within and between motorschemas. Section 62.4 turns to the mirror sys-tem, which provides shared representations whichbridge between the execution of an action andthe observation of that action when performedby others. We develop a neurobiological model ofhow learning may forge mirror neurons for hand62.1

[1]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[2]  S. Schaal,et al.  Computational motor control in humans and robots , 2005, Current Opinion in Neurobiology.

[3]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[5]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[6]  Patrick van der Smagt,et al.  Visual feedback in motion , 1997 .

[7]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[8]  Giacomo Rizzolatti,et al.  Grasping movements: visuomotor transformations , 1998 .

[9]  Alexander Borst,et al.  Visual course control in flies , 2003 .

[10]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[11]  M. Srinivasan,et al.  Interactions of visual odometry and landmark guidance during food search in honeybees , 2005, Journal of Experimental Biology.

[12]  Gillian M. Hayes,et al.  Imitation as a dual-route process featuring predictive and learning components: a biologically plausible computational model , 2002 .

[13]  D. Wolpert,et al.  Mental state inference using visual control parameters. , 2005, Brain research. Cognitive brain research.

[14]  P. Dean,et al.  Event or emergency? Two response systems in the mammalian superior colliculus , 1989, Trends in Neurosciences.

[15]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[16]  Jun Tani,et al.  Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB , 2004, Neural Networks.

[17]  L. Craighero,et al.  Corticospinal excitability is specifically modulated by motor imagery: a magnetic stimulation study , 1998, Neuropsychologia.

[18]  Jean-Arcady Meyer,et al.  Integration of Navigation and Action Selection Functionalities in a Computational Model of Cortico-Basal-Ganglia–Thalamo-Cortical Loops , 2005, Adapt. Behav..

[19]  Masayuki Inaba,et al.  From visuo-motor self learning to early imitation-a neural architecture for humanoid learning , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[20]  M. A. Arbib,et al.  A Model of the Effects of Speed, Accuracy, and Perturbation on Visually Guided Reaching , 1992 .

[21]  B. Tondu,et al.  Computation of inverse functions in a model of cerebellar and reflex pathways allows to control a mobile mechanical segment , 2005, Neuroscience.

[22]  Aina Puce,et al.  Electrophysiology and brain imaging of biological motion. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  R. Johansson,et al.  Action plans used in action observation , 2003, Nature.

[24]  A. Georgopoulos,et al.  Parietal cortex neurons of the monkey related to the visual guidance of hand movement , 1990, Experimental Brain Research.

[25]  Michael A. Arbib,et al.  Mirror neurons and imitation: A computationally guided review , 2006, Neural Networks.

[26]  Michael Damsgaard,et al.  Numerical Simulation and Justification of Antagonists in Isometric Squatting , 2000 .

[27]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[28]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[29]  D. Ingle Visual Releasers of Prey-Catching Behavior in Frogs and Toads , 1968 .

[30]  Stefan Schaal,et al.  Computational approaches to motor learning by imitation. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[31]  Masao Ito Cerebellar circuitry as a neuronal machine , 2006, Progress in Neurobiology.

[32]  B. Stein,et al.  The Merging of the Senses , 1993 .

[33]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[34]  G. Rizzolatti,et al.  Localization of grasp representations in humans by PET: 1. Observation versus execution , 1996, Experimental Brain Research.

[35]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[36]  Paul M. Fitzpatrick,et al.  First contact: an active vision approach to segmentation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[37]  W Reichardt,et al.  Autocorrelation, a principle for evaluation of sensory information by the central nervous system , 1961 .

[38]  Mitsuo Kawato,et al.  MOSAIC Model for Sensorimotor Learning and Control , 2001, Neural Computation.

[39]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[40]  M. Srinivasan,et al.  Visual regulation of ground speed and headwind compensation in freely flying honey bees (Apis mellifera L.) , 2006, Journal of Experimental Biology.

[41]  Giulio Sandini,et al.  An anthropomorphic retina-like structure for scene analysis , 1980 .

[42]  Christophe Sabourin,et al.  Robustness of the dynamic walk of a biped robot subjected to disturbing external forces by using CMAC neural networks , 2005, Robotics Auton. Syst..

[43]  Dave Cliff Neuroethology, computational , 1998 .

[44]  Michael A. Arbib,et al.  Extending the mirror neuron system model, I , 2007, Biological Cybernetics.

[45]  Michael A. Arbib,et al.  Depth and detours: an essay on visually guided behavior , 1990 .

[46]  Stéphane Viollet,et al.  Bio-inspired optical flow circuits for the visual guidance of micro air vehicles , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[47]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[48]  R. Johansson,et al.  Prediction Precedes Control in Motor Learning , 2003, Current Biology.

[49]  J. Albus A Theory of Cerebellar Function , 1971 .

[50]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[51]  Scott H. Johnson-Frey The neural bases of complex tool use in humans , 2004, Trends in Cognitive Sciences.

[52]  H. Gomi,et al.  Multijoint muscle regulation mechanisms examined by measured human arm stiffness and EMG signals. , 1999, Journal of neurophysiology.

[53]  Giulio Sandini,et al.  Object-based Visual Attention: a Model for a Behaving Robot , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[54]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[55]  E. Rolls,et al.  Attention and working memory: a dynamical model of neuronal activity in the prefrontal cortex , 2003, The European journal of neuroscience.

[56]  A. Barto,et al.  Models of the cerebellum and motor learning , 1996 .

[57]  M. Arbib,et al.  Multiple representations of space underlying behavior , 1982, Behavioral and Brain Sciences.

[58]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[59]  Shih-Chii Liu,et al.  Fly-like visuomotor responses of a robot using aVLSI motion-sensitive chips , 2001, Biological Cybernetics.

[60]  Angelo Arleo,et al.  Combining Multimodal Sensory Input for Spatial Learning , 2002, ICANN.

[61]  W. Thomas Miller,et al.  Real-time application of neural networks for sensor-based control of robots with vision , 1989, IEEE Trans. Syst. Man Cybern..

[62]  G. Rizzolatti,et al.  The organization of the cortical motor system: new concepts. , 1998, Electroencephalography and clinical neurophysiology.

[63]  Bernhard Voelkl,et al.  Imitation as Faithful Copying of a Novel Technique in Marmoset Monkeys , 2007, PloS one.

[64]  Giorgio Metta,et al.  Grounding vision through experimental manipulation , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[65]  R. Didday A model of visuomotor mechanisms in the frog optic tectum , 1976 .

[66]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[67]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[68]  Yiannis Demiris,et al.  Distributed, predictive perception of actions: a biologically inspired robotics architecture for imitation and learning , 2003, Connect. Sci..

[69]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[70]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[71]  Jan Peters,et al.  Searching a Scalable Approach to Cerebellar Based Control , 2002, Applied Intelligence.