Transfer of coded information from sensory to motor networks

During sensory-guided motor tasks, information must be transferred from arrays of neurons coding target location to motor networks that generate and control movement. We address two basic questions about this information transfer. First, what mechanisms assure that the different neural representations align properly so that activity in the sensory network representing target location evokes a motor response generating accurate movement toward the target? Coordinate transformations may be needed to put the sensory data into a form appropriate for use by the motor system. For example, in visually guided reaching the location of a target relative to the body is determined by a combination of the position of its image on the retina and the direction of gaze. What assures that the motor network responds to the appropriate combination of sensory inputs corresponding to target position in body- or arm-centered coordinates? To answer these questions, we model a sensory network coding target position and use it to drive a similarly modeled motor network. To determine the actual motor response we use decoding methods that have been developed and verified in experimental work. We derive a general set of conditions on the sensory-to-motor synaptic connections that assure a properly aligned and transformed response. The accuracy of the response for different numbers of coding cells is computed. We show that development of the synaptic weights needed to generate the correct motor response can occur spontaneously through the observation of random movements and correlation-based synaptic modification. No error signal or external teaching is needed during this process. We also discuss nonlinear coordinate transformations and the presence of both shifting and nonshifting receptive fields in sensory/motor systems.

[1]  G E Alexander,et al.  Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[2]  Christof Koch,et al.  Cortical Cells Should Fire Regularly, But Do Not , 1999, Neural Computation.

[3]  G. Wallis,et al.  Learning invariant responses to the natural transformations of objects , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[4]  M. Kuperstein,et al.  An adaptive neural model for mapping invariant target position. , 1988, Behavioral neuroscience.

[5]  Carol L. Colby,et al.  Oculomotor control and spatial processing , 1992, Current Opinion in Neurobiology.

[6]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[7]  Richard A. Andersen,et al.  Coordinate transformations in the representation of spatial information , 1993, Current Opinion in Neurobiology.

[8]  R Caminiti,et al.  Making arm movements within different parts of space: the premotor and motor cortical representation of a coordinate system for reaching to visual targets , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[10]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Charles G. Gross,et al.  REVIEW ■ : Multiple Representations of Space in the Brain , 1995 .

[12]  J. V. Gisbergen,et al.  Collicular ensemble coding of saccades based on vector summation , 1987, Neuroscience.

[13]  E I Knudsen,et al.  A neural map of auditory space in the owl. , 1978, Science.

[14]  Marc Jeannerod Motor representation and control , 1990 .

[15]  M Kuperstein,et al.  Neural model of adaptive hand-eye coordination for single postures. , 1988, Science.

[16]  R. Andersen,et al.  Head position signals used by parietal neurons to encode locations of visual stimuli , 1995, Nature.

[17]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[18]  Paul B. Johnson,et al.  Making arm movements within different parts of space: dynamic aspects in the primate motor cortex , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  Nicholas Port,et al.  A Neural Network Model of Cortical Activity during Reaching , 1993, Journal of Cognitive Neuroscience.

[20]  E. Knudsen Auditory and visual maps of space in the optic tectum of the owl , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[22]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[23]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[24]  J F Soechting,et al.  Moving in three-dimensional space: frames of reference, vectors, and coordinate systems. , 1992, Annual review of neuroscience.

[25]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[26]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[28]  Joachim M. Buhmann,et al.  Size and distortion invariant object recognition by hierarchical graph matching , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[29]  Carol L Colby,et al.  Oculomotor control and spatial processing , 1992, Current Biology.

[30]  Paul B. Johnson,et al.  Visuomotor transformations underlying arm movements toward visual targets: a neural network model of cerebral cortical operations , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Francis Crick,et al.  The recent excitement about neural networks , 1989, Nature.

[32]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  R. Andersen,et al.  The influence of the angle of gaze upon the excitability of the light- sensitive neurons of the posterior parietal cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  S. Lockery,et al.  Distributed processing of sensory information in the leech. II. Identification of interneurons contributing to the local bending reflex , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  J. Stein The representation of egocentric space in the posterior parietal cortex. , 1992, The Behavioral and brain sciences.

[36]  R. Andersen Visual and eye movement functions of the posterior parietal cortex. , 1989, Annual review of neuroscience.

[37]  D C Van Essen,et al.  Shifter circuits: a computational strategy for dynamic aspects of visual processing. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[38]  R Held,et al.  Development of sensorially-guided reaching in infant monkeys. , 1974, Brain research.

[39]  Terence D. Sanger,et al.  Theoretical Considerations for the Analysis of Population Coding in Motor Cortex , 1994, Neural Computation.

[40]  T. Sejnowski,et al.  A neural model of the cortical representation of egocentric distance. , 1994, Cerebral cortex.

[41]  AL van der Meer,et al.  The functional significance of arm movements in neonates , 1995, Science.

[42]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[43]  T. Takahashi,et al.  The neural coding of auditory space. , 1989, The Journal of experimental biology.

[44]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[45]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[46]  L F Abbott,et al.  Decoding neuronal firing and modelling neural networks , 1994, Quarterly Reviews of Biophysics.

[47]  J. Kalaska,et al.  Cerebral cortical mechanisms of reaching movements. , 1992, Science.

[48]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[49]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[50]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[51]  C. Gross,et al.  Coding of visual space by premotor neurons. , 1994, Science.

[52]  Stephen Grossberg,et al.  Vector associative maps: Unsupervised real-time error-based learning and control of movement trajectories , 1991, Neural Networks.

[53]  W. Kristan SENSORY AND MOTOR NEURONES RESPONSIBLE FOR THE LOCAL BENDING RESPONSE IN LEECHES , 1982 .

[54]  G E Alexander,et al.  Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[55]  J. F. Soechting,et al.  Early stages in a sensorimotor transformation , 1992, Behavioral and Brain Sciences.

[56]  A. Hein,et al.  Neck muscle vibration modifies the representation of visual motion and direction in man. , 1988, Brain : a journal of neurology.

[57]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[59]  K. I. Blum,et al.  Functional significance of long-term potentiation for sequence learning and prediction. , 1996, Cerebral cortex.

[60]  A Hein Prerequisite for development of visually guided reaching in the kitten. , 1974, Brain research.

[61]  W. Kristan,et al.  Distributed processing of sensory information in the leech. I. Input- output relations of the local bending reflex , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[62]  J. Kalaska,et al.  Cerebellar neuronal activity related to whole-arm reaching movements in the monkey. , 1989, Journal of neurophysiology.