Learning Cross-Modal Spatial Transformations through Spike Timing-Dependent Plasticity

A common problem in tasks involving the integration of spatial information from multiple senses, or in sensorimotor coordination, is that different modalities represent space in different frames of reference. Coordinate transformations between different reference frames are therefore required. One way to achieve this relies on the encoding of spatial information with population codes. The set of network responses to stimuli in different locations (tuning curves) constitutes a set of basis functions that can be combined linearly through weighted synaptic connections to approximate nonlinear transformations of the input variables. The question then arises: how is the appropriate synaptic connectivity obtained? Here we show that a network of spiking neurons can learn the coordinate transformation from one frame of reference to another, with connectivity that develops continuously in an unsupervised manner, based only on the correlations available in the environment and with a biologically realistic plasticity mechanism (spike timing-dependent plasticity).

[1]  J. Soechting,et al.  Somatosensory cortical activity in relation to arm posture: nonuniform spatial tuning. , 1996, Journal of neurophysiology.

[2]  Haim Sompolinsky,et al.  Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity , 2003, The Journal of Neuroscience.

[3]  Stéphanie Ratté,et al.  Synapse‐specific mGluR1‐dependent long‐term potentiation in interneurones regulates mouse hippocampal inhibition , 2004, The Journal of physiology.

[4]  Jill C. Heathcock,et al.  Toy-oriented changes in hand and joint kinematics during the emergence of purposeful reaching , 2005 .

[5]  M. Poo,et al.  Coincident Pre- and Postsynaptic Activity Modifies GABAergic Synapses by Postsynaptic Changes in Cl− Transporter Activity , 2003, Neuron.

[6]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[7]  K. Hoffmann,et al.  Neurons in the primate superior colliculus coding for arm movements in gaze-related coordinates. , 2000, Journal of neurophysiology.

[8]  Rufin van Rullen,et al.  Neurons Tune to the Earliest Spikes Through STDP , 2005, Neural Computation.

[9]  M Kuperstein,et al.  Neural model of adaptive hand-eye coordination for single postures. , 1988, Science.

[10]  Stephen Grossberg,et al.  Vector associative maps: Unsupervised real-time error-based learning and control of movement trajectories , 1991, Neural Networks.

[11]  R. Nicoll,et al.  Silent Synapses Speak Up , 1997, Neuron.

[12]  E. Thelen,et al.  The transition to reaching: mapping intention and intrinsic dynamics. , 1993, Child development.

[13]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[14]  E Guigon,et al.  Recoding arm position to learn visuomotor transformations. , 2001, Cerebral cortex.

[15]  David L. Sparks,et al.  Auditory receptive fields in primate superior colliculus shift with changes in eye position , 1984, Nature.

[16]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[17]  S. Grossberg,et al.  A Self-Organizing Neural Model of Motor Equivalent Reaching and Tool Use by a Multijoint Arm , 1993, Journal of Cognitive Neuroscience.

[18]  T. Sejnowski,et al.  A neural model of the cortical representation of egocentric distance. , 1994, Cerebral cortex.

[19]  C. Einspieler,et al.  Load perturbation does not influence spontaneous movements in 3-month-old infants. , 2004, Early Human Development.

[20]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[21]  R. Huganir,et al.  Activity-Dependent Modulation of Synaptic AMPA Receptor Accumulation , 1998, Neuron.

[22]  Mark C. W. van Rossum,et al.  Computation with populations codes in layered networks of integrate-and-fire neurons , 2004, Neurocomputing.

[23]  K. Tóth,et al.  Afferent-specific innervation of two distinct AMPA receptor subtypes on single hippocampal interneurons , 1998, Nature Neuroscience.

[24]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[25]  Alexandre Pouget,et al.  Basis Functions for Object-Centered Representations , 2003, Neuron.

[26]  A Hein.  Prerequisite for development of visually guided reaching in the kitten. , 1974, Brain research.

[27]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[28]  W. Kristan,et al.  A neuronal network for computing population vectors in the leech , 1998, Nature.

[29]  R Held,et al.  Development of sensorially-guided reaching in infant monkeys. , 1974, Brain research.

[30]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[31]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[32]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[33]  L F Abbott,et al.  Transfer of coded information from sensory to motor networks , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  A. Pouget,et al.  Reference frames for representing visual and tactile locations in parietal cortex , 2005, Nature Neuroscience.

[35]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[36]  Paul B. Johnson,et al.  Visuomotor transformations underlying arm movements toward visual targets: a neural network model of cerebral cortical operations , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[38]  AL van der Meer,et al.  The functional significance of arm movements in neonates , 1995, Science.

[39]  Wolfgang Maass,et al.  Movement Generation with Circuits of Spiking Neurons , 2005, Neural Computation.

[40]  R. Nicoll,et al.  Contrasting properties of two forms of long-term potentiation in the hippocampus , 1995, Nature.

[41]  Nicholas T. Carnevale,et al.  Discrete event simulation in the NEURON environment , 2004, Neurocomputing.

[42]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.