Dynamics and Computation of Continuous Attractors

Continuous attractor is a promising model for describing the encoding of continuous stimuli in neural systems. In a continuous attractor, the stationary states of the neural system form a continuous parameter space, on which the system is neutrally stable. This property enables the neutral system to track time-varying stimuli smoothly, but it also degrades the accuracy of information retrieval, since these stationary states are easily disturbed by external noise. In this work, based on a simple model, we systematically investigate the dynamics and the computational properties of continuous attractors. In order to analyze the dynamics of a large-size network, which is otherwise extremely complicated, we develop a strategy to reduce its dimensionality by utilizing the fact that a continuous attractor can eliminate the noise components perpendicular to the attractor space very quickly. We therefore project the network dynamics onto the tangent of the attractor space and simplify it successfully as a one-dimensional Ornstein-Uhlenbeck process. Based on this simplified model, we investigate (1) the decoding error of a continuous attractor under the driving of external noisy inputs, (2) the tracking speed of a continuous attractor when external stimulus experiences abrupt changes, (3) the neural correlation structure associated with the specific dynamics of a continuous attractor, and (4) the consequence of asymmetric neural correlation on statistical population decoding. The potential implications of these results on our understanding of neural information processing are also discussed.

[1]  Si Wu,et al.  Computing with Continuous Attractors: Stability and Online Aspects , 2005, Neural Computation.

[2]  Si Wu,et al.  Dynamics of neural networks with continuous attractors , 2008 .

[3]  Zhang Yi,et al.  Representations of Continuous Attractors of Recurrent Neural Networks , 2009, IEEE Transactions on Neural Networks.

[4]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[5]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[6]  E. Rolls,et al.  Self-organizing continuous attractor networks and path integration: one-dimensional models of head direction cells , 2002, Network.

[7]  Si Wu,et al.  Information processing in a neuron ensemble with the multiplicative correlation structure , 2004, Neural Networks.

[8]  E. Rolls,et al.  Self-organizing continuous attractor networks and path integration: one-dimensional models of head direction cells. , 2002 .

[9]  J. Taube.  Head direction cells and the neurophysiological basis for a sense of direction , 1998, Progress in Neurobiology.

[10]  Ali A. Minai,et al.  2009 Special Issue: Neural dynamics of idea generation and the effects of priming , 2009 .

[11]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[12]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[13]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[14]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[16]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[17]  Shun-ichi Amari,et al.  Correlation and Independence in the Neural Code , 2006, Neural Computation.

[18]  Stephen Coombes,et al.  Large-scale neural dynamics: Simple and complex , 2010, NeuroImage.

[19]  M. A. Smith,et al.  The Role of Correlations in Direction and Contrast Coding in the Primary Visual Cortex , 2007, The Journal of Neuroscience.

[20]  S. Amari.  Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[21]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[22]  Paul Miller,et al.  Analysis of Spike Statistics in Neuronal Systems with Continuous Attractors or Multiple, Discrete Attractor States , 2006, Neural Computation.

[23]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[24]  B. Ermentrout.  Neural networks as spatio-temporal pattern-forming systems , 1998 .

[25]  Ranulfo Romo,et al.  Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations , 2003, Current Opinion in Neurobiology.

[26]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[27]  H. Sompolinsky,et al.  13 Modeling Feature Selectivity in Local Cortical Circuits , 2022 .

[28]  Paul C. Bressloff,et al.  Spatially structured oscillations in a two-dimensional excitatory neuronal network with synaptic depression , 2009, Journal of Computational Neuroscience.

[29]  J. Hopfield.  Neurons withgraded response havecollective computational properties likethoseoftwo-state neurons , 1984 .

[30]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[31]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[32]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Thomas P. Trappenberg,et al.  Continuous Attractor Neural Networks , 2005 .

[34]  A Koriat,et al.  Establishing global and local correspondence between successive stimuli: the holistic nature of backward alignment. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[35]  Si Wu,et al.  A Moving Bump in a Continuous Manifold: A Comprehensive Study of the Tracking Dynamics of Continuous Attractor Neural Networks , 2008, Neural Computation.

[36]  E. Schwartz.  Methods in Neuronal Modelling. From Synapses to Networks edited by Christof Koch and Idan Segev, MIT Press, 1989. £40.50 (xii + 524 pages) ISBN 0 262 11133 0 , 1990, Trends in Neurosciences.

[37]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[38]  D. Metzler,et al.  Mental rotation: effects of dimensionality of objects and type of task. , 1988, Journal of Experimental Psychology: Human Perception and Performance.

[39]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Zhang Yi,et al.  Representations of continuous attractors of discrete-time Cellular Neural Networks , 2008, 2008 IEEE Conference on Cybernetics and Intelligent Systems.

[41]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[42]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[44]  Xiao-Jing Wang.  Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[45]  David Pinto,et al.  Mathematical neuroscience: from neurons to circuits to systems , 2003, Journal of Physiology-Paris.

[46]  Stephen Coombes,et al.  Existence and Wandering of Bumps in a Spiking Neural Network Model , 2006, SIAM J. Appl. Dyn. Syst..

[47]  W Gerstner,et al.  Effect of lateral connections on the accuracy of the population code for a network of spiking neurons. , 2001, Network.