Change-Based Inference in Attractor Nets: Linear Analysis

One standard interpretation of networks of cortical neurons is that they form dynamical attractors. Computations such as stimulus estimation are performed by mapping inputs to points on the networks' attractive manifolds. These points represent population codes for the stimulus values. However, this standard interpretation is hard to reconcile with the observation that the firing rates of such neurons constantly change following presentation of stimuli. We have recently suggested an alternative interpretation according to which computations are realized by systematic changes in the states of such networks over time. This way of performing computations is fast, accurate, readily learnable, and robust to various forms of noise. Here we analyze the computation of stimulus discrimination in this change-based setting, relating it directly to the computation of stimulus estimation in the conventional attractor-based view. We use a common linear approximation to compare the two methods and show that perfect performance at estimation implies chance performance at discrimination.

[1]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[2]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[3]  Kevan A. C. Martin,et al.  A Canonical Microcircuit for Neocortex , 1989, Neural Computation.

[4]  M. Fahle.  Human Pattern Recognition: Parallel Processing and Perceptual Learning , 1994, Perception.

[5]  M. Carandini,et al.  Summation and division by neurons in primate visual cortex. , 1994, Science.

[6]  T. Poggio,et al.  Fast perceptual learning in hyperacuity , 1995, Vision Research.

[7]  Eero P. Simoncelli,et al.  Computational models of cortical visual processing. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[8]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Xiao-Jing Wang,et al.  Modeling delay-period activity in the prefontal cortex during working memory tasks , 1997 .

[11]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[12]  Peter E. Latham,et al.  Statistically Efficient Estimation Using Population Coding , 1998, Neural Computation.

[13]  B. Dosher,et al.  Mechanisms of perceptual learning , 1999, Vision Research.

[14]  B. Dosher,et al.  Mechanisms of perceptual learning , 1999, Vision Research.

[15]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[16]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[17]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[18]  Peter Dayan,et al.  Position Variance, Recurrence and Perceptual Learning , 2000, NIPS.

[19]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[20]  Xiao-Jing Wang.  Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[21]  Pamela Reinagel.  How do visual neurons respond in the real world? , 2001, Current Opinion in Neurobiology.

[22]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[23]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[24]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[25]  R. Romo,et al.  Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. , 2003, Cerebral cortex.

[26]  Ronald,et al.  Learning representations by backpropagating errors , 2004 .

[27]  G. Laurent,et al.  Transient Dynamics versus Fixed Points in Odor Representations by Locust Antennal Lobe Projection Neurons , 2005, Neuron.

[28]  Si Wu,et al.  Computing with Continuous Attractors: Stability and Online Aspects , 2005, Neural Computation.

[29]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[30]  Steven C Dakin,et al.  Dynamic properties of orientation discrimination assessed by using classification images. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[31]  KongFatt Wong-Lin,et al.  Neural Circuit Dynamics Underlying Accumulation of Time-Varying Evidence During Perceptual Decision Making , 2007, Frontiers Comput. Neurosci..

[32]  K. Miller,et al.  One-Dimensional Dynamics of Attention and Decision Making in LIP , 2008, Neuron.

[33]  Anthony M. Zador,et al.  Millisecond-scale differences in neural activity in auditory cortex can drive decisions , 2008 .

[34]  P. Dayan,et al.  Change-based inference for invariant discrimination , 2008, Network.

[35]  P. Dayan,et al.  Change-Based Inference in Attractor Nets: Linear Analysis , 2010, Neural Computation.

[36]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.