Running Head : Decoding Temporal Dynamics of Category Information Decoding Dynamic Category Information Contact Information :

Most electrophysiology studies analyze the activity of each neuron separately. While such studies have given much insight into properties of the visual system, they have also potentially overlooked important aspects of information coded in changing patterns of activity that are distributed over larger populations of neurons. In this work, we apply a population decoding method, to better estimate what information is available in neuronal ensembles, and how this information is coded in dynamic patterns of neural activity in data recorded from inferior temporal cortex (ITC) and prefrontal cortex (PFC) as macaque monkeys engaged in a delayed match-to-category task (Freedman et al. 2003). Analyses of activity patterns in ITC and PFC revealed that both areas contain ‘abstract’ category information (i.e., category information that is not directly correlated with properties of the stimuli); however, in general, PFC has more task-relevant information, and ITC has more detailed visual information. Analyses examining how information coded in these areas show that almost all category information is available in a small fraction of the neurons in the population. Most remarkably, our results also show that category information is coded by a non-stationary pattern of activity that changes over the course of a trial, with individual neurons containing information on much shorter time scales than the population as a whole.

[1]  Jonathon Shlens,et al.  Estimating Information Rates with Confidence Intervals in Neural Spike Trains , 2007, Neural Computation.

[2]  J. Tanji,et al.  Categorization of behavioural sequences in the prefrontal cortex , 2007, Nature.

[3]  Danko Nikolic,et al.  Temporal dynamics of information content carried by neurons in the primary visual cortex , 2006, NIPS.

[4]  T. Pasternak,et al.  Directional Signals in the Prefrontal Cortex and in Area MT during a Working Memory for Visual Motion Task , 2006, The Journal of Neuroscience.

[5]  Britt Anderson,et al.  Joint decoding of visual stimuli by IT neurons’ spike counts is not improved by simultaneous recording , 2006, Experimental Brain Research.

[6]  Daeyeol Lee,et al.  Effects of noise correlations on information encoding and decoding. , 2006, Journal of neurophysiology.

[7]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[8]  R. Andersen,et al.  Movement Intention Is Better Predicted than Attention in the Posterior Parietal Cortex , 2006, The Journal of Neuroscience.

[9]  Thomas Serre,et al.  A Theory of Object Recognition: Computations and Circuits in the Feedforward Path of the Ventral Stream in Primate Visual Cortex , 2005 .

[10]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[11]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[12]  E. Rolls,et al.  Object perception in natural scenes: encoding by inferior temporal cortex simultaneously recorded neurons. , 2005, Journal of neurophysiology.

[13]  Leslie G. Ungerleider,et al.  Projections from inferior temporal cortex to prefrontal cortex via the uncinate fascicle in rhesus monkeys , 2004, Experimental Brain Research.

[14]  M. Jung,et al.  Dynamics of Population Code for Working Memory in the Prefrontal Cortex , 2003, Neuron.

[15]  David J. Freedman,et al.  A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization , 2003, The Journal of Neuroscience.

[16]  Stefano Panzeri,et al.  Coding of Sensory Signals by Neuronal Populations: The Role of Correlated Activity , 2003, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[17]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[18]  Gilles Laurent,et al.  Olfactory network dynamics and the coding of multidimensional signals , 2002, Nature Reviews Neuroscience.

[19]  David J. Freedman,et al.  Representation of the Quantity of Visual Items in the Primate Prefrontal Cortex , 2002, Science.

[20]  Glenn C. Turner,et al.  Oscillations and Sparsening of Odor Representations in the Mushroom Body , 2002, Science.

[21]  E. Miller,et al.  Timecourse of object‐related neural activity in the primate prefrontal cortex during a short‐term memory task , 2002, The European journal of neuroscience.

[22]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[23]  Inés Samengo,et al.  Information Loss in an Optimal Maximum Likelihood Decoding , 2001, Neural Computation.

[24]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[25]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[26]  J. Mcilwain.  Population coding: a historical sketch. , 2001, Progress in Brain Research.

[27]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[28]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[29]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[30]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[31]  A. Zador,et al.  Neural representation and the cortical code. , 2000, Annual review of neuroscience.

[32]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[33]  G B Stanley,et al.  Reconstruction of Natural Scenes from Ensemble Responses in the Lateral Geniculate Nucleus , 1999, The Journal of Neuroscience.

[34]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[35]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[36]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[37]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[38]  C. Gross,et al.  Neural ensemble coding in inferior temporal cortex. , 1994, Journal of neurophysiology.

[39]  G. Kane.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[40]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[41]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.