Information Loss Associated with Imperfect Observation and Mismatched Decoding

We consider two types of causes leading to information loss when neural activities are passed and processed in the brain. One is responses of upstream neurons to stimuli being imperfectly observed by downstream neurons. The other is upstream neurons non-optimally decoding stimuli information contained in the activities of the downstream neurons. To investigate the importance of neural correlation in information processing in the brain, we specifically consider two situations. One is when neural responses are not simultaneously observed, i.e., neural correlation data is lost. This situation means that stimuli information is decoded without any specific assumption about neural correlations. The other is when stimuli information is decoded by a wrong statistical model where neural responses are assumed to be independent even when they are not. We provide the information geometric interpretation of these two types of information loss and clarify their relationship. We then concretely evaluate these types of information loss in some simple examples. Finally, we discuss use of these evaluations of information loss to elucidate the importance of correlation in neural information processing.

[1]  M. Abeles.  Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[2]  S. Amari.  Differential Geometry of Curved Exponential Families-Curvatures and Information Loss , 1982 .

[3]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[4]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  Shlomo Shamai,et al.  On information rates for mismatched decoders , 1994, IEEE Trans. Inf. Theory.

[6]  N. Merhav,et al.  On Information Rates for Mismatched , 1994 .

[7]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[8]  D. Baylor,et al.  Concerted Signaling by Retinal Ganglion Cells , 1995, Science.

[9]  Shun-ichi Amari,et al.  Information geometry of the EM and em algorithms for neural networks , 1995, Neural Networks.

[10]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[11]  Nicolas Brunel,et al.  Mutual Information, Fisher Information, and Population Coding , 1998, Neural Computation.

[12]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.

[13]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[14]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[15]  P. Latham,et al.  Retinal ganglion cells act largely as independent encoders , 2001, Nature.

[16]  Shun-ichi Amari,et al.  Information geometry on hierarchy of probability distributions , 2001, IEEE Trans. Inf. Theory.

[17]  Shun-ichi Amari,et al.  Information-Geometric Measure for Neural Spikes , 2002, Neural Computation.

[18]  Yutaka Sakai,et al.  Synchronous Firing and Higher-Order Interactions in Neuron Pool , 2003, Neural Computation.

[19]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[20]  M. Young,et al.  Correlations, feature‐binding and population coding in primary visual cortex , 2003, Neuroreport.

[21]  P. Latham,et al.  Synergy, Redundancy, and Independence in Population Codes, Revisited , 2005, The Journal of Neuroscience.

[22]  M. Tachibana,et al.  Synchronized retinal oscillations encode essential information for escape behavior in frogs , 2005, Nature Neuroscience.

[23]  Daeyeol Lee,et al.  Effects of noise correlations on information encoding and decoding. , 2006, Journal of neurophysiology.

[24]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[25]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[26]  Shun-ichi Amari,et al.  Correlation and Independence in the Neural Code , 2006, Neural Computation.

[27]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[28]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[29]  Stefano Panzeri,et al.  The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[30]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.

[31]  Kazuya Ishibashi,et al.  Mismatched Decoding in the Brain , 2010, The Journal of Neuroscience.

[32]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[33]  Ron Meir,et al.  Error-Based Analysis of Optimal Tuning Functions Explains Phenomena Observed in Sensory Neurons , 2010, Front. Comput. Neurosci..