The Costs of Ignoring High-Order Correlations in Populations of Model Neurons

Investigators debate the extent to which neural populations use pairwise and higher-order statistical dependencies among neural responses to represent information about a visual stimulus. To study this issue, three statistical decoders were used to extract the information in the responses of model neurons about the binocular disparities present in simulated pairs of left-eye and right-eye images: (1) the full joint probability decoder considered all possible statistical relations among neural responses as potentially important; (2) the dependence tree decoder also considered all possible relations as potentially important, but it approximated high-order statistical correlations using a computationally tractable procedure; and (3) the independent response decoder, which assumed that neural responses are statistically independent, meaning that all correlations should be zero and thus can be ignored. Simulation results indicate that high-order correlations among model neuron responses contain significant information about binocular disparities and that the amount of this high-order information increases rapidly as a function of neural population size. Furthermore, the results highlight the potential importance of the dependence tree decoder to neuroscientists as a powerful but still practical way of approximating high-order correlations among neural responses.

[1]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[2]  R. Perez,et al.  Retinal correspondence of monocular receptive fields in disparity-sensitive complex cells from area V1 in the awake monkey. , 2005, Investigative ophthalmology & visual science.

[3]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[4]  Daeyeol Lee,et al.  Coding and transmission of information by neural ensembles , 2004, Trends in Neurosciences.

[5]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[6]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[7]  B. Cumming,et al.  Testing quantitative models of binocular disparity selectivity in primary visual cortex. , 2003, Journal of neurophysiology.

[8]  Daeyeol Lee,et al.  Neural Noise and Movement-Related Codes in the Macaque Supplementary Motor Area , 2003, The Journal of Neuroscience.

[9]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[10]  M. Young,et al.  Correlations, feature‐binding and population coding in primary visual cortex , 2003, Neuroreport.

[11]  Steven Reece,et al.  An information theoretic approach to the contributions of the firing rates and the correlations between the firing of neurons. , 2003, Journal of neurophysiology.

[12]  Jonathan D. Victor,et al.  Reading a population code: a multi-scale neural model for representing binocular disparity , 2003, Vision Research.

[13]  Hermann Wagner,et al.  Visual depth encoding in populations of neurons with localized receptive fields , 2002, Biological Cybernetics.

[14]  Stefano Panzeri,et al.  The role of correlated firing and synchrony in coding information about single and separate objects in cat V1 , 2002, Neurocomputing.

[15]  A. Parker,et al.  Quantitative analysis of the responses of V1 neurons to horizontal disparity in dynamic random-dot stereograms. , 2002, Journal of neurophysiology.

[16]  A. Parker,et al.  Stereoacuity thresholds in the presence of a reference surface , 2001, Vision Research.

[17]  P. Latham,et al.  Retinal ganglion cells act largely as independent encoders , 2001, Nature.

[18]  Michael I. Jordan,et al.  Learning with Mixtures of Trees , 2001, J. Mach. Learn. Res..

[19]  William Bialek,et al.  Synergy in a Neural Code , 2000, Neural Computation.

[20]  E T Rolls,et al.  Correlations and the encoding of information in the nervous system , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[21]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[22]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[23]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[24]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[25]  I. Ohzawa,et al.  Neural mechanisms underlying binocular fusion and stereopsis: position vs. phase. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[26]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[27]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[28]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[29]  Ning Qian,et al.  Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[30]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[31]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[32]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[33]  I. Ohzawa,et al.  On the neurophysiological organization of binocular vision , 1990, Vision Research.

[34]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[35]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[36]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.

[37]  C. N. Liu,et al.  Approximating discrete probability distributions with dependence trees , 1968, IEEE Trans. Inf. Theory.