Efficient stereo coding in the multiscale representation

Stereo images are highly redundant; the left and right frames of typical scenes are very similar. We explore the consequences of the hypothesis that cortical cells—in addition to their multiscale coding strategies—are concerned with reducing binocular redundancy due to correlations between the two eyes. We derive the most efficient coding strategies that achieve binocular decorrelation. It is shown that multiscale coding combined with a binocular decorrelation strategy leads to a rich diversity of cell types. In particular, the theory predicts monocular/binocular cells as well as a family of disparity selective cells, among which one can identify cells that are tuned-zero-excitatory, near, far, and tuned inhibitory. The theory also predicts correlations between ocular dominance, cell size, orientation, and disparity selectivities. Consequences on cortical ocular dominance column formation from abnormal developmental conditions such as strabismus and monocular eye closure are also predicted. These findings...

[1]  Ernst Fleischer,et al.  Die physiologischen Grundlagen des Tiefensehens , 1951 .

[2]  D. Hubel,et al.  Binocular interaction in striate cortex of kittens reared with artificial squint. , 1965, Journal of neurophysiology.

[3]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[4]  D. Hubel,et al.  Stereoscopic Vision in Macaque Monkey: Cells sensitive to Binocular Depth in Area 18 of the Macaque Monkey Cortex , 1970, Nature.

[5]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[6]  D. Hubel,et al.  Plasticity of ocular dominance columns in monkey striate cortex. , 1977, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[7]  M. Stryker,et al.  Ocular dominance in layer IV of the cat's visual cortex and the effects of monocular deprivation. , 1978, The Journal of physiology.

[8]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[9]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  D. Pollen,et al.  Relationship between spatial frequency selectivity and receptive field profile of simple cells. , 1979, The Journal of physiology.

[11]  R. C. Van Sluyters,et al.  Experimental strabismus in the kitten. , 1980, Journal of neurophysiology.

[12]  D. Hubel,et al.  Regular patchy distribution of cytochrome oxidase staining in primary visual cortex of macaque monkey , 1981, Nature.

[13]  D. Ferster.  A comparison of binocular depth mechanisms in areas 17 and 18 of the cat visual cortex , 1981, The Journal of physiology.

[14]  R. L. Valois,et al.  The orientation and direction selectivity of cells in macaque visual cortex , 1982, Vision Research.

[15]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[16]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  I. Ohzawa,et al.  The binocular organization of simple cells in the cat's visual cortex. , 1986, Journal of neurophysiology.

[18]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[19]  E. Switkes,et al.  Functional anatomy of macaque striate cortex. I. Ocular dominance, binocular interactions, and baseline conditions , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  S. Levay,et al.  Ocular dominance and disparity coding in cat visual cortex , 1988, Visual Neuroscience.

[21]  D. Ts'o,et al.  The organization of chromatic and spatial interactions in the primate striate cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  K. Miller,et al.  Ocular dominance column development: analysis and simulation. , 1989, Science.

[23]  M. Silverman,et al.  Spatial-frequency organization in primate striate cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[25]  I. Ohzawa,et al.  On the neurophysiological organization of binocular vision , 1990, Vision Research.

[26]  H. Wilson,et al.  Neural models of stereoscopic vision , 1991, Trends in Neurosciences.

[27]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[28]  Zhaoping Li,et al.  Understanding Retinal Color Coding from First Principles , 1992, Neural Computation.

[29]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[30]  P. Dayan,et al.  A correlational model for the development of disparity selectivity in visual cortex that depends on prenatal and postnatal phases. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Zhaoping Li,et al.  What does post-adaptation color appearance reveal about cortical color representation? , 1993, Vision Research.

[32]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[33]  Zhaoping Li,et al.  Toward a Theory of the Striate Cortex , 1994, Neural Computation.

[34]  Zhaoping Li.  Understanding Ocular Dominance Development from Binocular Input Statistics , 1995 .