A Theory of the Visual Motion Coding in the Primary Visual Cortex

This paper demonstrates that much of visual motion coding in the primary visual cortex can be understood from a theory of efficient motion coding in a multiscale representation. The theory predicts that cortical cells can have a spectrum of directional indices, be tuned to different directions of motion, and have spatiotemporally separable or inseparable receptive fields (RF). The predictions also include the following correlations between motion coding and spatial, chromatic, and stereo codings: the preferred speed is greater when the cell receptive field size is larger, the color channel prefers lower speed than the luminance channel, and both the optimal speeds and the preferred directions of motion can be different for inputs from different eyes to the same neuron. These predictions agree with experimental observations. In addition, this theory makes predictions that have not been experimentally investigated systematically and provides a testing ground for an efficient multiscale coding framework. These predictions are as follows: (1) if nearby cortical cells of a given preferred orientation and scale prefer opposite directions of motion and have a quadrature RF phase relationship with each other, then they will have the same directional index, (2) a single neuron can have different optimal motion speeds for opposite motion directions of monocular stimuli, and (3) a neuron's ocular dominance may change with motion direction if the neuron prefers opposite directions for inputs from different eyes.

[1]  Zhaoping Li.  Understanding Ocular Dominance Development from Binocular Input Statistics , 1995 .

[2]  R. Shapley,et al.  Directional selectivity and spatiotemporal structure of receptive fields of simple cells in cat striate cortex. , 1991, Journal of neurophysiology.

[3]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[4]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[5]  R D Freeman,et al.  Neuronal Mechanisms Underlying Stereopsis: How Do Simple Cells in the Visual Cortex Encode Binocular Disparity? , 1995, Perception.

[6]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[7]  Zhaoping Li,et al.  Efficient stereo coding in the multiscale representation , 1994 .

[8]  D. Heeger.  Modeling simple-cell direction selectivity with normalized, half-squared, linear operators. , 1993, Journal of neurophysiology.

[9]  R. Sekuler,et al.  The independence of channels in human vision selective for direction of movement. , 1975, The Journal of physiology.

[10]  B R Payne,et al.  Organization of orientation and direction selectivity in areas 17 and 18 of cat cerebral cortex. , 1987, Journal of neurophysiology.

[11]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[12]  R. Douglas,et al.  Exploring cortical microcircuits: a combined anatomical, physiological, and computational approach , 1992 .

[13]  T. Albright,et al.  What happens if it changes color when it moves?: Psychophysical experiments on the nature of chromatic input to motion detectors , 1993, Vision Research.

[14]  S. Laughlin.  A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[15]  J. Cronly-Dillon,et al.  Vision and visual dysfunction. , 1994, Journal of cognitive neuroscience.

[16]  D. Regan,et al.  Evidence for the existence of neural mechanisms selectively sensitive to the direction of movement in space , 1973, The Journal of physiology.

[17]  O E Favreau,et al.  Perceived velocity of moving chromatic gratings. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[18]  P. O. Bishop,et al.  Receptive fields of simple cells in the cat striate cortex , 1973, The Journal of physiology.

[19]  Brian J. Murphy,et al.  Summation and discrimination of gratings moving in opposite directions , 1980, Vision Research.

[20]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  T. Poggio,et al.  A synaptic mechanism possibly underlying directional selectivity to motion , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[22]  Zhaoping Li,et al.  Understanding Retinal Color Coding from First Principles , 1992, Neural Computation.

[23]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[24]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[25]  Zhaoping Li,et al.  Towards a theory of striate cortex , 1994 .

[26]  Zhaoping Li,et al.  Toward a Theory of the Striate Cortex , 1994, Neural Computation.

[27]  D. H. Kelly.  Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[28]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[29]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[30]  W. Bialek,et al.  Optimal Sampling of Natural Images: A Design Principle for the Visual System , 1990, NIPS 1990.

[31]  D. Hubel,et al.  Uniformity of monkey striate cortex: A parallel relationship between field size, scatter, and magnification factor , 1974, The Journal of comparative neurology.

[32]  Ralph Linsker,et al.  An Application of the Principle of Maximum Information Preservation to Linear Systems , 1988, NIPS.

[33]  L. Maffei,et al.  Correlation between the preferred orientation and spatial frequency of neurones in visual areas 17 and 18 of the cat. , 1982, The Journal of physiology.

[34]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[35]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[36]  E. Fleischer.  [Physiological basis of stereoscopic vision]. , 1951, Ophthalmologica. Journal international d'ophtalmologie. International journal of ophthalmology. Zeitschrift fur Augenheilkunde.

[37]  R. Holub,et al.  Response of Visual Cortical Neurons of the cat to moving sinusoidal gratings: response-contrast functions and spatiotemporal interactions. , 1981, Journal of neurophysiology.

[38]  A. Yuille,et al.  A model for the estimate of local image velocity by cells in the visual cortex , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[39]  H. Barlow.  Critical limiting factors in the design of the eye and visual cortex , 1981 .

[40]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[41]  Ernst Fleischer,et al.  Die physiologischen Grundlagen des Tiefensehens , 1951 .

[42]  D. Pollen,et al.  Spatial and temporal frequency selectivity of neurones in visual cortical areas V1 and V2 of the macaque monkey. , 1985, The Journal of physiology.

[43]  T D Albright,et al.  What happens if it changes color when it moves?: the nature of chromatic input to macaque visual area MT , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[45]  D. Ferster,et al.  Linearity of summation of synaptic potentials underlying direction selectivity in simple cells of the cat visual cortex. , 1993, Science.

[46]  Néstor Parga,et al.  Information processing by a perceptron in an unsupervised learning task , 1993 .

[47]  D. G. Albrecht,et al.  Visual cortical receptive fields in monkey and cat: Spatial and temporal phase transfer function , 1989, Vision Research.