Predictive coding: a fresh view of inhibition in the retina

Interneurons exhibiting centre-surround antagonism within their receptive fields are commonly found in peripheral visual pathways. We propose that this organization enables the visual system to encode spatial detail in a manner that minimizes the deleterious effects of intrinsic noise, by exploiting the spatial correlation that exists within natural scenes. The antagonistic surround takes a weighted mean of the signals in neighbouring receptors to generate a statistical prediction of the signal at the centre. The predicted value is subtracted from the actual centre signal, thus minimizing the range of outputs transmitted by the centre. In this way the entire dynamic range of the interneuron can be devoted to encoding a small range of intensities, thus rendering fine detail detectable against intrinsic noise injected at later stages in processing. This predictive encoding scheme also reduces spatial redundancy, thereby enabling the array of interneurons to transmit a larger number of distinguishable images, taking into account the expected structure of the visual world. The profile of the required inhibitory field is derived from statistical estimation theory. This profile depends strongly upon the signal: noise ratio and weakly upon the extent of lateral spatial correlation. The receptive fields that are quantitatively predicted by the theory resemble those of X-type retinal ganglion cells and show that the inhibitory surround should become weaker and more diffuse at low intensities. The latter property is unequivocally demonstrated in the first-order interneurons of the fly’s compound eye. The theory is extended to the time domain to account for the phasic responses of fly interneurons. These comparisons suggest that, in the early stages of processing, the visual system is concerned primarily with coding the visual image to protect against subsequent intrinsic noise, rather than with reconstructing the scene or extracting specific features from it. The treatment emphasizes that a neuron’s dynamic range should be matched to both its receptive field and the statistical properties of the visual pattern expected within this field. Finally, the analysis is synthetic because it is an extension of the background suppression hypothesis (Barlow & Levick 1976), satisfies the redundancy reduction hypothesis (Barlow 1961 a, b) and is equivalent to deblurring under certain conditions (Ratliff 1965).

[1]  C. Harrison Experiments with linear prediction in television , 1952 .

[2]  E. Kretzmer Statistics of television signals , 1952 .

[3]  B. M. Oliver Efficient coding , 1952 .

[4]  S. W. Kuffler Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[5]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[6]  D. Mackay,et al.  Towards an information-flow model of human behaviour. , 1956, British journal of psychology.

[7]  H. Barlow,et al.  Change of organization in the receptive fields of the cat's retina during dark adaptation , 1957, The Journal of physiology.

[8]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[9]  D. H. Kelly Visual response to time-dependent stimuli. I. Amplitude sensitivity measurements. , 1961, Journal of the Optical Society of America.

[10]  D. Jameson,et al.  Mach bands : quantitative studies on neural networks in the retina , 1966 .

[11]  R. Purple,et al.  Interaction of excitation and inhibition in the eccentric cell in the eye of Limulus. , 1965, Cold Spring Harbor symposia on quantitative biology.

[12]  R. W. Rodieck,et al.  Response of cat retinal ganglion cells to moving visual patterns. , 1965, Journal of neurophysiology.

[13]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[14]  J. Robson Spatial and Temporal Contrast-Sensitivity Functions of the Visual System , 1966 .

[15]  C. Enroth-Cugell,et al.  The contrast sensitivity of retinal ganglion cells of the cat , 1966, The Journal of physiology.

[16]  F. Campbell,et al.  Optical quality of the human eye , 1966, The Journal of physiology.

[17]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[18]  F. Werblin Adaptation in a vertebrate retina: intracellular recording in Necturus. , 1971, Journal of neurophysiology.

[19]  A. Lieberman,et al.  Presynaptic dendrites and a distinctive class of synaptic vesicle in the rat dorsal lateral geniculate nucleus. , 1972, Brain research.

[20]  H. K. Hartline,et al.  Inhibitory Interaction in the Retina of Limulus , 1972 .

[21]  C. Enroth-Cugell,et al.  Adaptation and dynamics of cat retinal ganglion cells , 1973, The Journal of physiology.

[22]  R. L. de Valois,et al.  Psychophysical studies of monkey vision. 3. Spatial luminance contrast sensitivity tests of macaque and human observers. , 1974, Vision research.

[23]  F. Werblin Control of Retinal Sensitivity II. Lateral Interactions at the Outer Plexiform Layer , 1974 .

[24]  F. Werblin Control of Retinal Sensitivity II . Lateral Interactions at the Outer Plexiform Layer , 2022 .

[25]  Gary D. Bernard,et al.  The effect of motion on visual acuity of the compound eye: A theoretical analysis , 1975, Vision Research.

[26]  J. T. Leutscher-Hazelhoff,et al.  Linear and non‐linear performance of transducer and pupil in Calliphora retinula cells. , 1975, The Journal of physiology.

[27]  M. Georgeson,et al.  Contrast constancy: deblurring in human vision by spatial frequency channels. , 1975, The Journal of physiology.

[28]  H B Barlow,et al.  Threshold setting by the surround of cat retinal ganglion cells. , 1976, The Journal of physiology.

[29]  Azriel Rosenfeld,et al.  Digital picture analysis , 1976 .

[30]  Azriel Rosenfeld,et al.  Digital Picture Processing , 1976 .

[31]  A. Hughes The Topography of Vision in Mammals of Contrasting Life Style: Comparative Optics and Retinal Organisation , 1977 .

[32]  F. Ratliff,et al.  The spatiotemporal transfer function of the Limulus lateral eye , 1978, The Journal of general physiology.

[33]  William H. Miller,et al.  Ocular Optical Filtering , 1979 .

[34]  A. Snyder Physics of Vision in Compound Eyes , 1979 .

[35]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[36]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[37]  R. Wehner Spatial Vision in Arthropods , 1981 .

[38]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[39]  H B Barlow,et al.  The Ferrier lecture, 1980 , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[40]  S B Laughlin,et al.  Single photon signals in fly photoreceptors and first order interneurones at behavioral threshold. , 1981, The Journal of physiology.

[41]  S. Laughlin Neural Principles in the Peripheral Visual Systems of Invertebrates , 1981 .