Predictability and redundancy of natural images.

One aspect of human image understanding is the ability to estimate missing parts of a natural image. This ability depends on the redundancy of the representation used to describe the class of images. In 1951, Shannon [Bell. Syst. Tech. J. 30, 50 (1951)] showed how to estimate bounds on the entropy and redundancy of an information source from predictability data. The entropy, in turn, gives a measure of the limits to error-free information compaction. An experiment was devised in which human observers interactively restored missing gray levels from 128 X 128 pixel pictures with 16 gray levels. For eight images, the redundancy ranged from 46%, for a complicated picture of foliage, to 74%, for a picture of a face. For almost-complete pictures, but not for noisy pictures, this performance can be matched by a nearest-neighbor predictor.

[1]  Claude E. Shannon,et al.  Prediction and Entropy of Printed English , 1951 .

[2]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[3]  William F. Schreiber,et al.  The measurement of third order probability distributions of television signals , 1956, IRE Trans. Inf. Theory.

[4]  J R Parks Prediction and entropy of half-tone pictures. , 1965, Behavioral science.

[5]  Nicolaos S. Tzannes,et al.  On Estimating the Entropy of Random Fields , 1970, Inf. Control..

[6]  D. E. Barton,et al.  Introduction to Mathematical Techniques in Pattern Recognition , 1973 .

[7]  Earl E. Swartzlander,et al.  Introduction to Mathematical Techniques in Pattern Recognition , 1973 .

[8]  B. Mandelbrot,et al.  Fractals: Form, Chance and Dimension , 1978 .

[9]  Thomas M. Cover,et al.  A convergent gambling estimate of the entropy of English , 1978, IEEE Trans. Inf. Theory.

[10]  A.N. Netravali,et al.  Picture coding: A review , 1980, Proceedings of the IEEE.

[11]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[12]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  W A Richards,et al.  Lightness scale from image intensity distributions. , 1981, Applied optics.

[14]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  W S Geisler,et al.  Sampling-theory analysis of spatial vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[16]  L Sirovich,et al.  Low-dimensional Procedure for the Characterization of Human Faces , 1986 .

[17]  A B Watson,et al.  Efficiency of a model human image code. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[18]  Garrison W. Cottrell,et al.  Image compression by back-propagation: An example of extensional programming , 1988 .

[19]  Eric Saund,et al.  Dimensionality-Reduction Using Connectionist Networks , 1989, IEEE Trans. Pattern Anal. Mach. Intell..