Image statistics and the perception of surface qualities

The world is full of surfaces, and by looking at them we can judge their material qualities. Properties such as colour or glossiness can help us decide whether a pancake is cooked, or a patch of pavement is icy. Most studies of surface appearance have emphasized textureless matte surfaces, but real-world surfaces, which may have gloss and complex mesostructure, are now receiving increased attention. Their appearance results from a complex interplay of illumination, reflectance and surface geometry, which are difficult to tease apart given an image. If there were simple image statistics that were diagnostic of surface properties it would be sensible to use them. Here we show that the skewness of the luminance histogram and the skewness of sub-band filter outputs are correlated with surface gloss and inversely correlated with surface albedo (diffuse reflectance). We find evidence that human observers use skewness, or a similar measure of histogram asymmetry, in making judgements about surfaces. When the image of a surface has positively skewed statistics, it tends to appear darker and glossier than a similar surface with lower skewness, and this is true whether the skewness is inherent to the original image or is introduced by digital manipulation. We also find a visual after-effect based on skewness: adaptation to patterns with skewed statistics can alter the apparent lightness and glossiness of surfaces that are subsequently viewed. We suggest that there are neural mechanisms sensitive to skewed statistics, and that their outputs can be used in estimating surface properties.

[1]  F. E. Nicodemus.  Directional Reflectance and Emissivity of an Opaque Surface , 1965 .

[2]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[3]  P. Schiller,et al.  Quantitative studies of single-cell properties in monkey striate cortex. II. Orientation specificity and ocular dominance. , 1976, Journal of neurophysiology.

[4]  J. Baizer,et al.  Visual responses of area 18 neurons in awake, behaving monkey. , 1977, Journal of neurophysiology.

[5]  H. L. MacGillivray,et al.  Skewness and Asymmetry: Measures and Orderings , 1986 .

[6]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[7]  D. Heeger.  Modeling simple-cell direction selectivity with normalized, half-squared, linear operators. , 1993, Journal of neurophysiology.

[8]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[9]  D H Brainard,et al.  Color constancy in the nearly natural image. I. Asymmetric matches. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  D. Brainard,et al.  Color constancy in the nearly natural image. 2. Achromatic loci. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[13]  Marc Levoy,et al.  The digital Michelangelo project , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[14]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999, Psychological review.

[15]  D. Field,et al.  Sensitivity to contrast histogram differences in synthetic wavelet-textures , 2001, Vision Research.

[16]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[17]  S. Zeki,et al.  The functional organization of area V2, I: Specialization across stripes and layers , 2002, Visual Neuroscience.

[18]  D. Snodderly,et al.  Spatial organization of receptive fields of V1 neurons of alert monkeys: comparison with responses to gratings. , 2002, Journal of neurophysiology.

[19]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[20]  J. Koenderink,et al.  Bidirectional Texture Contrast Function , 2004, International Journal of Computer Vision.

[21]  M. Landy,et al.  A visual mechanism tuned to black , 2004, Vision Research.

[22]  Ron O Dror,et al.  Statistical characterization of real-world illumination. , 2004, Journal of vision.

[23]  E. Mingolla,et al.  Lightness Constancy in the Presence of Specular Highlights , 2004, Psychological science.

[24]  D. Ringach,et al.  Spatial overlap of ON and OFF subregions and its relation to response modulation ratio in macaque primary visual cortex. , 2005, Journal of neurophysiology.

[25]  Heinrich H. Bülthoff,et al.  Low-Level Image Cues in the Perception of Translucent Materials , 2005, TAP.

[26]  Qasim Zaidi,et al.  Lightness identification of patterned three-dimensional, real objects. , 2006, Journal of vision.

[27]  R. Rosenfeld.  Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.