The Role of Background Statistics in Face Adaptation

Cross-adaptation is widely used to probe whether different stimuli share common neural mechanisms. For example, that adaptation to second-order stimuli usually produces little aftereffect on first-order stimuli has been interpreted as reflecting their separate processing. However, such results appear to contradict the cue-invariant responses of many visual cells. We tested the novel hypothesis that the null aftereffect arises from the large difference in the backgrounds of first- and second-order stimuli. We created second-order faces with happy and sad facial expressions specified solely by local directions of moving random dots on a static-dot background, without any luminance-defined form cues. As expected, adaptation to such a second-order face did not produce a facial-expression aftereffect on the first-order faces. However, consistent with our hypothesis, simply adding static random dots to the first-order faces to render their backgrounds more similar to that of the adapting motion face led to a significant aftereffect. This background similarity effect also occurred between different types of first-order stimuli: real-face adaptation transferred to cartoon faces only when noise with correlation statistics of real faces or natural images was added to the cartoon faces. These findings suggest the following: (1) statistical similarities between the featureless backgrounds of the adapting and test stimuli can influence aftereffects, as in contingent adaptation; (2) weak or null cross-adaptation aftereffects should be interpreted with caution; and (3) luminance- and motion-direction-defined forms, and local features and global statistics, converge in the representation of faces.

[1]  C. McCollough Color Adaptation of Edge-Detectors in the Human Visual System , 1965, Science.

[2]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[3]  P. Ekman Pictures of Facial Affect , 1976 .

[4]  J. N. Bassili Facial motion in the perception of faces and of emotional expression. , 1978, Journal of experimental psychology. Human perception and performance.

[5]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[6]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[7]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[8]  Joseph J. Atick,et al.  Towards a Theory of Early Visual Processing , 1990, Neural Computation.

[9]  D. Berry What can a moving face tell us? , 1990, Journal of personality and social psychology.

[10]  V. Ramachandran,et al.  Illusory Displacement of Equiluminous Kinetic Edges , 1990, Perception.

[11]  H. Barlow Vision: A theory about the functional role and synaptic mechanism of visual after-effects , 1991 .

[12]  K. D. De Valois,et al.  Vernier acuity with stationary moving Gabors. , 1991, Vision research.

[13]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[14]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[15]  T D Albright,et al.  Form-cue invariant motion processing in primate visual cortex. , 1992, Science.

[16]  G. Orban,et al.  Cue-invariant shape selectivity of macaque inferior temporal neurons. , 1993, Science.

[17]  D. Ruderman The statistics of natural images , 1994 .

[18]  R A Andersen,et al.  The Analysis of Complex Motion Patterns by Form/Cue Invariant MSTd Neurons , 1996, The Journal of Neuroscience.

[19]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[20]  M. Sur,et al.  Orientation Maps of Subjective Contours in Visual Cortex , 1996, Science.

[21]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[22]  Shin'ya Nishida,et al.  Dual multiple-scale processing for motion in the human visual System , 1997, Vision Research.

[23]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[24]  L. P. O'Keefe,et al.  Processing of first- and second-order motion signals by neurons in area MT of the macaque monkey , 1998, Visual Neuroscience.

[25]  S. Edelman,et al.  Cue-Invariant Activation in Object-Related Areas of the Human Occipital Lobe , 1998, Neuron.

[26]  Martin J. Wainwright,et al.  Visual adaptation as optimal information transmission , 1999, Vision Research.

[27]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[28]  C. Clifford,et al.  A functional angle on some after-effects in cortical vision , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[29]  Frédéric Gosselin,et al.  Bubbles: a technique to reveal the use of information in recognition tasks , 2001, Vision Research.

[30]  A. O'Toole,et al.  Prototype-referenced shape encoding revealed by high-level aftereffects , 2001, Nature Neuroscience.

[31]  C. Clifford,et al.  Interaction between first- and second-order orientation channels revealed by the tilt illusion: psychophysics and computational modelling , 2001, Vision Research.

[32]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[33]  M. Georgeson,et al.  Shading and texture: separate information channels with a common adaptation mechanism? , 2002, Spatial vision.

[34]  H. Bülthoff,et al.  The use of facial motion and facial form during the processing of identity , 2003, Vision Research.

[35]  R. Hess,et al.  Investigating local network interactions underlying first- and second-order processing , 2004, Vision Research.

[36]  Y. Dan,et al.  Asymmetry in Visual Cortical Circuits Underlying Motion-Induced Perceptual Mislocalization , 2004, The Journal of Neuroscience.

[37]  G. Rhodes,et al.  Orientation-Contingent Face Aftereffects and Implications for Face-Coding Mechanisms , 2004, Current Biology.

[38]  K. D. De Valois,et al.  Stimulus selectivity of figural aftereffects for faces. , 2005, Journal of experimental psychology. Human perception and performance.

[39]  M. Landy,et al.  Orientation-selective adaptation to first- and second-order patterns in human visual cortex. , 2006, Journal of neurophysiology.

[40]  Li Zhaoping,et al.  Theoretical understanding of the early visual processes by data compression and data selection , 2006, Network.

[41]  G. Boynton,et al.  Selectivity for the configural cues that identify the gender, ethnicity, and identity of faces in human cortex , 2006, Proceedings of the National Academy of Sciences.

[42]  P. Dayan,et al.  Space and time in visual context , 2007, Nature Reviews Neuroscience.

[43]  Christopher J. Fox,et al.  What is adapted in face adaptation? The neural representations of expression in the human visual system , 2007, Brain Research.

[44]  H. Ashida,et al.  FMRI adaptation reveals separate mechanisms for first-order and second-order motion. , 2007, Journal of neurophysiology.

[45]  A. Schofield,et al.  Asymmetric transfer of the dynamic motion aftereffect between first- and second-order cues and among different second-order cues. , 2007, Journal of vision.

[46]  M. Landy,et al.  The effect of viewpoint on perceived visual roughness. , 2007, Journal of vision.

[47]  D. Ringach,et al.  Topological analysis of population activity in visual cortex. , 2008, Journal of vision.

[48]  D. Levi Crowding—An essential bottleneck for object recognition: A mini-review , 2008, Vision Research.

[49]  Richard M. Lipkin,et al.  Adaptation across the Cortical Hierarchy: Low-Level Curve Adaptation Affects High-Level Facial-Expression Judgments , 2008, The Journal of Neuroscience.

[50]  M. Keil Does face image statistics predict a preferred spatial frequency for human face processing? , 2008, Proceedings of the Royal Society B: Biological Sciences.

[51]  Christopher J. Fox,et al.  It doesn't matter how you feel. The facial identity aftereffect is invariant to changes in facial expression. , 2008, Journal of vision.

[52]  A. Little,et al.  Category contingent aftereffects for faces of different races, ages and species , 2008, Cognition.

[53]  O. Blanke,et al.  Dorsal–Ventral Integration in the Recognition of Motion-Defined Unfamiliar Faces , 2009, The Journal of Neuroscience.

[54]  B. Murphy,et al.  Adaptation to natural facial categories , .