Fast Temporal Dynamics of Visual Cue Integration

The integration of information from different sensors, cues, or modalities lies at the very heart of perception. We are studying adaptive phenomena in visual cue integration. To this end, we have designed a visual tracking task, where subjects track a target object among distractors and try to identify the target after an occlusion. Objects are defined by three different attributes (color, shape, size) which change randomly within a single trial. When the attributes differ in their reliability (two change frequently, one is stable), our results show that subjects dynamically adapt their processing. The results are consistent with the hypothesis that subjects rapidly re-weight the information provided by the different cues by emphasizing the information from the stable cue. This effect seems to be automatic, ie not requiring subjects' awareness of the differential reliabilities of the cues. The hypothesized re-weighting seems to take place in about 1 s. Our results suggest that cue integration can exhibit adaptive phenomena on a very fast time scale. We propose a probabilistic model with temporal dynamics that accounts for the observed effect.

[1]  M. Potter.  Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[2]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[3]  E. Newman,et al.  The infrared 'vision' of snakes , 1982 .

[4]  Eileen Kowler,et al.  Reading twisted text: Implications for the role of saccades , 1987, Vision Research.

[5]  J. Cutting,et al.  Minimodularity and the perception of layout. , 1988, Journal of experimental psychology. General.

[6]  D. Massaro,et al.  Models of integration given multiple sources of information. , 1990, Psychological review.

[7]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[8]  B. C. Motter,et al.  Neural correlates of feature selective memory and pop-out in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[10]  A. Yuille,et al.  Bayesian decision theory and psychophysics , 1996 .

[11]  T. Oyama,et al.  Effects of Similarity on Apparent Motion and Perceptual Grouping , 1999, Perception.

[12]  Jeff B. Pelz,et al.  Development of a virtual laboratory for the study of complex human behavior , 1999, Electronic Imaging.

[13]  R. Jacobs,et al.  Experience-dependent integration of texture and motion cues to depth , 1999, Vision Research.

[14]  Jochen Triesch,et al.  Democratic Integration: A Theory of Adaptive Sensory Integration , 2000 .

[15]  Heinrich H. Bülthoff,et al.  Touch can change visual slant perception , 2000, Nature Neuroscience.

[16]  R. Jacobs,et al.  Experience-dependent visual cue integration based on consistencies between visual and haptic percepts , 2001, Vision Research.

[17]  Jochen Triesch,et al.  Democratic Integration: Self-Organized Integration of Adaptive Cues , 2001, Neural Computation.

[18]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[19]  E. Holst.  Die Arbeitsweise des Statolithen-apparates Bei Fischen , 2004, Zeitschrift für vergleichende Physiologie.