Effects of task requirements on rapid natural scene processing: from common sensory encoding to distinct decisional mechanisms.

Using manual responses, human participants are remarkably fast and accurate at deciding if a natural scene contains an animal, but recent data show that they are even faster to indicate with saccadic eye movements which of 2 scenes contains an animal. How could it be that 2 images can apparently be processed faster than a single image? To better understand the origin of this speed advantage in forced-choice categorization, the present study used a masking procedure to compare 4 tasks in which sensory, decisional, and motor aspects were systematically varied. With stimulus onset asynchronies (SOAs) above 40 ms, there were substantial differences in sensitivity between tasks, as determined by d' measurements, with an advantage for tasks using a single image. However, with SOAs below 30-40 ms, sensitivity was similar for all experiments, despite very large differences in reaction time. This suggests that the initial part of the sensory encoding relies on common and parallel processing across a large range of tasks, whether participants have to categorize the image or locate a target in 1 of 2 scenes.

[1]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[2]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[3]  J. Seal,et al.  Finger Pairings in Two-Choice Reaction Time Taskscolon: Does the Between-Hands Advantage Reflect Response Preparation? , 1995, Journal of motor behavior.

[4]  M. S. Mayzner,et al.  Human information processing : tutorials in performance and cognition , 1975 .

[5]  S. Thorpe,et al.  The time course of visual processing: Backward masking and natural scene categorisation , 2005, Vision Research.

[6]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[7]  Manuel Perea,et al.  Is the go/no-go lexical decision task an alternative to the yes/no lexical decision task? , 2002, Memory & cognition.

[8]  Leila Reddy,et al.  Face-gender discrimination is possible in the near-absence of attention. , 2004, Journal of vision.

[9]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[10]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[11]  S. Thorpe,et al.  Rapid categorization of foveal and extrafoveal natural images: Associated ERPs and effects of lateralization , 2005, Brain and Cognition.

[12]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[13]  S. Thorpe,et al.  Surfing a spike wave down the ventral stream , 2002, Vision Research.

[14]  Michèle Fabre-Thorpe,et al.  Interaction of top-down and bottom-up processing in the fast visual analysis of natural scenes. , 2004, Brain research. Cognitive brain research.

[15]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[16]  S. Thorpe,et al.  A Limit to the Speed of Processing in Ultra-Rapid Visual Categorization of Novel Natural Scenes , 2001, Journal of Cognitive Neuroscience.

[17]  E. Seidemann,et al.  Temporal gating of neural signals during performance of a visual discrimination task , 1998, Nature.

[18]  G Richard,et al.  Ultra-rapid categorisation of natural scenes does not rely on colour cues: a study in monkeys and humans , 2000, Vision Research.

[19]  John T. Wixted,et al.  Methodology in experimental psychology , 2002 .

[20]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[21]  A. Yonelinas,et al.  Separating sensitivity from response bias: implications of comparisons of yes-no and forced-choice tests for models and measures of recognition memory. , 2002, Journal of experimental psychology. General.

[22]  Jeroen B. J. Smeets,et al.  Colour vision can contribute to fast corrections of arm movements , 2004, Experimental Brain Research.

[23]  W P Banks,et al.  Recognition and Source Memory as Multivariate Decision Processes , 2000, Psychological science.

[24]  G. Rizzolatti,et al.  The organization of the cortical motor system: new concepts. , 1998, Electroencephalography and clinical neurophysiology.

[25]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[26]  David E. Irwin,et al.  The dynamics of cognition and action: mental processes inferred from speed-accuracy decomposition. , 1988, Psychological review.

[27]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[28]  P. Perona,et al.  Rapid natural scene categorization in the near absence of attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[29]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[30]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[31]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[32]  J Duncan,et al.  Responses of neurons in macaque area V4 during memory-guided visual search. , 2001, Cerebral cortex.

[33]  Laurette Hay,et al.  Contribution of visual information to feedforward and feedback processes in rapid pointing movements , 1986 .

[34]  J. Duncan,et al.  Competitive brain activity in visual attention , 1997, Current Opinion in Neurobiology.

[35]  Guillaume A. Rousselet,et al.  Processing of one, two or four natural scenes in humans: the limits of parallelism , 2004, Vision Research.

[36]  N. Kanwisher,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Recognition As Soon as You Know It Is There, You Know What It Is , 2022 .

[37]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[38]  S. Luck,et al.  Bridging the Gap between Monkey Neurophysiology and Human Perception: An Ambiguity Resolution Theory of Visual Selective Attention , 1997, Cognitive Psychology.

[39]  R VanRullen,et al.  Is it a Bird? Is it a Plane? Ultra-Rapid Visual Categorisation of Natural and Artifactual Objects , 2001, Perception.

[40]  Leila Reddy,et al.  Face identification in the near-absence of focal attention , 2006, Vision Research.

[41]  J. Dunn Remember-know: a matter of confidence. , 2004, Psychological review.

[42]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[43]  C. Koch,et al.  Visual Search and Dual Tasks Reveal Two Distinct Attentional Resources , 2004, Journal of Cognitive Neuroscience.

[44]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[45]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[46]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[47]  Robert T Knight,et al.  The contribution of recollection and familiarity to yes–no and forced-choice recognition tests in healthy subjects and amnesics , 2000, Neuropsychologia.

[48]  Neil A. Macmillan Signal Detection Theory , 2002 .

[49]  J. Schwarzbach,et al.  Different time courses for visual perception and action priming , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Leslie G. Ungerleider The Corticocortical Pathways for Object Recognition and Spatial Perception , 1985 .

[51]  Robert G Pachella,et al.  The Interpretation of Reaction Time in Information-Processing Research 1 , 1973, Human Information Processing.

[52]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[53]  G. Rousselet,et al.  Is it an animal? Is it a human face? Fast processing in upright and inverted natural scenes. , 2003, Journal of vision.

[54]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[55]  Emilio Salinas,et al.  Cognitive neuroscience: Flutter Discrimination: neural codes, perception, memory and decision making , 2003, Nature Reviews Neuroscience.

[56]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[57]  Joseph R. Higgins,et al.  Correction of false moves in pursuit tracking , 1969 .

[58]  C. Koch,et al.  Visual Selective Behavior Can Be Triggered by a Feed-Forward Process , 2003, Journal of Cognitive Neuroscience.

[59]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[60]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[61]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[62]  A. Treisman,et al.  Perception of objects in natural scenes: is it really attention free? , 2005, Journal of experimental psychology. Human perception and performance.

[63]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[64]  Yasushi Hino,et al.  Effects of word frequency and spelling-to-sound regularity in naming with and without preceding lexical decision. , 2000 .

[65]  Driss Boussaoud,et al.  Frontal lobe mechanisms subserving vision-for-action versus vision-for-perception , 1995, Behavioural Brain Research.

[66]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[67]  Charles G. Gross,et al.  Pattern recognition mechanisms , 1985 .

[68]  Guillaume A. Rousselet,et al.  Parallel processing in high-level categorization of natural images , 2002, Nature Neuroscience.

[69]  G W Humphreys,et al.  Top-down processes in object identification: evidence from experimental psychology, neuropsychology and functional anatomy. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[70]  A Treisman,et al.  Feature binding, attention and object perception. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[71]  H. Pashler STEVENS' HANDBOOK OF EXPERIMENTAL PSYCHOLOGY , 2002 .

[72]  J. Schall On building a bridge between brain and behavior. , 2004, Annual review of psychology.

[73]  S. Thorpe,et al.  How parallel is visual processing in the ventral pathway? , 2004, Trends in Cognitive Sciences.

[74]  Chris Westbury,et al.  The effect of semantic distance in yes/no and go/no-go semantic categorization tasks , 2003, Memory & cognition.

[75]  M. Shadlen,et al.  The effect of stimulus strength on the speed and accuracy of a perceptual decision. , 2005, Journal of vision.

[76]  D. Perrett,et al.  Evidence accumulation in cell populations responsive to faces: an account of generalisation of recognition without mental transformations , 1998, Cognition.

[77]  David E. Irwin,et al.  Modern mental chronometry , 1988, Biological Psychology.

[78]  B. Murdock,et al.  Tests of the list-strength effect in recognition memory. , 1992 .

[79]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[80]  Matthew Duncan,et al.  Testing theories of recognition memory by predicting performance across paradigms. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[81]  H H Bülthoff,et al.  Detection of animals in natural images using far peripheral vision , 2001, The European journal of neuroscience.

[82]  Li Fei-Fei,et al.  Binding is a local problem for natural objects and scenes , 2005, Vision Research.

[83]  J. Duncan The locus of interference in the perception of simultaneous stimuli. , 1980 .