Embodied Verbal Semantics: Evidence from an Image-Verb Matching Task

It has recently been demonstrated that certain neural circuitry involved in the execution of specific motor actions is also used when the very same motor actions are observed or when language describing those actions is perceived. In humans, the pre-motor cortex is organized into regions that are involved in the execution and observation of actions performed by at least the following three general areas: the mouth, the hand, and the leg. The discovery of this “mirror system”, involved in production and perception of motor behavior, leads to a viable hypothesis about the processing of linguistic units that refer to these actions. It could be that understanding a verb describing an action involves the activation of the very same mirror circuitry involved in performing and recognizing that action. This hypothesis is tested in a matching task, in which subjects were presented first with an image depicting some action, followed by a verb that either described that action or did not. They were asked to decide as quickly as possible whether the verb was appropriate to the image. It was reasoned that if the verbs and images for particular actions recruited the same mirror circuitry, then there should be interference in those cases where the actions described by the verb and image were not the same but used the same effector. The results showed that it took subjects significantly longer to reject nonmatching verbs and images when the two shared an effector than when they did not. These results support the hypothesis that understanding action language requires the activation of effector-specific neural circuitry in the human mirror system.

[1]  A. Sirigu,et al.  The Mental Representation of Hand Movements After Parietal Cortex Damage , 1996, Science.

[2]  J. Decety,et al.  The cerebellum participates in mental activity: tomographic measurements of regional cerebral blood flow , 1990, Brain Research.

[3]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[4]  P. Roland,et al.  Supplementary motor area and other cortical areas in organization of voluntary movements in man. , 1980, Journal of neurophysiology.

[5]  Jerome A. Feldman,et al.  Extending Embodied Lexical Development , 1998 .

[6]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[7]  E. Tulving,et al.  Reactivation of encoding-related brain activity during memory retrieval. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Brian MacWhinney,et al.  The emergence of language. , 1999 .

[9]  Lars-Göran Nilsson,et al.  Reactivation of Motor Brain Areas during Explicit Memory for Actions , 2001, NeuroImage.

[10]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[11]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[12]  Peter W. Foltz,et al.  An introduction to latent semantic analysis , 1998 .

[13]  Benjamin K. Bergen,et al.  Embodied Construction Grammar in Simulation-Based Language Understanding , 2003 .

[14]  M. Diamond,et al.  Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[15]  F. Pulvermüller,et al.  Walking or Talking?: Behavioral and Neurophysiological Correlates of Action Verb Processing , 2001, Brain and Language.

[16]  M. Erb,et al.  Activation of Cortical and Cerebellar Motor Areas during Executed and Imagined Hand Movements: An fMRI Study , 1999, Journal of Cognitive Neuroscience.