Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging

Event-related functional magnetic resonance imaging was used to measure blood oxygenation level-dependent responses in 13 young healthy human volunteers during performance of a probabilistic reversal-learning task. The task allowed the separate investigation of the relearning of stimulus–reward associations and the reception of negative feedback. Significant signal change in the right ventrolateral prefrontal cortex was demonstrated on trials when subjects stopped responding to the previously relevant stimulus and shifted responding to the newly relevant stimulus. Significant signal change in the region of the ventral striatum was also observed on such reversal errors, from a region of interest analysis. The ventrolateral prefrontal cortex and ventral striatum were not significantly activated by the other, preceding reversal errors, or when subjects received negative feedback for correct responses. Moreover, the response on the final reversal error, before shifting, was not modulated by the number of preceding reversal errors, indicating that error-related activity does not simply accumulate in this network. The signal change in this ventral frontostriatal circuit is therefore associated with reversal learning and is uncontaminated by negative feedback. Overall, these data concur with findings in rodents and nonhuman primates of reversal-learning deficits after damage to ventral frontostriatal circuitry, and also support recent clinical findings using this task.

[1]  E. Rolls The functions of the orbitofrontal cortex , 1999, Brain and Cognition.

[2]  M. Mishkin,et al.  Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity , 1970, Experimental Brain Research.

[3]  Chantal E. Stern,et al.  The nucleus accumbens in monkeys (Macaca fascicularis) , 2004, Experimental Brain Research.

[4]  T. Robbins,et al.  Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. , 2001, Cerebral cortex.

[5]  M. Petrides,et al.  Wisconsin Card Sorting Revisited: Distinct Neural Circuits Participating in Different Stages of the Task Identified by Event-Related Functional Magnetic Resonance Imaging , 2001, The Journal of Neuroscience.

[6]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[7]  A. Smit,et al.  Synapse Formation between Central Neurons Requires Postsynaptic Expression of the MEN1 Tumor Suppressor Gene , 2001, The Journal of Neuroscience.

[8]  Matthew Brett,et al.  A new robust 3d phase-unwrapping algorithm applied to fMRI field maps for the undistortion of EPIs , 2001, NeuroImage.

[9]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[10]  M. Umemiya,et al.  A Calcium-Dependent Feedback Mechanism Participates in Shaping Single NMDA Miniature EPSCs , 2001, The Journal of Neuroscience.

[11]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[12]  H. Fukuyama,et al.  Dissociable mechanisms of attentional control within the human prefrontal cortex. , 2001, Cerebral cortex.

[13]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[14]  T. Robbins,et al.  Probabilistic learning and reversal deficits in patients with Parkinson’s disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication , 2000, Neuropsychologia.

[15]  T. Robbins,et al.  Contrasting Cortical and Subcortical Activations Produced by Attentional-Set Shifting and Reversal Learning in Humans , 2000, Journal of Cognitive Neuroscience.

[16]  T. Robbins,et al.  Specific cognitive deficits in mild frontal variant frontotemporal dementia. , 1999, Brain : a journal of neurology.

[17]  E. Stein,et al.  Right hemispheric dominance of inhibitory control: an event-related functional MRI study. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Y. Miyashita,et al.  Common inhibitory mechanism in human inferior prefrontal cortex revealed by event-related functional MRI. , 1999, Brain : a journal of neurology.

[19]  N. J. Herrod,et al.  Redefining the functional organization of working memory processes within human lateral prefrontal cortex , 1999, The European journal of neuroscience.

[20]  A. Owen The Functional Organization of Working Memory Processes Within Human Lateral Frontal Cortex: The Contribution of Functional Neuroimaging , 1997, The European journal of neuroscience.

[21]  J. Pardo,et al.  Emotion, olfaction, and the human amygdala: amygdala activation during aversive olfactory stimulation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[22]  H. Groenewegen,et al.  The anatomical relationships of the prefrontal cortex with limbic structures and the basal ganglia , 1997, Journal of psychopharmacology.

[23]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[24]  E. Rolls,et al.  Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. , 1994, Journal of neurology, neurosurgery, and psychiatry.

[25]  Y Agid,et al.  Are dopaminergic neurons selectively vulnerable to Parkinson's disease? , 1993, Advances in neurology.

[26]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  T. Robbins,et al.  Limbic-striatal interactions in reward-related processes , 1989, Neuroscience & Biobehavioral Reviews.

[28]  T. Robbins,et al.  The effects of ibotenic acid lesions of the nucleus accumbens on spatial learning and extinction in the rat , 1989, Behavioural Brain Research.

[29]  S. Kish,et al.  Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. , 1988, The New England journal of medicine.

[30]  C. Marsden,et al.  'Frontal' cognitive function in patients with Parkinson's disease 'on' and 'off' levodopa. , 1988, Brain : a journal of neurology.

[31]  G. Mogenson,et al.  Limbic-motor integration , 1987 .

[32]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[33]  M. Le Moal,et al.  Alternation behavior, spatial discrimination, and reversal disturbances following 6-hydroxydopamine lesions in the nucleus accumbens of the rat. , 1985, Behavioral and neural biology.

[34]  M. Mishkin,et al.  Limbic lesions and the problem of stimulus--reinforcement associations. , 1972, Experimental neurology.

[35]  H. E. Rosvold,et al.  Behavioral effects of selective ablation of the caudate nucleus. , 1967, Journal of comparative and physiological psychology.