Association of Neural and Emotional Impacts of Reward Prediction Errors With Major Depression

Importance Major depressive disorder (MDD) is associated with deficits in representing reward prediction errors (RPEs), which are the difference between experienced and predicted reward. Reward prediction errors underlie learning of values in reinforcement learning models, are represented by phasic dopamine release, and are known to affect momentary mood. Objective To combine functional neuroimaging, computational modeling, and smartphone-based large-scale data collection to test, in the absence of learning-related concerns, the hypothesis that depression attenuates the impact of RPEs. Design, Setting, and Participants Functional magnetic resonance imaging (fMRI) data were collected on 32 individuals with moderate MDD and 20 control participants who performed a probabilistic reward task. A risky decision task with repeated happiness ratings as a measure of momentary mood was also tested in the laboratory in 74 participants and with a smartphone-based platform in 1833 participants. The study was conducted from November 20, 2012, to February 17, 2015. Main Outcomes and Measures Blood oxygen level–dependent activity was measured in ventral striatum, a dopamine target area known to represent RPEs. Momentary mood was measured during risky decision making. Results Of the 52 fMRI participants (mean [SD] age, 34.0 [9.1] years), 30 (58%) were women and 32 had MDD. Of the 74 participants in the laboratory risky decision task (mean age, 34.2 [10.3] years), 44 (59%) were women and 54 had MDD. Of the smartphone group, 543 (30%) had a depression history and 1290 (70%) had no depression history; 918 (50%) were women, and 593 (32%) were younger than 30 years. Contrary to previous results in reinforcement learning tasks, individuals with moderate depression showed intact RPE signals in ventral striatum (z = 3.16; P = .002) that did not differ significantly from controls (z = 0.91; P = .36). Symptom severity correlated with baseline mood parameters in laboratory (&rgr; = −0.54; P < 1 × 10−6) and smartphone (&rgr; = −0.30; P < 1 × 10−39) data. However, participants with depression showed an intact association between RPEs and happiness in a computational model of momentary mood dynamics (z = 4.55; P < .001) that was not attenuated compared with controls (z = −0.42; P = .67). Conclusions and Relevance The neural and emotional impact of RPEs is intact in major depression. These results suggest that depression does not affect the expression of dopaminergic RPEs and that attenuated RPEs in previous reports may reflect downstream effects more closely related to aberrant behavior. The correlation between symptom severity and baseline mood parameters supports an association between depression and momentary mood fluctuations during cognitive tasks. These results demonstrate a potential for smartphones in large-scale computational phenotyping, which is a goal for computational psychiatry.

[1]  T. Robbins,et al.  Approach and avoidance learning in patients with major depression and healthy controls: relation to anhedonia , 2009, Psychological Medicine.

[2]  P. Dayan,et al.  Dopaminergic Modulation of Decision Making and Subjective Well-Being , 2015, The Journal of Neuroscience.

[3]  Lauren M. Bylsma,et al.  A meta-analysis of emotional reactivity in major depressive disorder. , 2008, Clinical psychology review.

[4]  P. Glimcher,et al.  Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term , 2014, The Journal of Neuroscience.

[5]  P. Dayan,et al.  A computational and neural model of momentary subjective well-being , 2014, Proceedings of the National Academy of Sciences.

[6]  Olga V. Demler,et al.  Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[7]  Rick A Adams,et al.  Proactive and Reactive Response Inhibition across the Lifespan , 2015, PloS one.

[8]  Ellen Frank,et al.  Major depressive disorder: new clinical, neurobiological, and treatment perspectives , 2012, The Lancet.

[9]  R. Spitzer,et al.  The PHQ-9: A new depression diagnostic and severity measure , 2002 .

[10]  P. Dayan,et al.  Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis , 2013, Biology of Mood & Anxiety Disorders.

[11]  B. Sahakian,et al.  Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder. , 2012, The American journal of psychiatry.

[12]  Klaus P. Ebmeier,et al.  Blunted response to feedback information in depressive illness. , 2007, Brain : a journal of neurology.

[13]  Kristopher J Preacher,et al.  On the practice of dichotomization of quantitative variables. , 2002, Psychological methods.

[14]  Weina Zhang,et al.  The neural correlates of reward-related processing in major depressive disorder: a meta-analysis of functional magnetic resonance imaging studies. , 2013, Journal of affective disorders.

[15]  R. Dolan,et al.  Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans , 2006, Nature.

[16]  P. Glimcher,et al.  MEASURING BELIEFS AND REWARDS: A NEUROECONOMIC APPROACH. , 2010, The quarterly journal of economics.

[17]  A. Hariri,et al.  Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder. , 2009, The American journal of psychiatry.

[18]  R. Dolan,et al.  Dimensional psychiatry: reward dysfunction and depressive mood across psychiatric disorders , 2014, Psychopharmacology.

[19]  G. Waiter,et al.  Expected value and prediction error abnormalities in depression and schizophrenia. , 2011, Brain : a journal of neurology.

[20]  Rick A Adams,et al.  Age-related changes in working memory and the ability to ignore distraction , 2015, Proceedings of the National Academy of Sciences.

[21]  M. Milders,et al.  Abnormal Temporal Difference Reward-learning Signals in Major Depression Department of Radiology And , 2022 .

[22]  M. Frank,et al.  Computational psychiatry as a bridge from neuroscience to clinical applications , 2016, Nature Neuroscience.

[23]  Rick A Adams,et al.  Crowdsourcing for Cognitive Science – The Utility of Smartphones , 2014, PloS one.

[24]  Rick A Adams,et al.  Risk Taking for Potential Reward Decreases across the Lifespan , 2016, Current Biology.

[25]  P. Glimcher Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis , 2011, Proceedings of the National Academy of Sciences.

[26]  M. Treadway,et al.  Reward processing dysfunction in major depression, bipolar disorder and schizophrenia , 2015, Current opinion in psychiatry.

[27]  G. Freedman,et al.  Burden of Depressive Disorders by Country, Sex, Age, and Year: Findings from the Global Burden of Disease Study 2010 , 2013, PLoS medicine.

[28]  Aaron S. Andalman,et al.  Dopamine neurons modulate neural encoding and expression of depression-related behaviour , 2012, Nature.

[29]  M. Hamilton A RATING SCALE FOR DEPRESSION , 1960, Journal of neurology, neurosurgery, and psychiatry.

[30]  Karl J. Friston,et al.  Computational psychiatry , 2012, Trends in Cognitive Sciences.

[31]  Scott J. Russo,et al.  The brain reward circuitry in mood disorders , 2013, Nature Reviews Neuroscience.

[32]  P. Cowen,et al.  Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action , 2009, British Journal of Psychiatry.

[33]  G. Glover,et al.  Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior , 2016, Science.

[34]  P. Dayan,et al.  Depression: a decision-theoretic analysis. , 2015, Annual review of neuroscience.

[35]  D. Pizzagalli,et al.  Reduced Reward Learning Predicts Outcome in Major Depressive Disorder , 2013, Biological Psychiatry.

[36]  Jeffrey L. Birk,et al.  Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. , 2009, The American journal of psychiatry.

[37]  Henrik Walter,et al.  Prediction error as a linear function of reward probability is coded in human nucleus accumbens , 2006, NeuroImage.

[38]  D. Pizzagalli,et al.  Dopaminergic Enhancement of Striatal Response to Reward in Major Depression. , 2017, The American journal of psychiatry.

[39]  P. Glimcher,et al.  Testing the Reward Prediction Error Hypothesis with an Axiomatic Model , 2010, The Journal of Neuroscience.

[40]  Nikolaus Weiskopf,et al.  Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: A whole-brain analysis at 3 T and 1.5 T , 2006, NeuroImage.

[41]  Mark W Woolrich,et al.  Associative learning of social value , 2008, Nature.

[42]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.