Using Primary Reinforcement to Enhance Translatability of a Human Affect and Decision-Making Judgment Bias Task

Abstract Good translatability of behavioral measures of affect (emotion) between human and nonhuman animals is core to comparative studies. The judgment bias (JB) task, which measures “optimistic” and “pessimistic” decision-making under ambiguity as indicators of positive and negative affective valence, has been used in both human and nonhuman animals. However, one key disparity between human and nonhuman studies is that the former typically use secondary reinforcers (e.g., money) whereas the latter typically use primary reinforcers (e.g., food). To address this deficiency and shed further light on JB as a measure of affect, we developed a novel version of a JB task for humans using primary reinforcers. Data on decision-making and reported affective state during the JB task were analyzed using computational modeling. Overall, participants grasped the task well, and as anticipated, their reported affective valence correlated with trial-by-trial variation in offered volume of juice. In addition, previous findings from monetary versions of the task were replicated: More positive prediction errors were associated with more positive affective valence, a higher lapse rate was associated with lower affective arousal, and affective arousal decreased as a function of number of trials completed. There was no evidence that more positive valence was associated with greater “optimism,” but instead, there was evidence that affective valence influenced the participants' decision stochasticity, whereas affective arousal tended to influence their propensity for errors. This novel version of the JB task provides a useful tool for investigation of the links between primary reward and punisher experience, affect, and decision-making, especially from a comparative perspective.

[1]  E. Fuchs,et al.  Chronic psychosocial stress makes rats more ‘pessimistic’ in the ambiguous-cue interpretation paradigm , 2013, Behavioural Brain Research.

[2]  P. Dayan,et al.  Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis , 2013, Biology of Mood & Anxiety Disorders.

[3]  P. Dayan,et al.  Algorithms for survival: a comparative perspective on emotions , 2017, Nature Reviews Neuroscience.

[4]  C. MacLeod,et al.  Attentional bias in emotional disorders. , 1986, Journal of abnormal psychology.

[5]  M. Mendl,et al.  Animal behaviour: Cognitive bias and affective state , 2004, Nature.

[6]  E. Igou,et al.  Risk‐taking increases under boredom , 2020, Journal of Behavioral Decision Making.

[7]  S. H. Richter,et al.  Regular touchscreen training affects faecal corticosterone metabolites and anxiety-like behaviour in mice , 2020, Behavioural Brain Research.

[8]  E. Robinson,et al.  Evaluation of a novel translational task for assessing emotional biases in different species , 2011, Cognitive, Affective, & Behavioral Neuroscience.

[9]  P. Dayan,et al.  Cognitive Bias in Ambiguity Judgements: Using Computational Models to Dissect the Effects of Mild Mood Manipulation in Humans , 2016, PloS one.

[10]  P. Dayan,et al.  Assessing animal affect: an automated and self-initiated judgement bias task based on natural investigative behaviour , 2018, Scientific Reports.

[11]  N. Rupniak Animal models of depression: challenges from a drug development perspective. , 2003, Behavioural pharmacology.

[12]  B. Spruijt,et al.  Tools to measure and improve animal welfare: reward-related behaviour , 2007, Animal Welfare.

[13]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[14]  Daniel Nettle,et al.  The Evolutionary Origins of Mood and Its Disorders , 2012, Current Biology.

[15]  Jeffrey W Grimm,et al.  Dissociation of Primary and Secondary Reward-Relevant Limbic Nuclei in an Animal Model of Relapse , 2000, Neuropsychopharmacology.

[16]  E. Robinson,et al.  Translating a rodent measure of negative bias into humans: the impact of induced anxiety and unmedicated mood and anxiety disorders , 2019, Psychological Medicine.

[17]  Oliver von Bohlen und Halbach,et al.  Ambiguous-Cue Interpretation is Biased Under Stress- and Depression-Like States in Rats , 2010, Neuropsychopharmacology.

[18]  T. Dalgleish,et al.  The emotional Stroop task and psychopathology. , 1996, Psychological bulletin.

[19]  Per Binde Why people gamble: a model with five motivational dimensions , 2013 .

[20]  Wolfgang M. Pauli,et al.  Distinct Contributions of Ventromedial and Dorsolateral Subregions of the Human Substantia Nigra to Appetitive and Aversive Learning , 2015, The Journal of Neuroscience.

[21]  J. O'Doherty,et al.  Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. , 2011, Cerebral cortex.

[22]  M. Mendl,et al.  Animal affect and decision-making , 2020, Neuroscience & Biobehavioral Reviews.

[23]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[24]  I. Cuthill,et al.  Mood and the speed of decisions about anticipated resources and hazards , 2011 .

[25]  J. Dreher,et al.  Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies , 2013, Neuroscience & Biobehavioral Reviews.

[26]  E. Robinson,et al.  Investigating the psychopharmacology of cognitive affective bias in rats using an affective tone discrimination task , 2012, Psychopharmacology.

[27]  J. Eastwood,et al.  Is boredom associated with problem gambling behaviour? It depends on what you mean by ‘boredom’ , 2010 .

[28]  Katia M. Harlé,et al.  Anhedonia and anxiety underlying depressive symptomatology have distinct effects on reward-based decision-making , 2017, PloS one.

[29]  P. Dayan,et al.  Dissecting the links between reward and loss, decision-making, and self-reported affect using a computational approach , 2020, PLoS Comput. Biol..

[30]  Conor J. Houghton,et al.  Diffusion Modelling Reveals the Decision Making Processes Underlying Negative Judgement Bias in Rats , 2016, PloS one.

[31]  P. Dayan,et al.  A computational and neural model of momentary subjective well-being , 2014, Proceedings of the National Academy of Sciences.

[32]  W. Killgore,et al.  The Affect Grid: A Moderately Valid, Nonspecific Measure of Pleasure and Arousal , 1998, Psychological reports.

[33]  Mark A. Elliott,et al.  Being right is its own reward: Load and performance related ventral striatum activation to correct responses during a working memory task in youth , 2012, NeuroImage.

[34]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[35]  Peter Dayan,et al.  Vigor in the Face of Fluctuating Rates of Reward: An Experimental Examination , 2011, Journal of Cognitive Neuroscience.

[36]  Optimism, pessimism and judgement bias in animals: A systematic review and meta-analysis , 2020, Neuroscience & Biobehavioral Reviews.

[37]  Richard M A Parker,et al.  Cognitive bias as an indicator of animal emotion and welfare: Emerging evidence and underlying mechanisms , 2009 .

[38]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[39]  M. Delgado,et al.  Neural Systems Underlying Aversive Conditioning in Humans with Primary and Secondary Reinforcers , 2011, Front. Neurosci..

[40]  M. Bateson,et al.  Pharmacological manipulations of judgement bias: A systematic review and meta-analysis , 2019, Neuroscience & Biobehavioral Reviews.

[41]  A. R. Otto,et al.  Real-world unexpected outcomes predict city-level mood states and risk-taking behavior , 2018, PloS one.

[42]  Koji Jimura,et al.  Primary and Secondary Rewards Differentially Modulate Neural Activity Dynamics during Working Memory , 2010, PloS one.

[43]  Christopher K. Hsee,et al.  Music, Pandas, and Muggers: On the Affective Psychology of Value , 2004, Journal of experimental psychology. General.

[44]  J. Dreher,et al.  Cerebral correlates of salient prediction error for different rewards and punishments. , 2013, Cerebral cortex.

[45]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[46]  Scott A. Huettel,et al.  Functional Significance of Striatal Responses during Episodic Decisions: Recovery or Goal Attainment? , 2010, The Journal of Neuroscience.

[47]  Edmund T. Rolls,et al.  What are Emotional States, and Why Do We Have Them? , 2013 .

[48]  P. Dayan,et al.  Reward and punisher experience alter rodent decision-making in a judgement bias task , 2020, Scientific Reports.

[49]  Alasdair I Houston,et al.  On evolutionary explanations of cognitive biases. , 2013, Trends in ecology & evolution.

[50]  M. Mendl,et al.  An integrative and functional framework for the study of animal emotion and mood , 2010, Proceedings of the Royal Society B: Biological Sciences.

[51]  O. Robinson,et al.  Association Between a Directly Translated Cognitive Measure of Negative Bias and Self-reported Psychiatric Symptoms , 2020, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[52]  S. H. Richter,et al.  Daily exposure to a touchscreen-paradigm and associated food restriction evokes an increase in adrenocortical and neural activity in mice , 2016, Hormones and Behavior.

[53]  Gordon H. Bower,et al.  Mood effects on subjective probability assessment , 1992 .