Formal Comparison of Dual-Parameter Temporal Discounting Models in Controls and Pathological Gamblers

Temporal or delay discounting refers to the phenomenon that the value of a reward is discounted as a function of time to delivery. A range of models have been proposed that approximate the shape of the discount curve describing the relationship between subjective value and time. Recent evidence suggests that more than one free parameter may be required to accurately model human temporal discounting data. Nonetheless, many temporal discounting studies in psychiatry, psychology and neuroeconomics still apply single-parameter models, despite their oftentimes poor fit to single-subject data. Previous comparisons of temporal discounting models have either not taken model complexity into account, or have overlooked particular models. Here we apply model comparison techniques in a large sample of temporal discounting datasets using several discounting models employed in the past. Among the models examined, an exponential-power model from behavioural economics (CS model, Ebert & Prelec 2007) provided the best fit to human laboratory discounting data. Inter-parameter correlations for the winning model were moderate, whereas they were substantial for other dual-parameter models examined. Analyses of previous group and context effects on temporal discounting with the winning model provided additional theoretical insights. The CS model may be a useful tool in future psychiatry, psychology and neuroscience work on inter-temporal choice.

[1]  P. Samuelson A Note on Measurement of Utility , 1937 .

[2]  S. S. Stevens On the psychophysical law. , 1957, Psychological review.

[3]  H. Akaike A new look at the statistical model identification , 1974 .

[4]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[5]  R. Thaler Some empirical evidence on dynamic inconsistency , 1981 .

[6]  J. E. Mazur An adjusting procedure for studying delayed reinforcement. , 1987 .

[7]  M. Commons The effect of delay and of intervening events on reinforcement value , 2013 .

[8]  G. Loewenstein,et al.  Anomalies in Intertemporal Choice: Evidence and an Interpretation , 1992 .

[9]  L. Green,et al.  Discounting of Delayed Rewards: A Life-Span Comparison , 1994 .

[10]  L. Green,et al.  Discounting of delayed rewards: Models of individual choice. , 1995, Journal of the experimental analysis of behavior.

[11]  David I. Laibson,et al.  Golden Eggs and Hyperbolic Discounting , 1997 .

[12]  A. Odum,et al.  Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers , 1999, Psychopharmacology.

[13]  J. Monterosso,et al.  Beyond discounting: possible experimental models of impulse control , 1999, Psychopharmacology.

[14]  R. Grace The Matching Law And Amount-dependent Exponential Discounting As Accounts Of Self-control Choice. , 1999, Journal of the experimental analysis of behavior.

[15]  N. Petry,et al.  Excessive discounting of delayed rewards in substance abusers with gambling problems. , 1999, Drug and alcohol dependence.

[16]  G. Madden,et al.  Discounting of delayed rewards in opioid-dependent outpatients: exponential or hyperbolic discounting functions? , 1999, Experimental and clinical psychopharmacology.

[17]  R. Vuchinich,et al.  Reliability of a Measure of Temporal Discounting , 2000 .

[18]  N. Petry Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. , 2001, Journal of abnormal psychology.

[19]  D. Read Is Time-Discounting Hyperbolic or Subadditive? , 2001 .

[20]  Byron J. T. Morgan,et al.  Applied Stochastic Modelling , 2001 .

[21]  I. J. Myung,et al.  When a good fit can be bad , 2002, Trends in Cognitive Sciences.

[22]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[23]  S. M. Alessi,et al.  Pathological gambling severity is associated with impulsivity in a delay discounting procedure , 2003, Behavioural Processes.

[24]  M. Dixon,et al.  Delay discounting by pathological gamblers. , 2003, Journal of applied behavior analysis.

[25]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[26]  L. Green,et al.  A discounting framework for choice with delayed and probabilistic rewards. , 2004, Psychological bulletin.

[27]  E. Wagenmakers,et al.  AIC model selection using Akaike weights , 2004, Psychonomic bulletin & review.

[28]  Gary King,et al.  What to Do When Your Hessian is Not Invertible , 2004 .

[29]  L. Green,et al.  Temporal discounting when the choice is between two delayed rewards. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[30]  T. Kalenscher,et al.  Single Units in the Pigeon Brain Integrate Reward Amount and Time-to-Reward in an Impulsive Choice Task , 2005, Current Biology.

[31]  Taiki Takahashi,et al.  Three-month stability of delay and probability discounting measures. , 2006, Experimental and clinical psychopharmacology.

[32]  R. Dolan,et al.  Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans , 2006, Nature.

[33]  H. Rachlin Notes on discounting. , 2006, Journal of the experimental analysis of behavior.

[34]  Daniel Read,et al.  Discounting by Intervals: A Generalized Model of Intertemporal Choice , 2006, Manag. Sci..

[35]  Gordon D. A. Brown,et al.  Decision by sampling , 2006, Cognitive Psychology.

[36]  D. Huber Computer simulations of the ROUSE model: An analytic simulation technique and a comparison between the error variance—covariance and bootstrap methods for estimating parameter confidence , 2006, Behavior research methods.

[37]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[38]  Jane E. J. Ebert,et al.  The Fragility of Time: Time-Insensitivity and Valuation of the Near and Far Future , 2007, Manag. Sci..

[39]  W. Bickel,et al.  Behavioral and neuroeconomics of drug addiction: competing neural systems and temporal discounting processes. , 2007, Drug and alcohol dependence.

[40]  G. Berns,et al.  Intertemporal choice – toward an integrative framework , 2007, Trends in Cognitive Sciences.

[41]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[42]  Taiki Takahashi,et al.  Psychophysics of time perception and intertemporal choice models , 2008 .

[43]  Daeyeol Lee,et al.  Prefrontal Coding of Temporally Discounted Values during Intertemporal Choice , 2008, Neuron.

[44]  Matthew W. Johnson,et al.  An algorithm for identifying nonsystematic delay-discounting data. , 2008, Experimental and clinical psychopharmacology.

[45]  M. Paulus,et al.  Decision making, impulsivity and time perception , 2008, Trends in Cognitive Sciences.

[46]  Selin A. Malkoc,et al.  Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences , 2008 .

[47]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.

[48]  D. Hommer,et al.  Delay Discounting Correlates with Proportional Lateral Frontal Cortex Volumes , 2009, Biological Psychiatry.

[49]  C. Büchel,et al.  Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making , 2009, The Journal of Neuroscience.

[50]  W. Bickel,et al.  Novel Models of Intertemporal Valuation: Past and Future Outcomes. , 2009, Journal of neuroscience, psychology, and economics.

[51]  K. Kirby One-year temporal stability of delay-discount rates , 2009, Psychonomic bulletin & review.

[52]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[53]  Brian Knutson,et al.  Dissociable neural representations of future reward magnitude and delay during temporal discounting , 2009, NeuroImage.

[54]  P. Killeen An additive-utility model of delay discounting. , 2009, Psychological review.

[55]  Peter P. Wakker,et al.  Non-hyperbolic time inconsistency , 2009, Games Econ. Behav..

[56]  L. Green,et al.  A comparison of four models of delay discounting in humans , 2009, Behavioural Processes.

[57]  Karl J. Friston,et al.  Encoding of Marginal Utility across Time in the Human Brain , 2009, The Journal of Neuroscience.

[58]  G. Zauberman,et al.  Perception of anticipatory time in temporal discounting. , 2009 .

[59]  D. Read,et al.  The psychology of intertemporal tradeoffs. , 2010, Psychological review.

[60]  Mathias Pessiglione,et al.  Separate Valuation Subsystems for Delay and Effort Decision Costs , 2010, The Journal of Neuroscience.

[61]  P. Glimcher,et al.  An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. , 2010, Journal of neurophysiology.

[62]  Hiroyuki Nakahara,et al.  Internal-Time Temporal Difference Model for Neural Value-Based Decision Making , 2010, Neural Computation.

[63]  R. Dolan,et al.  Dopamine, Time, and Impulsivity in Humans , 2010, The Journal of Neuroscience.

[64]  Jan Peters,et al.  Episodic Future Thinking Reduces Reward Delay Discounting through an Enhancement of Prefrontal-Mediotemporal Interactions , 2010, Neuron.

[65]  Eric J. Johnson,et al.  Lateral prefrontal cortex and self-control in intertemporal choice , 2010, Nature Neuroscience.

[66]  L. Green,et al.  On the scaling interpretation of exponents in hyperboloid models of delay and probability discounting , 2010, Behavioural Processes.

[67]  Simon Farrell,et al.  Computational Modeling in Cognition: Principles and Practice , 2010 .

[68]  Nathaniel D. Daw,et al.  Trial-by-trial data analysis using computational models , 2011 .

[69]  Mareike M. Menz,et al.  Lower ventral striatal activation during reward anticipation in adolescent smokers. , 2011, The American journal of psychiatry.

[70]  E. Ciaramelli,et al.  The neurobiology of intertemporal choice: insight from imaging and lesion studies , 2011, Reviews in the neurosciences.

[71]  Jan Peters,et al.  The neural mechanisms of inter-temporal decision-making: understanding variability , 2011, Trends in Cognitive Sciences.

[72]  A. Odum Delay discounting: Trait variable? , 2011, Behavioural Processes.

[73]  J. Cairns,et al.  Descriptive validity of alternative intertemporal models for health outcomes: an axiomatic test. , 2011, Health economics.

[74]  Debajyoti Ray,et al.  Positive Temporal Dependence of the Biological Clock Implies Hyperbolic Discounting , 2011, Front. Neurosci..

[75]  R. Dolan,et al.  The Known Unknowns: Neural Representation of Second-Order Uncertainty, and Ambiguity , 2011, The Journal of Neuroscience.

[76]  J. Doyle,et al.  New designs for research in delay discounting , 2011, Judgment and Decision Making.

[77]  L. Green,et al.  Domain independence and stability in young and older adults’ discounting of delayed rewards , 2011, Behavioural Processes.

[78]  Samuel M. McClure,et al.  A mechanism for reducing delay discounting by altering temporal attention. , 2011, Journal of the experimental analysis of behavior.

[79]  S. Reimers,et al.  How Incidental Values From the Environment Affect Decisions About Money, Risk, and Delay , 2011, Psychological science.

[80]  Mikhail N. Koffarnus,et al.  Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. , 2012, Pharmacology & therapeutics.

[81]  Z. Kurth-Nelson,et al.  A theoretical account of cognitive effects in delay discounting , 2012, The European journal of neuroscience.

[82]  Stephan F. Miedl,et al.  Altered neural reward representations in pathological gamblers revealed by delay and probability discounting. , 2012, Archives of general psychiatry.