Anticipation and Choice Heuristics in the Dynamic Consumption of Pain Relief

Humans frequently need to allocate resources across multiple time-steps. Economic theory proposes that subjects do so according to a stable set of intertemporal preferences, but the computational demands of such decisions encourage the use of formally less competent heuristics. Few empirical studies have examined dynamic resource allocation decisions systematically. Here we conducted an experiment involving the dynamic consumption over approximately 15 minutes of a limited budget of relief from moderately painful stimuli. We had previously elicited the participants’ time preferences for the same painful stimuli in one-off choices, allowing us to assess self-consistency. Participants exhibited three characteristic behaviors: saving relief until the end, spreading relief across time, and early spending, of which the last was markedly less prominent. The likelihood that behavior was heuristic rather than normative is suggested by the weak correspondence between one-off and dynamic choices. We show that the consumption choices are consistent with a combination of simple heuristics involving early-spending, spreading or saving of relief until the end, with subjects predominantly exhibiting the last two.

[1]  P. Samuelson A Note on Measurement of Utility , 1937 .

[2]  R. H. Strotz Myopia and Inconsistency in Dynamic Utility Maximization , 1955 .

[3]  R Bellman,et al.  DYNAMIC PROGRAMMING AND LAGRANGE MULTIPLIERS. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[4]  H. Leland. Saving and Uncertainty: The Precautionary Demand for Saving , 1968 .

[5]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[6]  C.C. White,et al.  Dynamic programming and stochastic control , 1978, Proceedings of the IEEE.

[7]  G. Loewenstein Anticipation and the Valuation of Delayed Consumption , 1987 .

[8]  J. E. Mazur An adjusting procedure for studying delayed reinforcement. , 1987 .

[9]  Stephen M. Johnson,et al.  Can People Compute? an Experimental Test of the Life Cycle Consumption Model , 1987 .

[10]  John Rust A Dynamic Programming Model of Retirement Behavior , 1987 .

[11]  J. Baron Thinking and Deciding , 2023 .

[12]  G. Loewenstein,et al.  Do Workers Prefer Increasing Wage Profiles? , 1991, Journal of Labor Economics.

[13]  D. Prelec,et al.  Negative Time Preference , 1991 .

[14]  D. Kahneman,et al.  Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias , 1991 .

[15]  J. Elster,et al.  Utility from memory and anticipation. , 1992 .

[16]  G. Loewenstein,et al.  Anomalies in Intertemporal Choice: Evidence and an Interpretation , 1992 .

[17]  R. Herrnstein,et al.  Preference Reversals Due to Myopic Discounting of Delayed Reward , 1995 .

[18]  G. Chapman Expectations and Preferences for Sequences of Health and Money , 1996 .

[19]  David I. Laibson,et al.  Golden Eggs and Hyperbolic Discounting , 1997 .

[20]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[21]  G. Loewenstein,et al.  Mixing virtue and vice: combining the immediacy effect and the diversification heuristic , 1999 .

[22]  H. Uhlig,et al.  Rules of Thumb versus Dynamic Programming , 1999 .

[23]  G. Chapman Preferences for improving and declining sequences of health outcomes , 2000 .

[24]  J. Cairns,et al.  Negative and zero time preference for health. , 2000, Health economics.

[25]  G. Ainslie Breakdown of will , 2001 .

[26]  D. Read Is Time-Discounting Hyperbolic or Subadditive? , 2001 .

[27]  G. Angeletos,et al.  The Hyperbolic Consumption Model: Calibration, Simulation, and Empirical Evaluation , 2022 .

[28]  M. El-Sabaawi Breakdown of Will , 2002 .

[29]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[30]  D. Ariely,et al.  Procrastination, Deadlines, and Performance: Self-Control by Precommitment , 2002, Psychological science.

[31]  Ted O’Donoghue,et al.  Self-awareness and self-control , 2003 .

[32]  A. Rubinstein International Economic Review " Economics and Psychology " ? the Case of Hyperbolic Discounting * , 2003 .

[33]  G. Loewenstein,et al.  Time and Decision: Economic and Psychological Perspectives of Intertemporal Choice , 2003 .

[34]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[35]  James L. McClelland,et al.  Loss aversion and inhibition in dynamical models of multialternative choice. , 2004, Psychological review.

[36]  G. Loewenstein,et al.  Preferences for sequences of outcomes. , 1993 .

[37]  G. Pagnoni,et al.  Neurobiological Substrates of Dread , 2006, Science.

[38]  Tony O’Hagan Bayes factors , 2006 .

[39]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[40]  Samuel M. McClure,et al.  Time Discounting for Primary Rewards , 2007, The Journal of Neuroscience.

[41]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[42]  R. Thaler,et al.  Heuristics and Biases in Retirement Savings Behavior , 2007 .

[43]  G. Loewenstein,et al.  Conflicting motives in evaluations of sequences , 2008 .

[44]  K. Holland Proposed changes for nurse education in England (UK) as a result of the Darzi report (DoH, 2008a) Health Quality Care for All--NHS next stage review final report: some initial observations. , 2008, Nurse education in practice.

[45]  R. Elliott,et al.  Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans , 2008, The European journal of neuroscience.

[46]  Gerd Gigerenzer,et al.  Why Heuristics Work , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[47]  C. Pennartz,et al.  Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making , 2008, Progress in Neurobiology.

[48]  N. Chater,et al.  The Price of Pain and the Value of Suffering , 2009, Psychological science.

[49]  P. Dayan Prospective and retrospective temporal difference learning , 2009, Network.

[50]  P. Glimcher,et al.  An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. , 2010, Journal of neurophysiology.

[51]  Z. Kurth-Nelson,et al.  A Reinforcement Learning Model of Precommitment in Decision Making , 2010, Front. Behav. Neurosci..

[52]  M. Munafo,et al.  Delayed reward discounting and addictive behavior: a meta-analysis , 2011, Psychopharmacology.

[53]  Marco Casari,et al.  On Negative Time Preference , 2010 .

[54]  Mikhail N. Koffarnus,et al.  Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. , 2012, Pharmacology & therapeutics.

[55]  P. Dolan,et al.  Evaluation of the personal health budget pilot programme , 2012 .

[56]  S. Frederick,et al.  Four days later in Cincinnati: longitudinal tests of hyperbolic discounting. , 2012, Acta psychologica.

[57]  P. Tobler,et al.  Restricting Temptations: Neural Mechanisms of Precommitment , 2013, Neuron.

[58]  Raymond J. Dolan,et al.  Dread and the Disvalue of Future Pain , 2013, PLoS Comput. Biol..

[59]  Mikhail N. Koffarnus,et al.  The behavioral- and neuro-economic process of temporal discounting: A candidate behavioral marker of addiction , 2014, Neuropharmacology.

[60]  Giles W. Story,et al.  Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective , 2014, Front. Behav. Neurosci..

[61]  R. Hertwig,et al.  Heuristics: The Foundations of Adaptive Behavior , 2015 .

[62]  Shanefrederick,et al.  Time Discounting and Time Preference : A Critical Review , 2022 .