Some Work and Some Play: Microscopic and Macroscopic Approaches to Labor and Leisure

Given the option, humans and other animals elect to distribute their time between work and leisure, rather than choosing all of one and none of the other. Traditional accounts of partial allocation have characterised behavior on a macroscopic timescale, reporting and studying the mean times spent in work or leisure. However, averaging over the more microscopic processes that govern choices is known to pose tricky theoretical problems, and also eschews any possibility of direct contact with the neural computations involved. We develop a microscopic framework, formalized as a semi-Markov decision process with possibly stochastic choices, in which subjects approximately maximise their expected returns by making momentary commitments to one or other activity. We show macroscopic utilities that arise from microscopic ones, and demonstrate how facets such as imperfect substitutability can arise in a more straightforward microscopic manner.

[1]  Sally McClean STATISTICAL ANALYSIS OF BEHAVIOURAL DATA — AN APPROACH BASED ON TIME-STRUCTURED MODELS. Patsy Haccou and Evert Meelis, Oxford University Press, 1994. No. of pages: xvii+396. Price: £21.50. ISBN: 0-19-854850-8 , 1997 .

[2]  N. Daw,et al.  Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions , 2011, Neuropsychopharmacology.

[3]  K. Arrow,et al.  Capital-labor substitution and economic efficiency , 1961 .

[4]  W M Baum,et al.  Choice as time allocation. , 1969, Journal of the experimental analysis of behavior.

[5]  E. Charnov Optimal foraging, the marginal value theorem. , 1976, Theoretical population biology.

[6]  P. Shizgal,et al.  Role of Dopamine Tone in the Pursuit of Brain Stimulation Reward , 2012, The Journal of Neuroscience.

[7]  J. J. McDowell,et al.  Falsification of matching theory's account of single-alternative responding: Herrnstein's k varies with sucrose concentration. , 2000, Journal of the experimental analysis of behavior.

[8]  P. Shizgal,et al.  Rattus Psychologicus: Construction of preferences by self-stimulating rats , 2009, Behavioural Brain Research.

[9]  Joseph T. McGuire,et al.  Effort discounting in human nucleus accumbens , 2009, Cognitive, affective & behavioral neuroscience.

[10]  David S. Touretzky,et al.  Long-Term Reward Prediction in TD Models of the Dopamine System , 2002, Neural Computation.

[11]  Peter Dayan,et al.  Some work and some play: a normative, microscopic approach to allocating time between work and leisure , 2013 .

[12]  M. Botvinick,et al.  A labor/leisure tradeoff in cognitive control. , 2014, Journal of experimental psychology. General.

[13]  W M Baum,et al.  Optimization and the matching law as accounts of instrumental behavior. , 1981, Journal of the experimental analysis of behavior.

[14]  P. Shizgal,et al.  At What Stage of Neural Processing Does Cocaine Act to Boost Pursuit of Rewards? , 2010, PloS one.

[15]  P. Shizgal,et al.  The reinforcement mountain: allocation of behavior as a function of the rate and intensity of rewarding brain stimulation. , 2008, Behavioral neuroscience.

[16]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[17]  P. Dayan Instrumental vigour in punishment and reward , 2012, The European journal of neuroscience.

[18]  J. J. McDowell On the falsifiability of matching theory. , 1986, Journal of the experimental analysis of behavior.

[19]  P. Dayan,et al.  Effort and Valuation in the Brain: The Effects of Anticipation and Execution , 2013, The Journal of Neuroscience.

[20]  A. Kacelnik,et al.  Cost can increase preference in starlings , 2002, Animal Behaviour.

[21]  D. McFadden Econometric analysis of qualitative response models , 1984 .

[22]  P Killeen,et al.  The matching law. , 1972, Journal of the experimental analysis of behavior.

[23]  W M Baum,et al.  On two types of deviation from the matching law: bias and undermatching. , 1974, Journal of the experimental analysis of behavior.

[24]  Yannick-André Breton Molar and Molecular Models of Performance for Rewarding Brain Stimulation , 2013 .

[25]  R. Blundell,et al.  Labor Supply: A Review of Alternative Approaches , 1998 .

[26]  Peter Dayan,et al.  Optimal indolence: a normative microscopic approach to work and leisure , 2014, Journal of The Royal Society Interface.

[27]  Andrew Caplin,et al.  Axiomatic Methods, Dopamine and Reward Prediction Error This Review Comes from a Themed Issue on Cognitive Neuroscience Edited Advantages of the Axiomatic Approach , 2022 .

[28]  R. C. Merton,et al.  AN INTERTEMPORAL CAPITAL ASSET PRICING MODEL , 1973 .

[29]  J. Daunizeau,et al.  Neurocomputational account of how the human brain decides when to have a break , 2013, Proceedings of the National Academy of Sciences.

[30]  J. Salamone,et al.  Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine , 2002, Behavioural Brain Research.

[31]  R. Frank Microeconomics and behavior , 1991 .

[32]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[33]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[34]  Zhiyang Jia,et al.  Theoretical and Practical Arguments for Modeling Labor Supply as a Choice Among Latent Jobs , 2012, SSRN Electronic Journal.

[35]  Peter Shizgal,et al.  Employing labor-supply theory to measure the reward value of electrical brain stimulation , 2005, Games Econ. Behav..

[36]  R J Herrnstein,et al.  Formal properties of the matching law. , 1974, Journal of the experimental analysis of behavior.

[37]  P. Shizgal,et al.  Cannabinoid Receptor Blockade Reduces the Opportunity Cost at Which Rats Maintain Operant Performance for Rewarding Brain Stimulation , 2011, The Journal of Neuroscience.

[38]  P. Glimcher,et al.  Testing the Reward Prediction Error Hypothesis with an Axiomatic Model , 2010, The Journal of Neuroscience.

[39]  J J McDowell,et al.  On the classic and modern theories of matching. , 2005, Journal of the experimental analysis of behavior.

[40]  P. Glimcher,et al.  Phasic Dopamine Release in the Rat Nucleus Accumbens Symmetrically Encodes a Reward Prediction Error Term , 2014, The Journal of Neuroscience.

[41]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[42]  Rajesh P. N. Rao Reinforcement Learning: An Introduction; R.S. Sutton, A.G. Barto (Eds.); MIT Press, Cambridge, MA, 1998, 380 pages, ISBN 0-262-19398-1, $42.00 , 2000 .

[43]  Patsy Haccou,et al.  Statistical Analysis of Behavioural Data: An Approach Based on Time-structured Models , 1992 .

[44]  T. Zentall,et al.  “work ethic” in pigeons: Reward value is directly related to the effort or time required to obtain the reward , 2000, Psychonomic bulletin & review.

[45]  Emanuel Todorov,et al.  Efficient computation of optimal actions , 2009, Proceedings of the National Academy of Sciences.