Rational use of Episodic and Working Memory: A Normative Account of Prospective Memory

Humans often simultaneously pursue multiple plans at different time scales. The successful realization of non-immediate plans (e.g., post package after work) requires keeping track of a future plan while accomplishing other intermediate tasks (e.g., write a paper), a capacity known as prospective memory. This capacity requires the integration of noisy evidence from perceptual input with evidence from short-term working memory (WM) and longer-term or episodic memory (LTM/EM). Here we formulate a set of dual-task problems in empirical studies of prospective memory as problems of computational rationality, and ask how a rational model should exploit noisy perception and memory to maximize payoffs. The model combines reinforcement learning (optimal action selection) with evidence accumulation (optimal inference) in order to derive good decision parameters for optimal task performance (i.e., performing an ongoing task while monitoring for a cue that triggers executing a second prospective task). We compare model behavior to key accuracy and reaction time phenomena in human performance. Thus, we offer a normative approach to theorizing and modeling these phenomena without assumptions about mechanisms of attention or retrieval. This approach can be extended to study meta-parameters governing the boundedly rational use of memory in planned action in health, as well as compensatory mnemonic strategies that may be rational responses to disturbances of these mechanisms in neuropsychiatric disorders.

[1]  Montague Ullman The Role of Imagery , 1975 .

[2]  John R. Anderson A spreading activation theory of memory. , 1983 .

[3]  P. Gollwitzer Action phases and mind-sets , 1990 .

[4]  E. Higgins,et al.  Handbook of motivation and cognition : foundations of social behavior , 1991 .

[5]  Devika Subramanian,et al.  Provably Bounded Optimal Agents , 1993, IJCAI.

[6]  R. O’Reilly,et al.  A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challenges. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[7]  P. Gollwitzer,et al.  Implementation intentions and effective goal pursuit , 1997 .

[8]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[9]  R. Shiffrin Modeling memory and perception , 2003 .

[10]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[11]  M. Lee,et al.  Evidence accumulation in decision making: Unifying the “take the best” and the “rational” models , 2004, Psychonomic bulletin & review.

[12]  M. McDaniel,et al.  Prospective Memory , 2005 .

[13]  M. McDaniel,et al.  Multiple processes in prospective memory retrieval: factors determining monitoring versus spontaneous retrieval. , 2005, Journal of experimental psychology. General.

[14]  K. M. Butler,et al.  Implementation intentions facilitate prospective memory under high attention demands , 2008, Memory & cognition.

[15]  Richard L. Lewis,et al.  Rational adaptation under task and processing constraints: implications for testing theories of cognition and action. , 2009, Psychological review.

[16]  Gene A. Brewer,et al.  On the role of episodic future simulation in encoding of prospective memories , 2010, Cognitive neuroscience.

[17]  Gene A. Brewer,et al.  On the role of imagery in event-based prospective memory , 2011, Consciousness and Cognition.

[18]  S. Gilbert Decoding the Content of Delayed Intentions , 2011, The Journal of Neuroscience.

[19]  John-Dylan Haynes,et al.  Human anterior prefrontal cortex encodes the ‘what’ and ‘when’ of future intentions , 2012, NeuroImage.

[20]  E. Glisky,et al.  Implementation intentions and imagery: individual and combined effects on prospective memory among young adults , 2011, Memory & Cognition.

[21]  M. McDaniel,et al.  Whoops, I did it again: commission errors in prospective memory. , 2012, Psychology and aging.

[22]  Shayne Loft,et al.  Wait a second: Brief delays in responding reduce focality effects in event-based prospective memory , 2013, Quarterly journal of experimental psychology.

[23]  I. Momennejad,et al.  Encoding of Prospective Tasks in the Human Prefrontal Cortex under Varying Task Loads , 2013, The Journal of Neuroscience.

[24]  C. Dodson,et al.  Negative prospective memory: Remembering not to perform an action , 2013, Psychonomic bulletin & review.

[25]  Satinder Singh,et al.  Computational Rationality: Linking Mechanism and Behavior Through Bounded Utility Maximization , 2014, Top. Cogn. Sci..

[26]  Po-Hsuan Chen,et al.  A Reduced-Dimension fMRI Shared Response Model , 2015, NIPS.

[27]  Phoebe E. Bailey,et al.  Future thinking improves prospective memory performance and plan enactment in older adults , 2015, Quarterly journal of experimental psychology.

[28]  Beat Meier,et al.  Loads and loads and loads: the influence of prospective load, retrospective load, and ongoing task load in prospective memory , 2015, Front. Hum. Neurosci..

[29]  Shayne Loft,et al.  Slow down and remember to remember! A delay theory of prospective memory costs. , 2015, Psychological review.

[30]  Jarrod A. Lewis-Peacock,et al.  Neural evidence of the strategic choice between working memory and episodic memory in prospective remembering , 2016, Neuropsychologia.

[31]  Shayne Loft,et al.  Accumulating Evidence About What Prospective Memory Costs Actually Reveal , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[32]  M. Altgassen,et al.  Future thinking instructions improve prospective memory performance in adolescents , 2017, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[33]  Shayne Loft,et al.  Racing to Remember: A Theory of Decision Control in Event-Based Prospective Memory , 2018, Psychological review.

[34]  Shayne Loft,et al.  Prospective memory in the red zone: Cognitive control and capacity sharing in a complex, multi-stimulus task. , 2019, Journal of experimental psychology. Applied.