Integrating incremental learning and episodic memory models of the hippocampal region.

By integrating previous computational models of corticohippocampal function, the authors develop and test a unified theory of the neural substrates of familiarity, recollection, and classical conditioning. This approach integrates models from 2 traditions of hippocampal modeling, those of episodic memory and incremental learning, by drawing on an earlier mathematical model of conditioning, SOP (A. Wagner, 1981). The model describes how a familiarity signal may arise from parahippocampal cortices, giving a novel explanation for the finding that the neural response to a stimulus in these regions decreases with increasing stimulus familiarity. Recollection is ascribed to the hippocampus proper. It is shown how the properties of episodic representations in the neocortex, parahippocampal gyrus, and hippocampus proper may explain phenomena in classical conditioning. The model reproduces the effects of hippocampal, septal, and broad hippocampal region lesions on contextual modulation of classical conditioning, blocking, learned irrelevance, and latent inhibition.

[1]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[3]  R. Lubow,et al.  Latent inhibition: the effect of nonreinforced pre-exposure to the conditional stimulus. , 1959, Journal of comparative and physiological psychology.

[4]  L. Kamin Predictability, surprise, attention, and conditioning , 1967 .

[5]  B. Campbell,et al.  Punishment and aversive behavior , 1969 .

[6]  G. Frommer,et al.  Effects of CS preexposures on avoidance learning in rats with hippocampal lesions. , 1969, Journal of comparative and physiological psychology.

[7]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  J. Theios,et al.  Acquisition and extinction of a classically conditioned response in hippocampectomized rabbits (Oryctolagus cuniculus). , 1972, Journal of comparative and physiological psychology.

[9]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[10]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[11]  N. J. Mackintosh,et al.  Stimulus selection: Learning to ignore stimuli that predict no change in reinforcement. , 1973 .

[12]  Richard C. Atkinson,et al.  Search and decision processes in recognition memory. , 1974 .

[13]  Robert Bolles,et al.  Constraints on Learning: Limitations and Predispositions , 1974 .

[14]  J J Miller,et al.  The hippocampal control of neuronal discharges in the septum of the rat , 1974, The Journal of physiology.

[15]  N. Mackintosh A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[16]  P. Suppes,et al.  Contemporary Developments in Mathematical Psychology , 1976 .

[17]  JOHN W. Moore,et al.  Central cholinergic blockade by scopolamine and habituation, classical conditioning, and latent inhibition of the rabbit’s nictitating membrane response , 1976 .

[18]  Richard F. Thompson,et al.  Neuronal plasticity in the limbic system during classical conditioning of the rabbit nictitating membrane response. I. The hippocampus , 1978, Brain Research.

[19]  Richard F. Thompson,et al.  Neuronal plasticity in the limbic system during classical conditioning of the rabbit nictitating membrane response. II: Septum and mammillary bodies , 1978, Brain Research.

[20]  L. Aitkin,et al.  Acoustic input to the lateral pontine nuclei , 1978, Hearing Research.

[21]  J. O’Keefe A review of the hippocampal place cells , 1979, Progress in Neurobiology.

[22]  G. Mandler Recognizing: The judgment of previous occurrence. , 1980 .

[23]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[24]  J. Eccles The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.

[25]  H. Terrace,et al.  Autoshaping and Conditioning Theory , 1980 .

[26]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[27]  Ralph R. Miller,et al.  Information processing in animals : memory mechanisms , 1983 .

[28]  L. Nadel,et al.  The medial temporal region and memory consolidation: A new hypothesis , 2014 .

[29]  T. Teyler,et al.  The hippocampal memory indexing theory. , 1986, Behavioral neuroscience.

[30]  T W Berger,et al.  Lesions of the retrosplenial cortex produce deficits in reversal learning of the rabbit nictitating membrane response: implications for potential interactions between hippocampal and cerebellar brain systems. , 1986, Behavioral neuroscience.

[31]  R. F. Thompson,et al.  Modeling the neural substrates of associative learning and memory: a computational approach. , 1987, Psychological review.

[32]  Richard F. Thompson,et al.  Modeling the Neural Substrates of Associative Learning and Memory: A Computational Approach , 1987 .

[33]  Ralph R. Miller,et al.  The comparator hypothesis: A response rule for the expression of associations. , 1988 .

[34]  R. Sutherland,et al.  Configural association theory: The role of the hippocampal formation in learning, memory, and amnesia , 1989, Psychobiology.

[35]  [Hippocampus-cerebellar cortex-cerebellar nuclei projection in the rat: electrophysiological and HRP studies]. , 1989, Sheng li xue bao : [Acta physiologica Sinica].

[36]  M. Humphreys,et al.  Different Ways to Cue a Coherent Memory System: A Theory for Episodic, Semantic, and Procedural Tasks. , 1989 .

[37]  C. Köhler,et al.  Subicular projections to the hypothalamus and brainstem: some novel aspects revealed in the rat by the anterograde Phaseolus vulgaris leukoagglutinin (PHA-L) tracing method. , 1990, Progress in brain research.

[38]  P. May,et al.  Neuronal connections between the cerebellar nuclei and hypothalamus in Macaca fascicularis: Cerebello‐visceral circuits , 1990, The Journal of comparative neurology.

[39]  N. Mackintosh,et al.  Perceptual Learning in Flavour Aversion Conditioning , 1991, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[40]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[41]  永福 智志 The Organization of Learning , 2005, Journal of Cognitive Neuroscience.

[42]  Hippocampus, context, and conditioning. , 1991, Behavioral neuroscience.

[43]  H. Eichenbaum The Hippocampal System and Declarative Memory in Animals , 1992, Journal of Cognitive Neuroscience.

[44]  R. Shiffrin,et al.  Models for recall and recognition. , 1992, Annual review of psychology.

[45]  N. Schmajuk,et al.  Stimulus configuration, classical conditioning, and hippocampal function. , 1992, Psychological review.

[46]  Bryan J. Travis,et al.  A Computational Model of the Cerebellum , 1992 .

[47]  M. Merzenich,et al.  Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  M. Hasselmo,et al.  Acetylcholine and memory , 1993, Trends in Neurosciences.

[49]  M. McKERNAN,et al.  Hippocampal lesions do not impair negative patterning: a challenge to configural association theory. , 1993, Behavioral neuroscience.

[50]  M. Gluck,et al.  Hippocampal mediation of stimulus representation: A computational theory , 1993, Hippocampus.

[51]  R. Desimone,et al.  The representation of stimulus familiarity in anterior inferior temporal cortex. , 1993, Journal of neurophysiology.

[52]  J. Ogden,et al.  Visual object agnosia, prosopagnosia, achromatopsia, loss of visual imagery, and autobiographical amnesia following recovery from cortical blindness: Case M.H. , 1993, Neuropsychologia.

[53]  R. C. Honey,et al.  Selective hippocampal lesions abolish the contextual specificity of latent inhibition and conditioning. , 1993, Behavioral neuroscience.

[54]  Michael E. Hasselmo,et al.  Runaway synaptic modification in models of cortex: Implications for Alzheimer's disease , 1994, Neural Networks.

[55]  M. Gluck,et al.  Context, conditioning, and hippocampal rerepresentation in animal learning. , 1994, Behavioral neuroscience.

[56]  L. Squire,et al.  Retrograde amnesia and memory consolidation: a neurobiological perspective , 1995, Current Opinion in Neurobiology.

[57]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[58]  L. Jarrard What does the hippocampus really do? , 1995, Behavioural Brain Research.

[59]  R. Sutherland,et al.  Configural association theory and the hippocampal formation: An appraisal and reconfiguration , 1995, Hippocampus.

[60]  J W Rudy,et al.  A comparison of kainic acid plus colchicine and ibotenic acid-induced hippocampal formation damage on four configural tasks in rats. , 1995, Behavioral neuroscience.

[61]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[62]  M. Gallagher,et al.  Hippocampal lesions disrupt decrements but not increments in conditioned stimulus processing , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  M. Gluck,et al.  Dissociation of hippocampal and entorhinal function in associative learning: A computational approach , 1995, Psychobiology.

[64]  Geoffrey Hall,et al.  Perceptual learning in flavor aversion conditioning: Roles of stimulus comparison and latent inhibition of common stimulus elements☆ , 1995 .

[65]  M. Mustari,et al.  Transneuronal pathways to the vestibulocerebellum , 1996, The Journal of comparative neurology.

[66]  M. Witter,et al.  Entorhinal-Hippocampal Interactions Revealed by Real-Time Imaging , 1996, Science.

[67]  M. Hasselmo,et al.  A Computational Model of Cholinergic Disruption of Septohippocampal Activity in Classical Eyeblink Conditioning , 1996, Neurobiology of Learning and Memory.

[68]  M. Gluck,et al.  Cortico-hippocampal representations in simultaneous odor discrimination: a computational interpretation of Eichenbaum, Mathews, and Cohen (1989). , 1996, Behavioral neuroscience.

[69]  J. Murre TraceLink: A model of amnesia and consolidation of memory , 1996, Hippocampus.

[70]  M. Gutnick,et al.  Slow inactivation of Na+ current and slow cumulative spike adaptation in mouse and guinea‐pig neocortical neurones in slices. , 1996, The Journal of physiology.

[71]  D. Amaral,et al.  Cholinergic innervation of the primate hippocampal formation: II. Effects of fimbria/fornix transection , 1996, The Journal of comparative neurology.

[72]  D. Amaral,et al.  Three Cases of Enduring Memory Impairment after Bilateral Damage Limited to the Hippocampal Formation , 2022 .

[73]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[74]  James L. McClelland,et al.  Considerations arising from a complementary learning systems perspective on hippocampus and neocortex , 1996, Hippocampus.

[75]  M. W. Brown,et al.  Differential activation of the rat hippocampus and perirhinal cortex by novel visual stimuli and a novel environment , 1997, Neuroscience Letters.

[76]  L. Nadel,et al.  Memory consolidation, retrograde amnesia and the hippocampal complex , 1997, Current Opinion in Neurobiology.

[77]  R. Desimone,et al.  Object and place memory in the macaque entorhinal cortex. , 1997, Journal of neurophysiology.

[78]  H. Eichenbaum,et al.  The hippocampus and memory for orderly stimulus relations. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[79]  Mark O West,et al.  Operant behavior during sessions of intravenous cocaine infusion is necessary and sufficient for phasic firing of single nucleus accumbens neurons , 1997, Brain Research.

[80]  M. Hasselmo,et al.  Free recall and recognition in a network model of the hippocampus: simulating effects of scopolamine on human memory function , 1997, Behavioural Brain Research.

[81]  P. Reber,et al.  Contrasting cortical activity associated with category memory and recognition memory. , 1998, Learning & memory.

[82]  R. F. Thompson,et al.  Inhibitory cerebello-olivary projections and blocking effect in classical conditioning. , 1998, Science.

[83]  M. Farah,et al.  What is "special" about face perception? , 1998, Psychological review.

[84]  O. Vinogradova,et al.  Pacemaker neurons of the forebrain medical septal area and theta rhythm of the hippocampus. , 1998 .

[85]  M. Fanselow,et al.  Pavlovian Conditioning, Negative Feedback, and Blocking: Mechanisms that Regulate Association Formation , 1998, Neuron.

[86]  L R Squire,et al.  Retrograde Amnesia for Facts and Events: Findings from Four New Cases , 1998, The Journal of Neuroscience.

[87]  J. Steinmetz The Localization of a Simple Type of Learning and Memory , 1998 .

[88]  M. W. Brown,et al.  Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe , 1998, Neuropharmacology.

[89]  I. Robertson,et al.  Rehabilitation of brain damage: brain plasticity and principles of guided recovery. , 1999, Psychological bulletin.

[90]  K. Malmberg,et al.  Context-dependent recognition memory: the ICE theory. , 1999, Journal of experimental psychology. General.

[91]  M. W. Brown,et al.  Episodic memory, amnesia, and the hippocampal–anterior thalamic axis , 1999, Behavioral and Brain Sciences.

[92]  Robert E. Clark,et al.  Human Eyeblink Classical Conditioning: Effects of Manipulating Awareness of the Stimulus Contingencies , 1999 .

[93]  G Buzsáki,et al.  Interactions between Hippocampus and Medial Septum during Sharp Waves and Theta Oscillation in the Behaving Rat , 1999, The Journal of Neuroscience.

[94]  M. Hasselmo Neuromodulation: acetylcholine and memory consolidation , 1999, Trends in Cognitive Sciences.

[95]  Pankaj Sah,et al.  Photolytic Manipulation of [Ca2+]iReveals Slow Kinetics of Potassium Channels Underlying the Afterhyperpolarization in Hipppocampal Pyramidal Neurons , 1999, The Journal of Neuroscience.

[96]  M. Gallagher,et al.  Blocking can occur without losses in attention in rats with selective removal of hippocampal cholinergic input. , 1999, Behavioral neuroscience.

[97]  Victor A. F. Lamme,et al.  Separate processing dynamics for texture elements, boundaries and surfaces in primary visual cortex of the macaque monkey. , 1999, Cerebral cortex.

[98]  W. Scoville,et al.  Loss of Recent Memory After Bilateral Hippocampal Lesions , 2000 .

[99]  L. Nadel,et al.  Multiple trace theory of human memory: Computational, neuroimaging, and neuropsychological results , 2000, Hippocampus.

[100]  M. Hasselmo,et al.  A model for experience-dependent changes in the responses of inferotemporal neurons , 2000, Network.

[101]  M. Witter,et al.  Anatomical Organization of the Parahippocampal‐Hippocampal Network , 2000, Annals of the New York Academy of Sciences.

[102]  Catherine E. Myers,et al.  Gateway to Memory: An Introduction to Neural Network Modeling of the Hippocampus and Learning , 2000 .

[103]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[104]  John J. B. Allen,et al.  Memory Deficits Characterized by Patterns of Lesions to the Hippocampus and Parahippocampal Cortex , 2000, Annals of the New York Academy of Sciences.

[105]  H. Scharfman,et al.  The parahippocampal region. Implications for neurological and psychiatric diseases. Introduction. , 2000, Annals of the New York Academy of Sciences.

[106]  M. Fanselow Contextual fear, gestalt memories, and the hippocampus , 2000, Behavioural Brain Research.

[107]  M. Bouton,et al.  The effects of neurotoxic hippocampal lesions on two effects of context after fear extinction. , 2000, Behavioral neuroscience.

[108]  R. O’Reilly,et al.  Computational principles of learning in the neocortex and hippocampus , 2000, Hippocampus.

[109]  J. T. Erichsen,et al.  Fos Imaging Reveals Differential Patterns of Hippocampal and Parahippocampal Subfield Activation in Rats in Response to Different Spatial Memory Tests , 2000, The Journal of Neuroscience.

[110]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[111]  H Eichenbaum,et al.  Hippocampus: Mapping or memory? , 2000, Current Biology.

[112]  M. Gluck,et al.  Dissociating entorhinal and hippocampal involvement in latent inhibition. , 2000, Behavioral neuroscience.

[113]  Catherine E. Myers,et al.  Cerebellar Substrates for Error Correction in Motor Conditioning , 2001, Neurobiology of Learning and Memory.

[114]  R. O’Reilly,et al.  Conjunctive representations in learning and memory: principles of cortical and hippocampal function. , 2001, Psychological review.

[115]  J. Peirce,et al.  Sheep don't forget a face , 2001, Nature.

[116]  J. Pearce,et al.  Theories of associative learning in animals. , 2001, Annual review of psychology.

[117]  Paul E. Gilbert,et al.  Dissociating hippocampal subregions: A double dissociation between dentate gyrus and CA1 , 2001, Hippocampus.

[118]  Joseph R. Manns,et al.  Trace and Delay Eyeblink Conditioning: Contrasting Phenomena of Declarative and Nondeclarative Memory , 2001, Psychological science.

[119]  A. Yonelinas Components of episodic memory: the contribution of recollection and familiarity. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[120]  Steven M. Smith,et al.  Environmental context-dependent memory: A review and meta-analysis , 2001, Psychonomic bulletin & review.

[121]  Greg D. Gale,et al.  Hippocampus and contextual fear conditioning: Recent controversies and advances , 2001, Hippocampus.

[122]  O. Hikosaka,et al.  A neural correlate of response bias in monkey caudate nucleus , 2002, Nature.

[123]  W. Macken Environmental context and recognition: the role of recollection and familiarity. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[124]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[125]  M. Gluck,et al.  A connectionist model of septohippocampal dynamics during conditioning: closing the loop. , 2002, Behavioral neuroscience.

[126]  Mark A. Gluck,et al.  Selective entorhinal and nonselective cortical-hippocampal region lesions, but not selective hippocampal lesions, disrupt learned irrelevance in rabbit eyeblink conditioning , 2002, Cognitive, affective & behavioral neuroscience.

[127]  Catherine E. Myers,et al.  Selective hippocampal lesions disrupt a novel cue effect but fail to eliminate blocking in rabbit eyeblink conditioning , 2002, Cognitive, affective & behavioral neuroscience.

[128]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[129]  M. Gluck,et al.  Ibotenic acid lesions of the medial septum retard delay eyeblink conditioning in rabbits (Oryctolagus cuniculus). , 2002, Behavioral neuroscience.

[130]  A. Yonelinas The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[131]  Rafal Bogacz,et al.  The restricted influence of sparseness of coding on the capacity of familiarity discrimination networks , 2002, Network.

[132]  M. Meeter,et al.  A computational approach to memory deficits in schizophrenia , 2002, Neurocomputing.

[133]  Rafal Bogacz,et al.  Comparison of computational models of familiarity discrimination in the perirhinal cortex , 2003, Hippocampus.

[134]  Mark J. Thomas,et al.  Synaptic plasticity in the mesolimbic dopamine system. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[135]  Richard F. Thompson,et al.  Inhibiting the Expression of a Classically Conditioned Behavior Prevents Its Extinction , 2003, The Journal of Neuroscience.

[136]  M. Gluck,et al.  Computational models of the hippocampal region: linking incremental learning and episodic memory , 2003, Trends in Cognitive Sciences.

[137]  Jason P. Mitchell,et al.  Multiple routes to memory: Distinct medial temporal lobe processes build item and source memories , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[138]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[139]  M. Shapiro,et al.  Prospective and Retrospective Memory Coding in the Hippocampus , 2003, Neuron.

[140]  Wendy A. McKenzie,et al.  Context effects in recognition memory: The role of familiarity and recollection , 2004, Consciousness and Cognition.

[141]  M Meeter,et al.  Mode shifting between storage and recall based on novelty detection in oscillating hippocampal circuits , 2004, Hippocampus.

[142]  Sabrina M. Tom,et al.  Dissociable correlates of recollection and familiarity within the medial temporal lobes , 2004, Neuropsychologia.

[143]  Martijn Meeter,et al.  Consolidation of long-term memory: evidence and alternatives. , 2004, Psychological bulletin.

[144]  Rafal Bogacz,et al.  Model of Familiarity Discrimination in the Perirhinal Cortex , 2004, Journal of Computational Neuroscience.

[145]  S. Tsujimoto,et al.  Properties of delay‐period neuronal activity in the primate prefrontal cortex during memory‐ and sensory‐guided saccade tasks , 2004, The European journal of neuroscience.