Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory.

Damage to the hippocampal system disrupts recent memory but leaves remote memory intact. The account presented here suggests that memories are first stored via synaptic changes in the hippocampal system, that these changes support reinstatement of recent memories in the neocortex, that neocortical synapses change a little on each reinstatement, and that remote memory is based on accumulated neocortical changes. Models that learn via changes to connections help explain this organization. These models discover the structure in ensembles of items if learning of each item is gradual and interleaved with learning about other items. This suggests that the neocortex learns slowly to discover the structure in ensembles of experiences. The hippocampal system permits rapid learning of new items without disrupting this structure, and reinstatement of new memories interleaves them with others to integrate them into structured neocortical memory systems.

[1]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  W. James.  Psychology: Briefer Course , 2020 .

[3]  T. Ribot,et al.  The Diseases of Memory , 1906 .

[4]  J. Haldane.  The interaction of nature and nurture. , 1946, Annals of eugenics.

[5]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[6]  B. Underwood,et al.  Fate of first-list associations in transfer theory. , 1959, Journal of experimental psychology.

[7]  John Garcia,et al.  Learning with prolonged delay of reinforcement , 1966 .

[8]  Walter Dandy,et al.  The Brain , 1966 .

[9]  B. Milner.  Amnesia following operation on the temporal lobes , 1996 .

[10]  B. Milner,et al.  Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of H.M.☆ , 1968 .

[11]  Marvin Minsky,et al.  Semantic Information Processing , 1968 .

[12]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[13]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[14]  D. Marr.  A theory for cerebral neocortex , 1970, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[16]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[17]  Wayne A. Wickelgren,et al.  Trace resistance and the decay of long-term memory. , 1972 .

[18]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the unanaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[19]  Lance J. Rips,et al.  Semantic distance and the verification of semantic relations , 1973 .

[20]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[21]  L R Squire,et al.  Retrograde amnesia: temporal gradient in very long term memory following electroconvulsive therapy. , 1975, Science.

[22]  Larry R. Squire,et al.  Forgetting in very long-term memory as assessed by an improved questionnaire technique. , 1975 .

[23]  R. Douglas,et al.  Long lasting synaptic potentiation in the rat dentate gyrus following brief high frequency stimulation , 1977, Brain Research.

[24]  B. McNaughton,et al.  Synaptic enhancement in fascia dentata: Cooperativity among coactive afferents , 1978, Brain Research.

[25]  E. Warrington,et al.  Further analysis of the prior learning effect in amnesic patients , 1978, Neuropsychologia.

[26]  W A Wickelgren,et al.  Chunking and consolidation: a theoretical synthesis of semantic networks, configuring in conditioning, S--R versus congenitive learning, normal forgetting, the amnesic syndrome, and the hippocampal arousal system. , 1979, Psychological review.

[27]  G. Handelmann,et al.  Hippocampus, space, and memory , 1979 .

[28]  W. Levy,et al.  Synapses as associative memory elements in the hippocampal formation , 1979, Brain Research.

[29]  Wayne A. Wickelgren,et al.  Chunking and consolidation: A theoretical synthesis of semantic networks configuring in conditioning , 1979 .

[30]  L. Squire,et al.  Memory and amnesia: resistance to disruption develops for years after learning. , 1979, Behavioral and neural biology.

[31]  C. Barnes.  Memory deficits associated with senescence: a neurophysiological and behavioral study in the rat. , 1979, Journal of comparative and physiological psychology.

[32]  S. Gould,et al.  The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[33]  L. Squire,et al.  Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. , 1980, Science.

[34]  M. Eckardt.  The Hippocampus as a Cognitive Map , 1980 .

[35]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[36]  Charles E. Caton,et al.  Semantic and Conceptual Development: An Ontological Perspective , 1982 .

[37]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[38]  G. Collingridge,et al.  Excitatory amino acids in synaptic transmission in the Schaffer collateral‐commissural pathway of the rat hippocampus. , 1983, The Journal of physiology.

[39]  T. H. Brown,et al.  Associative long-term potentiation in hippocampal slices. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[40]  W. Seifert.  Neurobiology of the hippocampus , 1983 .

[41]  J. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  L. Nadel,et al.  The medial temporal region and memory consolidation: A new hypothesis , 2014 .

[43]  A. Ganong,et al.  Long-term potentiation in the hippocampus involves activation of N-methyl-D-aspartate receptors , 1984, Brain Research.

[44]  Herbert Weingartner,et al.  Memory consolidation : psychobiology of cognition , 1984 .

[45]  G Mandler,et al.  The information that amnesic patients do not forget. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[46]  J. Rawlins,et al.  Associations across time: The hippocampus as a temporary memory store , 1985, Behavioral and Brain Sciences.

[47]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[48]  B L McNaughton,et al.  An age comparison of the rates of acquisition and forgetting of spatial information in relation to long-term enhancement of hippocampal synapses. , 1985, Behavioral neuroscience.

[49]  James L. McClelland,et al.  Distributed memory and the representation of general and specific information. , 1985, Journal of experimental psychology. General.

[50]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation columns. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[51]  R. Linsker,et al.  From basic network principles to neural architecture , 1986 .

[52]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[53]  Daniel L. Schacter,et al.  Computer learning by memory-impaired patients: Acquisition and retention of complex knowledge , 1986, Neuropsychologia.

[54]  E Tulving,et al.  Journal of Clinical and Experimental Neuropsychology Learning and retention of computer-related vocabulary in memory-impaired patients: Method of vanishing cues , 2022 .

[55]  T. Teyler,et al.  The hippocampal memory indexing theory. , 1986, Behavioral neuroscience.

[56]  L. Squire,et al.  Human amnesia and the medial temporal region: enduring memory impairment following a bilateral lesion limited to field CA1 of the hippocampus , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation-selective cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[58]  H. Wigström,et al.  Mode of action of excitatory amino acid receptor antagonists on hippocampal long-lasting potentiation , 1986, Neuroscience.

[59]  D L Schacter,et al.  Preserved learning in amnesic patients: perspectives from research on direct priming. , 1986, Journal of clinical and experimental neuropsychology.

[60]  G. Lynch,et al.  Induction of synaptic potentiation in hippocampus by patterned stimulation involves two events. , 1986, Science.

[61]  B L McNaughton,et al.  Long-term enhancement of hippocampal synaptic transmission and the acquisition of spatial information , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[62]  D. Rumelhart.  Learning Internal Representations by Error Propagation, Parallel Distributed Processing , 1986 .

[63]  G. Lynch,et al.  Selective impairment of learning and blockade of long-term potentiation by an N-methyl-D-aspartate receptor antagonist, AP5 , 1986, Nature.

[64]  R Linsker,et al.  From basic network principles to neural architecture: emergence of spatial-opponent cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[65]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[66]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[67]  B. L. McNaughton,et al.  Suppression of hippocampal synaptic plasticity during slow-wave sleep , 1987, Brain Research.

[68]  James L. McClelland,et al.  State-Dependent Factors Influencing Neural Plasticity: A Partial Account of the Critical Period , 1987 .

[69]  David S. Touretzky,et al.  A distributed connectionist representation for concept structures , 1987 .

[70]  D. Schacter.  Implicit memory: History and current status. , 1987 .

[71]  Geoffrey E. Hinton,et al.  Learning Representations by Recirculation , 1987, NIPS.

[72]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[73]  L R Squire,et al.  A neuropsychological study of fact memory and source amnesia. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[74]  D. Schacter,et al.  Selective effects of interference on implicit and explicit memory for new associations. , 1987 .

[75]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[76]  C. Barnes.  Spatial learning and memory processes: the search for their neurobiological mechanisms in the rat , 1988, Trends in Neurosciences.

[77]  James L. McClelland,et al.  Explorations in parallel distributed processing: a handbook of models, programs, and exercises , 1988 .

[78]  Rosaleen A. McCarthy,et al.  The fractionation of retrograde amnesia , 1988, Brain and Cognition.

[79]  James L. McClelland.  Explorations In Parallel Distributed Processing , 1988 .

[80]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[81]  R. Sutherland,et al.  Configural association theory: The role of the hippocampal formation in learning, memory, and amnesia , 1989, Psychobiology.

[82]  Arthur P. Shimamura,et al.  The neurology of memory: quantitative assessment of retrograde amnesia in two groups of amnesic patients , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[83]  D. Amaral,et al.  Memory and the Hippocampus , 1989 .

[84]  L R Squire,et al.  Impaired priming of new associations in amnesia. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[85]  C. Pavlides,et al.  Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[86]  Gordon H. Bower,et al.  Computational models of learning in simple neural systems , 1989 .

[87]  L. Squire,et al.  Autobiographical memory and amnesia , 1989 .

[88]  Geoffrey E. Hinton.  Learning distributed representations of concepts. , 1989 .

[89]  D. Amaral,et al.  Lesions of perirhinal and parahippocampal cortex that spare the amygdala and hippocampal formation produce severe memory impairment , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[90]  Halbert White,et al.  Learning in Artificial Neural Networks: A Statistical Perspective , 1989, Neural Computation.

[91]  K. Miller,et al.  Ocular dominance column development: analysis and simulation. , 1989, Science.

[92]  M. Humphreys,et al.  Different Ways to Cue a Coherent Memory System: A Theory for Episodic, Semantic, and Procedural Tasks. , 1989 .

[93]  G. Buzsáki.  Two-stage model of memory trace formation: A role for “noisy” brain states , 1989, Neuroscience.

[94]  B. McNaughton,et al.  Cortical-hippocampal interactions and cognitive mapping: A hypothesis based on reintegration of the parietal and inferotemporal pathways for visual processing , 1989 .

[95]  W. Levy.  A computational approach to hippocampal function , 1989 .

[96]  D. Schacter,et al.  Modality specificity of implicit memory for new associations. , 1989 .

[97]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[98]  D L Schacter,et al.  Modality specificity of implicit memory for new associations. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[99]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[100]  R. Sutherland,et al.  The hippocampal formation is necessary for rats to learn and remember configural discriminations , 1989, Behavioural Brain Research.

[101]  L. Jarrard.  On the use of ibotenic acid to lesion selectively different components of the hippocampal formation , 1989, Journal of Neuroscience Methods.

[102]  John H. Byrne,et al.  Neural Models of Plasticity: Experimental and Theoretical Approaches , 1989 .

[103]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[104]  P. Milner.  A cell assembly theory of hippocampal amnesia , 1989, Neuropsychologia.

[105]  Daniel L. Schacter,et al.  Unitization and grouping mediate dissociations in memory for new , 1989 .

[106]  Daniel L. Schacter,et al.  Implicit memory and test awareness. , 1990 .

[107]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[108]  L. Squire,et al.  The primate hippocampal formation: evidence for a time-limited role in memory storage. , 1990, Science.

[109]  G. Winocur.  Anterograde and retrograde amnesia in rats with dorsal hippocampal or dorsomedial thalamic lesions , 1990, Behavioural Brain Research.

[110]  R. Morris.  Parallel Distributed Processing: Implications for Psychology and Neurobiology , 1990 .

[111]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[112]  G. Recanzone,et al.  Adaptive mechanisms in cortical networks underlying cortical contributions to learning and nondeclarative memory. , 1990, Cold Spring Harbor symposia on quantitative biology.

[113]  John E. Moody,et al.  Note on Learning Rate Schedules for Stochastic Optimization , 1990, NIPS.

[114]  R. Muller,et al.  The firing of hippocampal place cells in the dark depends on the rat's recent experience , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[115]  R. Morris,et al.  Ibotenate Lesions of Hippocampus and/or Subiculum: Dissociating Components of Allocentric Spatial Learning , 1990, The European journal of neuroscience.

[116]  B. McNaughton,et al.  Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. , 1990, Progress in brain research.

[117]  David E. Rumelhart,et al.  Brain style computation: learning and generalization , 1990 .

[118]  Regional variations in NMDA receptor properties—evidence for receptor isoforms Daniel T. Monaghan, University of Nebraska Medical Center, Omaha, NE 68198-6260 U.S.A. , 1990, Neurochemistry International.

[119]  Stephen José Hanson,et al.  Connectionist modeling and brain function : the developing interface , 1990 .

[120]  B. McNaughton,et al.  Hebb-Marr networks and the neurobiological representation of action in space. , 1990 .

[121]  E. Rolls.  Principles underlying the representation and storage of information in neuronal networks in the primate hippocampus and cerebral cortex , 1990 .

[122]  Robert M. French,et al.  Using Semi-Distributed Representations to Overcome Catastrophic Forgetting in Connectionist Networks , 1991 .

[123]  Michael I. Jordan,et al.  A more biologically plausible learning rule for neural networks. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[124]  David S. Touretzky,et al.  Connectionist models : proceedings of the 1990 summer school , 1991 .

[125]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[126]  Geoffrey E. Hinton,et al.  Deterministic Boltzmann Learning in Networks with Asymmetric Connectivity , 1991 .

[127]  L. Squire,et al.  Intact priming of words and nonwords in amnesia , 1991, Psychobiology.

[128]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[129]  Daniel L. Schacter,et al.  Priming and Multiple Memory Systems: Perceptual Mechanisms of Implicit Memory , 1992, Journal of Cognitive Neuroscience.

[130]  L. Squire.  Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[131]  M. Fanselow,et al.  Modality-specific retrograde amnesia of fear. , 1992, Science.

[132]  Seth J. Ramus,et al.  Intact Artificial Grammar Learning in Amnesia: Dissociation of Classification Learning and Explicit Memory for Specific Instances , 1992 .

[133]  Robert M. French,et al.  Semi-distributed Representations and Catastrophic Forgetting in Connectionist Networks , 1992 .

[134]  N. Schmajuk,et al.  Stimulus configuration, classical conditioning, and hippocampal function. , 1992, Psychological review.

[135]  L. Squire.  "Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans": Correction. , 1992 .

[136]  E. Murray,et al.  Monkeys (Macaca fascicularis) with rhinal cortex ablations succeed in object discrimination learning despite 24-hr intertrial intervals and fail at matching to sample despite double sample presentations. , 1992, Behavioral neuroscience.

[137]  William B. Levy,et al.  Predicting Complex Behavior in Sparse Asymmetric Networks , 1992, NIPS.

[138]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .

[139]  Peter M. Todd,et al.  Learning and connectionist representations , 1993 .

[140]  James L. McClelland,et al.  Generalization with Componential Attractors: Word and Nonword Reading in an Attractor Network , 1993 .

[141]  L. Jarrard.  On the role of the hippocampus in learning and memory in the rat. , 1993, Behavioral and neural biology.

[142]  Bruce L. McNaughton,et al.  Why do we have a special learning system in the hippocampus?,(Abstract 580) , 1993 .

[143]  M. McKERNAN,et al.  Hippocampal lesions do not impair negative patterning: a challenge to configural association theory. , 1993, Behavioral neuroscience.

[144]  C. Stewart,et al.  Electroconvulsive stimulation and synaptic plasticity in the rat , 1993, Brain Research.

[145]  M. Gluck,et al.  Hippocampal mediation of stimulus representation: A computational theory , 1993, Hippocampus.

[146]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[147]  Axel Cleeremans,et al.  Mechanisms of Implicit Learning: Connectionist Models of Sequence Processing , 1993 .

[148]  L. Squire,et al.  The learning of categories: parallel brain systems for item memory and category knowledge. , 1993, Science.

[149]  M. L. Howe,et al.  On resolving the enigma of infantile amnesia. , 1993, Psychological bulletin.

[150]  K. McRae,et al.  Catastrophic Interference is Eliminated in Pretrained Networks , 1993 .

[151]  Bruce L. McNaughton,et al.  Hippocampal Place Fields, the Internal Compass, and the Learning of Landmark Stability, , 1994 .

[152]  B L McNaughton,et al.  LTP saturation and spatial learning disruption: effects of task variables and saturation levels , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[153]  James L. McClelland,et al.  Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off , 1994, Hippocampus.

[154]  G. Kane.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[155]  James L. McClelland,et al.  The organization of memory. A parallel distributed processing perspective. , 1994, Revue neurologique.

[156]  P Alvarez,et al.  Memory consolidation and the medial temporal lobe: a simple network model. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[157]  Wendy A. Suzuki,et al.  What can neuroanatomy tell us about the functional components of the hippocampal memory system? , 1994, Behavioral and Brain Sciences.

[158]  E. Rolls,et al.  Computational analysis of the role of the hippocampus in memory , 1994, Hippocampus.

[159]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[160]  H. Eichenbaum,et al.  Two functional components of the hippocampal memory system , 1994, Behavioral and Brain Sciences.

[161]  Larry R. Squire,et al.  Functional distinctions within the medical temporal lobe memory system: What is the evidence? , 1994, Behavioral and Brain Sciences.

[162]  G. Buzsáki,et al.  Selective activation of deep layer (V-VI) retrohippocampal cortical neurons during hippocampal sharp waves in the behaving rat , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[163]  E. Tulving,et al.  Memory Systems 1994 , 1994 .

[164]  J. Hodges.  Memory, Amnesia and the Hippocampal System , 1995 .

[165]  D. Lavond.  Cellular and molecular mechanisms underlying higher neural functions edited by A.I. Selverston and P. Ascher, John Wiley & Sons, 1994. £65.00 (328 pages) ISBN 0 471 94304 5 , 1995, Trends in Neurosciences.

[166]  R. Sutherland,et al.  Configural association theory and the hippocampal formation: An appraisal and reconfiguration , 1995, Hippocampus.

[167]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[168]  Jonathan Baxter,et al.  Learning internal representations , 1995, COLT '95.

[169]  G. Collingridge,et al.  The NMDA Receptor , 1995 .

[170]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[171]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[172]  Jonathan D. Cohen,et al.  A preliminary theory of the interactions between prefrontal cortex and hippocampus that contribute to planning and prospective memory. , 1996 .

[173]  Alan F. Murray,et al.  IEEE International Conference on Neural Networks , 1997 .