Optimal Recall from Bounded Metaplastic Synapses: Predicting Functional Adaptations in Hippocampal Area CA3

A venerable history of classical work on autoassociative memory has significantly shaped our understanding of several features of the hippocampus, and most prominently of its CA3 area, in relation to memory storage and retrieval. However, existing theories of hippocampal memory processing ignore a key biological constraint affecting memory storage in neural circuits: the bounded dynamical range of synapses. Recent treatments based on the notion of metaplasticity provide a powerful model for individual bounded synapses; however, their implications for the ability of the hippocampus to retrieve memories well and the dynamics of neurons associated with that retrieval are both unknown. Here, we develop a theoretical framework for memory storage and recall with bounded synapses. We formulate the recall of a previously stored pattern from a noisy recall cue and limited-capacity (and therefore lossy) synapses as a probabilistic inference problem, and derive neural dynamics that implement approximate inference algorithms to solve this problem efficiently. In particular, for binary synapses with metaplastic states, we demonstrate for the first time that memories can be efficiently read out with biologically plausible network dynamics that are completely constrained by the synaptic plasticity rule, and the statistics of the stored patterns and of the recall cue. Our theory organises into a coherent framework a wide range of existing data about the regulation of excitability, feedback inhibition, and network oscillations in area CA3, and makes novel and directly testable predictions that can guide future experiments.

[1]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[2]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[3]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[7]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[8]  Sompolinsky,et al.  Information storage in neural networks with low levels of activity. , 1987, Physical review. A, General physics.

[9]  Anthony Y. C. Kuk,et al.  Estimation of distribution functions and medians under sampling with unequal probabilities , 1988 .

[10]  R. Miles,et al.  Synaptic excitation of inhibitory cells by single CA3 hippocampal pyramidal cells of the guinea‐pig in vitro. , 1990, The Journal of physiology.

[11]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[12]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[13]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[14]  D. J. C. MacKay Maximum Entropy Connections: Neural Networks , 1991 .

[15]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[16]  M. Hasselmo,et al.  Acetylcholine and memory , 1993, Trends in Neurosciences.

[17]  D. Amaral Emerging principles of intrinsic hippocampal organization , 1993, Current Opinion in Neurobiology.

[18]  Daniel J. Amit,et al.  Learning in Neural Networks with Material Synapses , 1994, Neural Computation.

[19]  E. Rolls,et al.  Computational analysis of the role of the hippocampus in memory , 1994, Hippocampus.

[20]  A. Treves,et al.  How much of the hippocampus can be explained by functional constraints? , 1996, Hippocampus.

[21]  Radford M. Neal Sampling from multimodal distributions using tempered transitions , 1996, Stat. Comput..

[22]  S. Tonegawa,et al.  The Essential Role of Hippocampal CA1 NMDA Receptor–Dependent Synaptic Plasticity in Spatial Memory , 1996, Cell.

[23]  G. Buzsáki,et al.  Gamma Oscillation by Synaptic Inhibition in a Hippocampal Interneuronal Network Model , 1996, The Journal of Neuroscience.

[24]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[25]  G. Buzsáki,et al.  Interneurons of the hippocampus , 1998, Hippocampus.

[26]  J F Disterhoft,et al.  Transient changes in excitability of rabbit CA3 neurons with a time course appropriate to support memory consolidation. , 1996, Journal of neurophysiology.

[27]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[28]  Michael E. Hasselmo,et al.  Changes in GABAB Modulation During a Theta Cycle May Be Analogous to the Fall of Temperature During Annealing , 1998, Neural Computation.

[29]  Peter Dayan,et al.  Bayesian retrieval in associative memories with storage errors , 1998, IEEE Trans. Neural Networks.

[30]  D. Debanne,et al.  Heterogeneity of Synaptic Plasticity at Unitary CA3–CA1 and CA3–CA3 Connections in Rat Hippocampal Slice Cultures , 1999, The Journal of Neuroscience.

[31]  Niraj S. Desai,et al.  Plasticity in the intrinsic excitability of cortical pyramidal neurons , 1999, Nature Neuroscience.

[32]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[33]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[34]  M. Hasselmo,et al.  Size of CA1-evoked synaptic potentials is related to theta rhythm phase in rat hippocampus. , 2000, Journal of neurophysiology.

[35]  John F. Disterhoft,et al.  Increased Excitability of Aged Rabbit CA1 Neurons after Trace Eyeblink Conditioning , 2000, The Journal of Neuroscience.

[36]  M. Poo,et al.  Enhancement of presynaptic neuronal excitability by correlated presynaptic and postsynaptic spiking , 2000, Nature Neuroscience.

[37]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[38]  Yukito Iba EXTENDED ENSEMBLE MONTE CARLO , 2001 .

[39]  Aapo Hyvärinen,et al.  Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior , 2002, NIPS.

[40]  M. Quirk,et al.  Requirement for Hippocampal CA3 NMDA Receptors in Associative Memory Recall , 2002, Science.

[41]  Urs Gerber,et al.  Slow feedback inhibition in the Ca3 area of the rat hippocampus by synergistic synaptic activation of mGluR1 and mGluR5 , 2002, The Journal of physiology.

[42]  J. Csicsvari,et al.  Mechanisms of Gamma Oscillations in the Hippocampus of the Behaving Rat , 2003, Neuron.

[43]  J. D. Smith,et al.  The comparative psychology of uncertainty monitoring and metacognition. , 2003, The Behavioral and brain sciences.

[44]  P. Somogyi,et al.  Brain-state- and cell-type-specific firing of hippocampal interneurons in vivo , 2003, Nature.

[45]  H. Spiers,et al.  Prefrontal and medial temporal lobe interactions in long-term memory , 2003, Nature Reviews Neuroscience.

[46]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[47]  D. Linden,et al.  The other side of the engram: experience-driven changes in neuronal intrinsic excitability , 2003, Nature Reviews Neuroscience.

[48]  G. Buzsáki,et al.  Place Representation within Hippocampal Networks Is Modified by Long-Term Potentiation , 2003, Neuron.

[49]  Jochen Triesch,et al.  Synergies between Intrinsic and Synaptic Plasticity in Individual Model Neurons , 2004, NIPS.

[50]  P. Somogyi,et al.  Spike timing of dendrite-targeting bistratified cells during hippocampal network oscillations in vivo , 2004, Nature Neuroscience.

[51]  P. Földiák,et al.  Forming sparse representations by local anti-Hebbian learning , 1990, Biological Cybernetics.

[52]  M. Poo,et al.  Bidirectional Modification of Presynaptic Neuronal Excitability Accompanying Spike Timing-Dependent Synaptic Plasticity , 2004, Neuron.

[53]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[54]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[55]  P. Dayan,et al.  Matching storage and recall: hippocampal spike timing–dependent plasticity and phase response curves , 2005, Nature Neuroscience.

[56]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[57]  Andrew P Maurer,et al.  Phase Precession in Hippocampal Interneurons Showing Strong Functional Coupling to Individual Pyramidal Cells , 2006, The Journal of Neuroscience.

[58]  György Buzsáki,et al.  Hippocampal CA3 pyramidal cells selectively innervate aspiny interneurons , 2006, The European journal of neuroscience.

[59]  György Buzsáki,et al.  Erratum: Brain-state- and cell-type-specific firing of hippocampal interneurons in vivo (Nature (2003) 421, (844-848)) , 2006 .

[60]  Peter Dayan,et al.  Uncertainty, phase and oscillatory hippocampal recall , 2006, NIPS.

[61]  Peter E. Latham,et al.  A Balanced Memory Network , 2007, PLoS Comput. Biol..

[62]  J. Nadal,et al.  What can we learn from synaptic weight distributions? , 2007, Trends in Neurosciences.

[63]  T. Freund,et al.  Perisomatic Inhibition , 2007, Neuron.

[64]  L. Abbott,et al.  Limits on the memory storage capacity of bounded synapses , 2007, Nature Neuroscience.

[65]  György Buzsáki,et al.  Gamma oscillations dynamically couple hippocampal CA3 and CA1 regions during memory task performance , 2007, Proceedings of the National Academy of Sciences.

[66]  Stefano Fusi,et al.  Long Memory Lifetimes Require Complex Synapses and Limited Sparseness , 2007, Frontiers Comput. Neurosci..

[67]  Jadin C. Jackson,et al.  Network dynamics of hippocampal cell‐assemblies resemble multiple spatial maps within single tasks , 2007, Hippocampus.

[68]  W. Abraham Metaplasticity: tuning synapses and networks for plasticity , 2008, Nature Reviews Neuroscience.

[69]  R. Kempter,et al.  Sparseness constrains the prolongation of memory lifetime via synaptic metaplasticity. , 2008, Cerebral cortex.

[70]  Emilio Kropff,et al.  Place cells, grid cells, and the brain's spatial representation system. , 2008, Annual review of neuroscience.

[71]  R. Sundareswara,et al.  Perceptual multistability predicted by search model for Bayesian decisions. , 2008, Journal of vision.

[72]  J. D. Smith The study of animal metacognition , 2009, Trends in Cognitive Sciences.

[73]  D. Tank,et al.  Intracellular dynamics of hippocampal place cells during virtual navigation , 2009, Nature.

[74]  T. Hafting,et al.  Frequency of gamma oscillations routes flow of information in the hippocampus , 2009, Nature.

[75]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[76]  Yali Amit,et al.  Capacity analysis in multi-state synaptic models: a retrieval probability perspective , 2011, Journal of Computational Neuroscience.

[77]  Eric Halgren,et al.  Human entorhinal gamma and theta oscillations selective for remote autobiographical memory , 2009, Hippocampus.

[78]  Peter Dayan,et al.  Two is better than one: distinct roles for familiarity and recollection in retrieving palimpsest memories , 2011, NIPS.

[79]  Dimitri M Kullmann,et al.  Interneuron networks in the hippocampus , 2011, Current Opinion in Neurobiology.

[80]  Kristen M Harris,et al.  Coordination of size and number of excitatory and inhibitory synapses results in a balanced structural plasticity along mature hippocampal CA1 dendrites during LTP , 2011, Hippocampus.

[81]  Peggy Seriès,et al.  Neuronal Adaptation for Sampling-Based Probabilistic Inference in Perceptual Bistability , 2011, NIPS.

[82]  H. Seo,et al.  A reservoir of time constants for memory traces in cortical neurons , 2011, Nature Neuroscience.

[83]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[84]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[85]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[86]  A. Treves,et al.  Theta-paced flickering between place-cell maps in the hippocampus , 2011, Nature.

[87]  K. Deisseroth,et al.  Optogenetic stimulation of a hippocampal engram activates fear memory recall , 2012, Nature.

[88]  Adriano B. L. Tort,et al.  OLM interneurons differentially modulate CA3 and entorhinal inputs to hippocampal CA1 neurons , 2012, Nature Neuroscience.

[89]  Michael Lagler,et al.  Behavior-dependent specialization of identified hippocampal interneurons , 2012, Nature Neuroscience.

[90]  P. Golshani,et al.  Frequency-invariant temporal ordering of interneuronal discharges during hippocampal oscillations in awake mice , 2012, Proceedings of the National Academy of Sciences.

[91]  Joshua B. Tenenbaum,et al.  Multistability and Perceptual Inference , 2012, Neural Computation.

[92]  Margaret F. Carr,et al.  A single microcircuit with multiple functions: state dependent information processing in the hippocampus , 2012, Current Opinion in Neurobiology.

[93]  Mark Mayford,et al.  Selection of distinct populations of dentate granule cells in response to inputs as a mechanism for pattern separation in mice , 2013, eLife.

[94]  Peter Dayan,et al.  Correlations strike back (again): the case of associative memory retrieval , 2013, NIPS.

[95]  Jozsef Csicsvari,et al.  Dynamic Reconfiguration of Hippocampal Interneuron Circuits during Spatial Learning , 2013, Neuron.

[96]  Wickliffe C. Abraham,et al.  Emerging roles of metaplasticity in behaviour and disease , 2013, Trends in Neurosciences.

[97]  M. Carandini,et al.  Erratum: Inhibition dominates sensory responses in awake cortex (Nature (2013) 493 (97-100) DOI:10.1038/nature11655) , 2013 .

[98]  Surya Ganguli,et al.  A memory frontier for complex synapses , 2013, NIPS.

[99]  N. Matsuki,et al.  Interpyramid spike transmission stabilizes the sparseness of recurrent network activity. , 2013, Cerebral cortex.