Synaptic Scaling Enables Dynamically Distinct Short- and Long-Term Memory Formation

Memory formation in the nervous system relies on mechanisms acting on time scales from minutes, for long-term synaptic plasticity [1], to days, for memory consolidation [2]. During such processes, the neural network distinguishes synapses relevant for forming a long-term storage (LTS), which are consolidated, from synapses of short-term storage (STS), which fade. How time scale integration and synaptic differentiation is simultaneously achieved within one neural circuit remains unclear. We show in simulations and mean-field analyses that synaptic scaling [3] - a slow process usually associated with the maintenance of activity homeostasis - combined with the faster processes of synaptic plasticity simultaneously achieve both, thereby providing a natural separation of short- from long-term storage. A network intrinsic bifurcation enables this separation as this bifurcation induces different response properties of previously learned cell assemblies due to external memory reactivations. These reactivations could be associated with "sleep-like" activations as, for instance, sharp-wave ripples during slow-wave sleep [4,5]. Additionally, the interaction between plasticity and scaling provides an explanation for an established paradox where memory consolidation and destabilization critically depends on the exact order of learning and recall. This enables us to reproduce human-psychophysical results [6] on the apparently paradoxical effect of memory destabilization due to memory recall [7]. However, other experimentalists failed to reproduce this memory destabilization effect (e.g., [8]). This ambivalence can be explained by the here proposed bifurcation scenario as the initial conditions and exact timings of recall and learning determine the transition between consolidation and destabilization. Thus, the dynamics of our model yield the fact that memory - similar to the real systems - remains susceptible to perturbations and has to be repeatedly consolidated [2] which could happen during sleep [4,5]. To achieve a final stabilization of memory, systems consolidation, which also begins during sleep [4], performs a transition from a dynamic to a more static memory representation by transferring the information to the neocortex [2]. The processes suggested here are capable of repeatedly (re)consolidating LTS-synapses, while STS-candidates fade. This may thus essentially contribute to providing a stable substrate for systems consolidation.

[1]  Susanne Diekelmann,et al.  Slow-wave sleep takes the leading role in memory reorganization , 2010, Nature Reviews Neuroscience.

[2]  L. Nadel,et al.  Update on Memory Systems and Processes , 2011, Neuropsychopharmacology.

[3]  Nicolas Brunel,et al.  Can Attractor Network Models Account for the Statistics of Firing During Persistent Activity in Prefrontal Cortex? , 2008, Front. Neurosci..

[4]  Adriano B. L. Tort,et al.  A synaptic reinforcement‐based model for transient amnesia following disruptions of memory consolidation and reconsolidation , 2008, Hippocampus.

[5]  S. Rumpel,et al.  Discrete Neocortical Dynamics Predict Behavioral Categorization of Sounds , 2012, Neuron.

[6]  Joe Z Tsien,et al.  Inducible and Reversible NR1 Knockout Reveals Crucial Role of the NMDA Receptor in Preserving Remote Memories in the Brain , 2004, Neuron.

[7]  Daniel J. Amit,et al.  Quantitative Study of Attractor Neural Network Retrieving at Low Spike Rates: I , 1991 .

[8]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[9]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[10]  G. Buzsáki,et al.  Selective suppression of hippocampal ripples impairs spatial memory , 2009, Nature Neuroscience.

[11]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[12]  Botond Szatmáry,et al.  Spike-Timing Theory of Working Memory , 2010, PLoS Comput. Biol..

[13]  Marc Timme,et al.  Analysis of Synaptic Scaling in Combination with Hebbian Plasticity in Several Simple Networks , 2012, Front. Comput. Neurosci..

[14]  M. Bear,et al.  Common forms of synaptic plasticity in the hippocampus and neocortex in vitro. , 1993, Science.

[15]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[16]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[17]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[18]  Anthony J. Lombardino The Cognitive Neuroscience of Memory: An Introduction.ByHoward Eichenbaum.Oxford and New York: Oxford University Press. $69.50 (hardcover); $39.50 (paper). xi + 370 p; ill.; index. ISBN: 0–19–514174–1 (hc); 0–19–514175–X (pb). 2002. , 2004 .

[19]  Marc Mézard,et al.  Solvable models of working memories , 1986 .

[20]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[21]  Wulfram Gerstner,et al.  Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns , 1993, Biological Cybernetics.

[22]  J. Born,et al.  The memory function of sleep , 2010, Nature Reviews Neuroscience.

[23]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[24]  K. Nader,et al.  Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval , 2000, Nature.

[25]  E. Shimizu,et al.  NMDA receptor-dependent synaptic reinforcement as a crucial process for memory consolidation. , 2000, Science.

[26]  I. Timofeev,et al.  Sleep Oscillations in the Thalamocortical System Induce Long-Term Neuronal Plasticity , 2012, Neuron.

[27]  Marc Timme,et al.  Revealing network connectivity from response dynamics. , 2006, Physical review letters.

[28]  C. Alberini The Role of Reconsolidation and the Dynamic Process of Long-Term Memory Formation and Storage , 2011, Front. Behav. Neurosci..

[29]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[30]  M. Carandini,et al.  Inhibition dominates sensory responses in awake cortex , 2012, Nature.

[31]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  Jörg Lücke,et al.  Feedforward Inhibition and Synaptic Scaling – Two Sides of the Same Coin? , 2012, PLoS Comput. Biol..

[33]  Y. Dudai The neurobiology of consolidations, or, how stable is the engram? , 2004, Annual review of psychology.

[34]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[35]  P Alvarez,et al.  Memory consolidation and the medial temporal lobe: a simple network model. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[36]  K. Harris Cell Assemblies of the Superficial Cortex , 2012, Neuron.

[37]  David C Rowland,et al.  Generation of a Synthetic Memory Trace , 2012, Science.

[38]  U. Frey,et al.  Synaptic tagging and long-term potentiation , 1997, Nature.

[39]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[40]  Karl J. Friston,et al.  The Dynamic Brain: From Spiking Neurons to Neural Masses and Cortical Fields , 2008, PLoS Comput. Biol..

[41]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[42]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[43]  J. G. Taylor,et al.  Neural ‘bubble’ dynamics in two dimensions: foundations , 1999, Biological Cybernetics.

[44]  K. Deisseroth,et al.  Optogenetic stimulation of a hippocampal engram activates fear memory recall , 2012, Nature.

[45]  Stefano Fusi,et al.  Efficient Partitioning of Memory Systems and Its Importance for Memory Consolidation , 2013, PLoS Comput. Biol..

[46]  Y. Dudai,et al.  Rites of Passage of the Engram Reconsolidation and the Lingering Consolidation Hypothesis , 2004, Neuron.

[47]  Dean V Buonomano,et al.  Embedding Multiple Trajectories in Simulated Recurrent Neural Networks in a Self-Organizing Manner , 2009, The Journal of Neuroscience.

[48]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[49]  Eugene M. Izhikevich,et al.  Relating STDP to BCM , 2003, Neural Computation.

[50]  Marc Timme,et al.  Synaptic Scaling in Combination with Many Generic Plasticity Mechanisms Stabilizes Circuit Connectivity , 2011, Front. Comput. Neurosci..

[51]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[52]  Florentin Wörgötter,et al.  Time scales of memory, learning, and plasticity , 2012, Biological Cybernetics.

[53]  M. Meeter,et al.  Tracelink: A model of consolidation and amnesia , 2005, Cognitive neuropsychology.

[54]  M. Matsuzaki Factors critical for the plasticity of dendritic spines and memory storage , 2007, Neuroscience Research.

[55]  J. O’Neill,et al.  Play it again: reactivation of waking experience and memory , 2010, Trends in Neurosciences.

[56]  B. Everitt,et al.  Independent Cellular Processes for Hippocampal Memory Consolidation and Reconsolidation , 2004, Science.

[57]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[58]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[59]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[60]  JaneR . Taylor,et al.  Molecular mechanisms of memory reconsolidation , 2007, Nature Reviews Neuroscience.

[61]  J. Henson,et al.  Plasticity , 2010, Neurology.

[62]  K. Miller,et al.  Synaptic Economics: Competition and Cooperation in Synaptic Plasticity , 1996, Neuron.

[63]  N. Brunel,et al.  Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location , 2012, Proceedings of the National Academy of Sciences.

[64]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[65]  R. Stickgold,et al.  Memory consolidation and reconsolidation: what is the role of sleep? , 2005, Trends in Neurosciences.

[66]  I. Izquierdo,et al.  Retrieval does not induce reconsolidation of inhibitory avoidance memory. , 2004, Learning & memory.

[67]  Narayan Srinivasa,et al.  Learning and prospective recall of noisy spike pattern episodes , 2013, Front. Comput. Neurosci..

[68]  W. Gerstner,et al.  Spike-Timing-Dependent Plasticity: A Comprehensive Overview , 2012, Front. Syn. Neurosci..

[69]  Wulfram Gerstner,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2002 .

[70]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[71]  P. Frankland,et al.  The organization of recent and remote memories , 2005, Nature Reviews Neuroscience.

[72]  S. J. Martin,et al.  Synaptic plasticity and memory: an evaluation of the hypothesis. , 2000, Annual review of neuroscience.

[73]  A. Lansner Associative memory models: from the cell-assembly theory to biophysically detailed cortex simulations , 2009, Trends in Neurosciences.

[74]  J. Tsien,et al.  Synaptic reentry reinforcement based network model for long‐term memory consolidation , 2002, Hippocampus.

[75]  G. Lynch,et al.  Heterosynaptic depression: a postsynaptic correlate of long-term potentiation , 1977, Nature.

[76]  J. Hobson,et al.  The Role of Sleep in Learning and Memory , 2014 .

[77]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[78]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[79]  K. Svoboda,et al.  Experience-dependent structural synaptic plasticity in the mammalian brain , 2009, Nature Reviews Neuroscience.

[80]  E. Pastalkova,et al.  Storage of Spatial Information by the Maintenance Mechanism of LTP , 2006, Science.

[81]  H. Eichenbaum,et al.  Consolidation and Reconsolidation: Two Lives of Memories? , 2011, Neuron.

[82]  John H. Holland,et al.  Tests on a cell assembly theory of the action of the brain, using a large digital computer , 1956, IRE Trans. Inf. Theory.

[83]  Natalie L. M. Cappaert,et al.  The anatomy of memory: an interactive overview of the parahippocampal–hippocampal network , 2009, Nature Reviews Neuroscience.

[84]  D. J. Lewis,et al.  Retrograde Amnesia Produced by Electroconvulsive Shock after Reactivation of a Consolidated Memory Trace , 1968, Science.

[85]  Wulfram Gerstner,et al.  Tag-Trigger-Consolidation: A Model of Early and Late Long-Term-Potentiation and Depression , 2008, PLoS Comput. Biol..

[86]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[87]  Ulf Grenander,et al.  SOME PROPERTIES OF A NEURAL MODEL FOR MEMORY , 1995 .

[88]  Mark C. W. van Rossum,et al.  State Based Model of Long-Term Potentiation and Synaptic Tagging and Capture , 2009, PLoS Comput. Biol..

[89]  R. Stickgold,et al.  Dissociable stages of human memory consolidation and reconsolidation , 2003, Nature.