Memory States and Transitions between Them in Attractor Neural Networks

Human memory is capable of retrieving similar memories to a just retrieved one. This associative ability is at the base of our everyday processing of information. Current models of memory have not been able to underpin the mechanism that the brain could use in order to actively exploit similarities between memories. The current idea is that to induce transitions in attractor neural networks, it is necessary to extinguish the current memory. We introduce a novel mechanism capable of inducing transitions between memories where similarities between memories are actively exploited by the neural dynamics to retrieve a new memory. Populations of neurons that are selective for multiple memories play a crucial role in this mechanism by becoming attractors on their own. The mechanism is based on the ability of the neural network to control the excitation-inhibition balance.

[1]  Philip Resnik,et al.  Using Information Content to Evaluate Semantic Similarity in a Taxonomy , 1995, IJCAI.

[2]  Sandro Romani,et al.  Scaling Laws of Associative Memory Retrieval , 2013, Neural Computation.

[3]  David Kappel,et al.  STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning , 2014, PLoS Comput. Biol..

[4]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[5]  M. Tsodyks.  Associative Memory in Asymmetric Diluted Network with Low Level of Activity , 1988 .

[6]  Michael J. Kahana,et al.  Foundations of Human Memory , 2012 .

[7]  Itamar Lerner,et al.  Internally- and externally-driven network transitions as a basis for automatic and strategic processes in semantic priming: theory and experimental validation , 2014, Front. Psychol..

[8]  S F Larsen,et al.  Mnemonic organization and free recall in schizophrenia. , 1976, Journal of abnormal psychology.

[9]  Xiao-Jing Wang,et al.  What determines the frequency of fast network oscillations with irregular neural discharges? I. Synaptic dynamics and excitation-inhibition balance. , 2003, Journal of neurophysiology.

[10]  Sandro Romani,et al.  Neural Network Model of Memory Retrieval , 2015, Front. Comput. Neurosci..

[11]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[12]  A. Treves,et al.  Theta-paced flickering between place-cell maps in the hippocampus , 2011, Nature.

[13]  G. Bower,et al.  Human Associative Memory , 1973 .

[14]  M. Merzenich,et al.  Model of autism: increased ratio of excitation/inhibition in key neural systems , 2003, Genes, brain, and behavior.

[15]  W. Kintsch,et al.  APPLICATION OF A MARKOV MODEL TO FREE RECALL AND RECOGNITION. , 1965, Journal of experimental psychology.

[16]  Sandro Romani,et al.  Effects of long-term representations on free recall of unrelated words , 2015, Learning & memory.

[17]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[18]  S. Tipper.  The Negative Priming Effect: Inhibitory Priming by Ignored Objects , 1985, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[19]  Jane S. Paulsen,et al.  The nature of learning and memory impairments in schizophrenia , 1995, Journal of the International Neuropsychological Society.

[20]  Kelly M. Addis,et al.  A comparative analysis of serial and free recall , 2005, Memory & cognition.

[21]  Masato Okada,et al.  Notions of Associative Memory and Sparse Coding , 1996, Neural Networks.

[22]  R. Monasson,et al.  Transitions between Spatial Attractors in Place-Cell Models. , 2015, Physical review letters.

[23]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[24]  G. La Camera,et al.  Dynamics of Multistable States during Ongoing and Evoked Cortical Activity , 2015, The Journal of Neuroscience.

[25]  E. Tulving,et al.  Availability versus accessibility of information in memory for words , 1966 .

[26]  Athena Akrami,et al.  Lateral thinking, from the Hopfield model to cortical dynamics , 2012, Brain Research.

[27]  Lief E. Fenno,et al.  Neocortical excitation/inhibition balance in information processing and social dysfunction , 2011, Nature.

[28]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[29]  James P Roach,et al.  Memory recall and spike-frequency adaptation. , 2016, Physical review. E.

[30]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[31]  Alessandro Treves,et al.  Cortical free-association dynamics: distinct phases of a latching network. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Alessandro Treves,et al.  Threshold-linear formal neurons in auto-associative nets , 1990 .

[33]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[34]  C. Koch,et al.  Sparse Representation in the Human Medial Temporal Lobe , 2006, The Journal of Neuroscience.

[35]  R. Kahn,et al.  Memory impairment in schizophrenia: a meta-analysis. , 1999, The American journal of psychiatry.