Restricted Boltzmann Machine Models of Hippocampal Coding and Neurogenesis

Abstract The hippocampus has been traditionally viewed as a memorization device, creating orthogonalized representations (pattern separation) in the dentate gyrus, and performing associative retrieval (pattern completion) in the CA3. Moreover, neurogenesis in the dentate gyrus is widely assumed to increase pattern separation. Evidence that neurogenesis is important for behavioral discrimination has been erroneously taken as supporting the pattern separation assumption. Instead, we propose that the hippocampus forms a probabilistic, generative model of its input, using forward and feedback connections for encoding versus reconstruction. Using the Restricted Boltzmann Machine, we model the developmental trajectory of adult-generated neurons from hyperactive, hyperplastic, sparsely connected young neurons to less plastic, more densely connected mature neurons under tight inhibitory control. Models with neurogenesis are more robust against interference, while paradoxically generating more overlapping representations (less pattern separation). When applied to more realistic grid cell and boundary vector cell inputs, the model learns place cell representations. Finally, we simulate a full multilayer hippocampal model with neurogenesis and discuss how it can learn representations of sequential, complex events.

[1]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[2]  A. Fenton,et al.  Ensemble Place Codes in Hippocampus: CA1, CA3, and Dentate Gyrus Place Cells Have Multiple Place Fields in Large Environments , 2011, PloS one.

[3]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[4]  P. Argibay,et al.  A putative role for neurogenesis in neurocomputational terms: Inferences from a hippocampal model , 2009, Cognition.

[5]  P. Jonas,et al.  Enhanced synaptic plasticity in newly generated granule cells of the adult hippocampus , 2004, Nature.

[6]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[7]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[8]  Lisa M. Giocomo,et al.  Grid cell firing may arise from interference of theta frequency membrane potential oscillations in single neurons , 2007, Hippocampus.

[9]  Barak A. Pearlmutter Learning State Space Trajectories in Recurrent Neural Networks , 1988, Neural Computation.

[10]  J. O’Keefe,et al.  Geometric determinants of the place fields of hippocampal neurons , 1996, Nature.

[11]  Kathryn J Jeffery,et al.  Heterogeneous Modulation of Place Cell Firing by Changes in Context , 2003, The Journal of Neuroscience.

[12]  T. Palmer,et al.  Neurogenesis in the dentate gyrus of the adult rat: age-related decrease of neuronal progenitor proliferation , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  Brandy Schmidt,et al.  Changes in Task Demands Alter the Pattern of zif268 Expression in the Dentate Gyrus , 2011, The Journal of Neuroscience.

[14]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[15]  M. Hvoslef-Eide,et al.  Adult neurogenesis and pattern separation in rodents: A critical evaluation of data, tasks and interpretation , 2016, Frontiers in Biology.

[16]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[17]  Diano F. Marrone,et al.  Increased pattern separation in the aged fascia dentata , 2011, Neurobiology of Aging.

[18]  Suzanna Becker,et al.  The role of adult hippocampal neurogenesis in reducing interference. , 2012, Behavioral neuroscience.

[19]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.

[20]  Jürgen Schmidhuber,et al.  Evolino: Hybrid Neuroevolution/Optimal Linear Search for Sequence Learning , 2005, IJCAI.

[21]  E. Kropff,et al.  Delayed Coupling to Feedback Inhibition during a Critical Period for the Integration of Adult-Born Granule Cells , 2015, Neuron.

[22]  T. H. Brown,et al.  Voltage-clamp analysis of mossy fiber synaptic input to hippocampal neurons. , 1983, Journal of neurophysiology.

[23]  L. Saksida,et al.  A Functional Role for Adult Hippocampal Neurogenesis in Spatial Pattern Separation , 2009, Science.

[24]  E. Tulving Memory and consciousness. , 1985 .

[25]  K M Gothard,et al.  Dentate Gyrus and CA1 Ensemble Activity during Spatial Reference Frame Shifts in the Presence and Absence of Visual Input , 2001, The Journal of Neuroscience.

[26]  Chunmei Zhao,et al.  Distinct Morphological Stages of Dentate Granule Neuron Maturation in the Adult Mouse Hippocampus , 2006, The Journal of Neuroscience.

[27]  B. McNaughton,et al.  Sparse, environmentally selective expression of Arc RNA in the upper blade of the rodent fascia dentata by brief spatial experience , 2005, Hippocampus.

[28]  A. F. Schinder,et al.  Unique Processing During a Period of High Excitation/Inhibition Balance in Adult-Born Neurons , 2012, Science.

[29]  S. Becker A computational principle for hippocampal learning and neurogenesis , 2005, Hippocampus.

[30]  B. Schölkopf,et al.  Modeling Human Motion Using Binary Latent Variables , 2007 .

[31]  P. Allen,et al.  Palaeoclimatology: Formation of Precambrian sediment ripples (reply) , 2005, Nature.

[32]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[33]  Suzanna Becker,et al.  A Principle for Learning Egocentric-Allocentric Transformation , 2008, Neural Computation.

[34]  M. Hasselmo,et al.  Laminar selectivity of the cholinergic suppression of synaptic transmission in rat hippocampal region CA1: computational modeling and brain slice physiology , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  G. Winocur,et al.  Amnesia as an impairment of detail generation and binding: Evidence from personal, fictional, and semantic narratives in K.C. , 2009, Neuropsychologia.

[36]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[37]  Laura A. Ewell,et al.  Neurogenesis in the dentate gyrus: carrying the message or dictating the tone , 2013, Front. Neurosci..

[38]  M. Quirk,et al.  Requirement for Hippocampal CA3 NMDA Receptors in Associative Memory Recall , 2002, Science.

[39]  Suzanna Becker,et al.  Neurogenesis and pattern separation: time for a divorce. , 2017, Wiley interdisciplinary reviews. Cognitive science.

[40]  Neil Burgess,et al.  Characterizing multiple independent behavioral correlates of cell firing in freely moving animals , 2005, Hippocampus.

[41]  E T Rolls,et al.  Computational constraints suggest the need for two distinct input systems to the hippocampal CA3 network , 1992, Hippocampus.

[42]  Richard N. A. Henson,et al.  Perception and Conception: Temporal Lobe Activity during Complex Discriminations of Familiar and Novel Faces and Objects , 2011, Journal of Cognitive Neuroscience.

[43]  Fernando J. Pineda,et al.  Generalization of Back propagation to Recurrent and Higher Order Neural Networks , 1987, NIPS.

[44]  J. O’Keefe,et al.  Modeling place fields in terms of the cortical inputs to the hippocampus , 2000, Hippocampus.

[45]  James L. McClelland,et al.  Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off , 1994, Hippocampus.

[46]  Henry Markram,et al.  On the computational power of circuits of spiking neurons , 2004, J. Comput. Syst. Sci..

[47]  Charlotte N. Boccara,et al.  Grid cells in pre- and parasubiculum , 2010, Nature Neuroscience.

[48]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[49]  T. Seki,et al.  Age‐related production of new granule cells in the adult dentate gyrus , 1995, Neuroreport.

[50]  Arne D. Ekstrom,et al.  Cellular networks underlying human spatial navigation , 2003, Nature.

[51]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[52]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[53]  Uriel Martinez-Hernandez,et al.  Extending a Hippocampal Model for Navigation Around a Maze Generated from Real-World Data , 2015, Living Machines.

[54]  James J. Knierim,et al.  CA3 Retrieves Coherent Representations from Degraded Input: Direct Evidence for CA3 Pattern Completion and Dentate Gyrus Pattern Separation , 2014, Neuron.

[55]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[56]  A. F. Schinder,et al.  Reliable Activation of Immature Neurons in the Adult Hippocampus , 2009, PloS one.

[57]  Suzanna Becker,et al.  Adult hippocampal neurogenesis and memory interference , 2012, Behavioural Brain Research.

[58]  Simon M Stringer,et al.  Entorhinal cortex grid cells can map to hippocampal place cells by competitive learning , 2006, Network.

[59]  Jason S. Snyder,et al.  Effects of adult neurogenesis on synaptic plasticity in the rat dentate gyrus. , 2001, Journal of neurophysiology.

[60]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[61]  Benjamin Gompertz,et al.  XXIV. On the nature of the function expressive of the law of human mortality, and on a new mode of determining the value of life contingencies. In a letter to Francis Baily, Esq. F. R. S. &c , 1825, Philosophical Transactions of the Royal Society of London.

[62]  J. O’Keefe,et al.  Boundary Vector Cells in the Subiculum of the Hippocampal Formation , 2009, The Journal of Neuroscience.

[63]  J. Lisman,et al.  Hippocampal CA3 region predicts memory sequences: accounting for the phase precession of place cells. , 1996, Learning & memory.

[64]  Tony J. Prescott,et al.  Hippocampus as unitary coherent particle filter , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[65]  Orna Aizenstein,et al.  Bilateral hippocampal lesion and a selective impairment of the ability for mental time travel , 2010, Neurocase.

[66]  A. Besnard,et al.  Adult hippocampal neurogenesis and pattern separation in DG: a role for feedback inhibition in modulating sparseness to govern population-based coding , 2015, Front. Syst. Neurosci..

[67]  M. Hasselmo,et al.  Encoding and retrieval of episodic memories: Role of cholinergic and GABAergic modulation in the hippocampus , 1998, Hippocampus.

[68]  Tony J. Prescott,et al.  Learning in a Unitary Coherent Hippocampus , 2010, ICANN.

[69]  Andy C. H. Lee,et al.  The hippocampus and visual perception , 2012, Front. Hum. Neurosci..

[70]  J. O’Keefe Place units in the hippocampus of the freely moving rat , 1976, Experimental Neurology.

[71]  P. Dayan,et al.  Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions , 2004, Nature Neuroscience.

[72]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[73]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[74]  S. Becker,et al.  Neurogenesis paradoxically decreases both pattern separation and memory interference , 2015, Front. Syst. Neurosci..

[75]  Neil Burgess,et al.  What do grid cells contribute to place cell firing? , 2014, Trends in Neurosciences.

[76]  W B Levy,et al.  A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal‐like tasks , 1996, Hippocampus.

[77]  Mayank R Mehta,et al.  From synaptic plasticity to spatial maps and sequence learning , 2015, Hippocampus.

[78]  H. Scharfman,et al.  Pattern separation in the dentate gyrus: A role for the CA3 backprojection , 2011, Hippocampus.