A Principle for Learning Egocentric-Allocentric Transformation

Numerous single-unit recording studies have found mammalian hippocampal neurons that fire selectively for the animal's location in space, independent of its orientation. The population of such neurons, commonly known as place cells, is thought to maintain an allocentric, or orientation-independent, internal representation of the animal's location in space, as well as mediating long-term storage of spatial memories. The fact that spatial information from the environment must reach the brain via sensory receptors in an inherently egocentric, or viewpoint-dependent, fashion leads to the question of how the brain learns to transform egocentric sensory representations into allocentric ones for long-term memory storage. Additionally, if these long-term memory representations of space are to be useful in guiding motor behavior, then the reverse transformation, from allocentric to egocentric coordinates, must also be learned. We propose that orientation-invariant representations can be learned by neural circuits that follow two learning principles: minimization of reconstruction error and maximization of representational temporal inertia. Two different neural network models are presented that adhere to these learning principles, the first by direct optimization through gradient descent and the second using a more biologically realistic circuit based on the restricted Boltzmann machine (Hinton, 2002; Smolensky, 1986). Both models lead to orientation-invariant representations, with the latter demonstrating place-cell-like responses when trained on a linear track environment.

[1]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[2]  J. O’Keefe Place units in the hippocampus of the freely moving rat , 1976, Experimental Neurology.

[3]  R. Morris,et al.  Place navigation impaired in rats with hippocampal lesions , 1982, Nature.

[4]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[5]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[6]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[7]  C. Barnes Spatial learning and memory processes: the search for their neurobiological mechanisms in the rat , 1988, Trends in Neurosciences.

[8]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[9]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[10]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[11]  C. Stevens,et al.  Voltage dependence of NMDA-activated macroscopic conductances predicted by single-channel kinetics , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Patricia E. Sharp,et al.  Computer simulation of hippocampal place cells , 1991, Psychobiology.

[13]  Michael I. Jordan,et al.  A more biologically plausible learning rule than backpropagation applied to a network model of cortical area 7a. , 1991, Cerebral cortex.

[14]  K. Nakamura,et al.  Monkey hippocampal neurons related to spatial and nonspatial functions. , 1993, Journal of neurophysiology.

[15]  L. Jarrard On the role of the hippocampus in learning and memory in the rat. , 1993, Behavioral and neural biology.

[16]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[17]  R. Muller,et al.  On the directional firing properties of hippocampal place cells , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  E. Rolls,et al.  View‐responsive neurons in the primate hippocampal complex , 1995, Hippocampus.

[19]  L. Abbott,et al.  A model of multiplicative neural responses in parietal cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[20]  J. O’Keefe,et al.  Geometric determinants of the place fields of hippocampal neurons , 1996, Nature.

[21]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[22]  Jean-Arcady Meyer,et al.  BIOLOGICALLY BASED ARTIFICIAL NAVIGATION SYSTEMS: REVIEW AND PROSPECTS , 1997, Progress in Neurobiology.

[23]  L. Nadel,et al.  Spatial memory deficits in patients with lesions to the right hippocampus and to the right parahippocampal cortex , 1998, Neuropsychologia.

[24]  Richard A. Andersen,et al.  Separate body- and world-referenced representations of visual space in parietal cortex , 1998, Nature.

[25]  P. Goldman-Rakic,et al.  Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task. , 1998, Journal of neurophysiology.

[26]  J. Taube Head direction cells and the neurophysiological basis for a sense of direction , 1998, Progress in Neurobiology.

[27]  T. Ono,et al.  Spatial- and Task-Dependent Neuronal Responses during Real and Virtual Translocation in the Monkey Hippocampal Formation , 1999, The Journal of Neuroscience.

[28]  M. Hasselmo Neuromodulation: acetylcholine and memory consolidation , 1999, Trends in Cognitive Sciences.

[29]  A. Milner,et al.  A paradoxical improvement of misreaching in optic ataxia: new evidence for two separate neural systems for visual localization , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[30]  P. Dayan,et al.  The Involvement of Recurrent Connections in Area CA3 in Establishing the Properties of Place Fields: a Model , 2000, The Journal of Neuroscience.

[31]  R. Andersen,et al.  Models of the Posterior Parietal Cortex Which Perform Multimodal Integration and Represent Space in Several Coordinate Frames , 2000, Journal of Cognitive Neuroscience.

[32]  J. O’Keefe,et al.  Modeling place fields in terms of the cortical inputs to the hippocampus , 2000, Hippocampus.

[33]  Bruce L. McNaughton,et al.  Place cell firing shows an inertia-like process , 2000, Neurocomputing.

[34]  John A. King,et al.  Memory for events and their spatial context: models and experiments. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[35]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[36]  L. Barrett‐Lennard,et al.  Graded persistent activity in entorhinal cortex neurons , 2002 .

[37]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[38]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[39]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[40]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[41]  A. Berthoz,et al.  Development of spatial firing in the hippocampus of young rats , 2002, Hippocampus.

[42]  John A. King,et al.  Human hippocampus and viewpoint dependence in spatial memory , 2002, Hippocampus.

[43]  Arne D. Ekstrom,et al.  Cellular networks underlying human spatial navigation , 2003, Nature.

[44]  M. Hasselmo,et al.  High acetylcholine levels set circuit dynamics for attention and encoding and low acetylcholine levels set dynamics for consolidation. , 2004, Progress in brain research.

[45]  Suzanna Becker,et al.  Modeling Mental Navigation in Scenes with Multiple Objects , 2004, Neural Computation.

[46]  B. McNaughton,et al.  Local Sensory Cues and Place Cell Directionality: Additional Evidence of Prospective Coding in the Hippocampus , 2004, The Journal of Neuroscience.

[47]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 2004, Experimental Brain Research.

[48]  B. Milner,et al.  What went where? Impaired object‐location learning in patients with right hippocampal lesions , 2005, Hippocampus.

[49]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[50]  J. O’Keefe,et al.  Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells , 2005, Hippocampus.

[51]  E. Rolls,et al.  A computational theory of hippocampal function, and empirical tests of the theory , 2006, Progress in Neurobiology.

[52]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[53]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[54]  K. Jeffery,et al.  The Boundary Vector Cell Model of Place Cell Firing and Spatial Memory , 2006, Reviews in the neurosciences.

[55]  Jonathan D. Cohen,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006 .

[56]  S. Becker,et al.  Remembering the past and imagining the future: a neural model of spatial memory and imagery. , 2007, Psychological review.

[57]  András Lörincz,et al.  Here and now: How time segments may become events in the hippocampus , 2009, Neural Networks.

[58]  Michael W. Spratling Learning Posture Invariant Spatial Representations Through Temporal Correlations , 2009, IEEE Transactions on Autonomous Mental Development.

[59]  Lise Getoor,et al.  Learning in Logic , 2010, Encyclopedia of Machine Learning.