Mapping dynamic memories of gradually changing objects

Our brain is able to maintain a continuously updated memory representation of objects despite changes in their appearance over time (aging faces or objects, growing trees, etc.). Although this ability is crucial for cognition and behavior, it was barely explored. Here, we investigate this memory characteristic using a protocol emulating face transformation. Observers were presented with a sequence of faces that gradually transformed over many days, from a known face (source) to a new face (target), in presentations separated by other stimuli. This practice resulted in a drastic change in the memory and recognition of the faces. Although identification of the source and older face instances was reduced, recent face instances were increasingly identified as the source and rated as highly similar to the memory of the source. Using an object perturbation method, we estimated the corresponding memory shift, showing that memory patterns shifted from the source neighborhood toward the target. Our findings suggest that memory is updated to account for object changes over time while still keeping associations with past appearances. These experimental results are broadly compatible with a recently developed model of associative memory that assumes attractor dynamics with a learning rule facilitated by novelty, shown to hold when objects change gradually over short timescales.

[1]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[2]  Hugh R. Wilson,et al.  Learning alters local face space geometry , 2006, Vision Research.

[3]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[4]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[5]  E. Rolls High-level vision: Object recognition and visual cognition, Shimon Ullman. MIT Press, Bradford (1996), ISBN 0 262 21013 4 , 1997 .

[6]  Misha Tsodyks,et al.  The effects of perceptual history on memory of visual objects , 2007, Vision Research.

[7]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[8]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[9]  P. Bennett,et al.  Inversion Leads to Quantitative, Not Qualitative, Changes in Face Processing , 2004, Current Biology.

[10]  Y. Dudai The neurobiology of consolidations, or, how stable is the engram? , 2004, Annual review of psychology.

[11]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[12]  Bruce L. McNaughton,et al.  Progressive Transformation of Hippocampal Neuronal Representations in “Morphed” Environments , 2005, Neuron.

[13]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[14]  D. Sagi,et al.  Dynamics of Memory Representations in Networks with Novelty-Facilitated Synaptic Plasticity , 2006, Neuron.

[15]  R. Hari,et al.  Face recognition and cortical responses show similar sensitivity to noise spatial frequency. , 2005, Cerebral cortex.

[16]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  E. Miller,et al.  Effects of Visual Experience on the Representation of Objects in the Prefrontal Cortex , 2000, Neuron.

[18]  D. Amit The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[19]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  C. Gilbert,et al.  The Neural Basis of Perceptual Learning , 2001, Neuron.

[21]  R. Näsänen Spatial frequency bandwidth used in the recognition of facial images , 1999, Vision Research.

[22]  R. Stickgold,et al.  Dissociable stages of human memory consolidation and reconsolidation , 2003, Nature.

[23]  D. Tanné,et al.  Perceptual learning: learning to see , 1994, Current Opinion in Neurobiology.

[24]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[25]  Karim Nader,et al.  Memory traces unbound , 2003, Trends in Neurosciences.

[26]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Keiji Tanaka Mechanisms of visual object recognition: monkey and human studies , 1997, Current Opinion in Neurobiology.

[28]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[29]  I. Gauthier,et al.  Visual object understanding , 2004, Nature Reviews Neuroscience.

[30]  H. Bülthoff,et al.  Effects of temporal association on recognition memory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[31]  A. B. Sekuler,et al.  Signal but not noise changes with perceptual learning , 1999, Nature.