Spiking Associative Memory and Scene Segmentation by Synchronization of Cortical Activity

For the recognition of objects there are a number of computational requirements that go beyond the detection of simple geometric features like oriented lines. When there are several partially occluded objects present in a visual scene one has to have an internal knowledge about the object to be identified, e.g. using associative memories. We have studied the bidirectional dynamical interaction of two areas, where the lower area is modelled to match area V1 in greater detail and the higher area uses Hebbian learning to form an associative memory for a number of geometric shapes. Both areas are modelled with simple spiking neuron models, and questions of "binding" by spike-synchronisation and of the effects of Hebbian learning in various synaptic connections (including the long-range cortico-cortical projections) are studied. Presenting a superposition of three stimulus objects corresponding to learned assemblies, we found generally two states of activity: (i) relatively slow and unordered activity, synchronized only within small regions, and (ii) faster oscillations, synchronized over larger regions. The neuron groups representing one stimulus tended to be simultaneously in either the slow or the fast state. At each particular time, only one assembly was found to be in the fast state. Activation of the three assemblies switched within a few hundred milliseconds.

[1]  Günther Palm,et al.  Iterative retrieval of sparsely coded associative memory patterns , 1996, Neural Networks.

[2]  Ad Aertsen,et al.  Dynamics of functional coupling in the cerebral cortex , 1994 .

[3]  R. Eckhorn,et al.  Stimulus-specific fast oscillations at zero phase between visual areas V1 and V2 of awake monkey. , 1994, Neuroreport.

[4]  G Palm,et al.  Computing with neural networks. , 1987, Science.

[5]  W. Singer,et al.  Interhemispheric synchronization of oscillatory neuronal responses in cat visual cortex , 1991, Science.

[6]  P König,et al.  Synchronization of oscillatory neuronal responses between striate and extrastriate visual cortical areas of the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Harvey A Swadlow,et al.  Information Flow along Neocortical Axons , 2000 .

[8]  T. M. Mayhew,et al.  Anatomy of the Cortex: Statistics and Geometry. , 1991 .

[9]  C. von der Malsburg,et al.  Am I Thinking Assemblies , 1986 .

[10]  P König,et al.  Direct physiological evidence for scene segmentation by temporal coding. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Günther Palm,et al.  Iterative Retrieval In Associative Memories By Threshold Control Of Different Neural Models , 1995 .

[12]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[13]  Günther Palm,et al.  On Associative Memories , 1987 .

[14]  J. Bullier,et al.  Cross-Correlograms for Neuronal Spike Trains. Different Types of Temporal Correlation in Neocortex, their Origin and Significance , 2000 .

[15]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[16]  R. Miller Time and the brain , 2000 .

[17]  W. Singer,et al.  Stimulus-dependent synchronization of neuronal responses in the visual cortex of the awake macaque monkey , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  J. Davenport Editor , 1960 .

[19]  G. Palm Neural Assemblies , 1982, Studies of Brain Function.

[20]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[22]  Günther Palm,et al.  Improved bidirectional retrieval of sparse patterns stored by Hebbian learning , 1999, Neural Networks.

[23]  E. Pöppel Temporal mechanisms in perception. , 1994, International review of neurobiology.

[24]  Thomas Wennekers Synchronisation und Assoziation in neuronalen Netzen , 1999 .

[25]  Thomas Wennekers,et al.  On the relation between neural modelling and experimental neuroscience , 1997 .

[26]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[27]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Andreas Knoblauch,et al.  Pattern separation and synchronization in spiking associative memories and visual areas , 2001, Neural Networks.

[29]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[30]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[31]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[32]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[33]  Günther Palm,et al.  Scene segmentation by spike synchronization in reciprocally connected visual areas. I. Local effects of cortical feedback , 2002, Biological Cybernetics.

[34]  Gèunther Palm,et al.  Neural Assemblies: An Alternative Approach to Artificial Intelligence , 1982 .

[35]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[36]  C. Koch,et al.  A detailed model of the primary visual pathway in the cat: comparison of afferent excitatory and intracortical inhibitory connection schemes for orientation selectivity , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  Ronald J. MacGregor,et al.  Neural and brain modeling , 1987 .