Conversion of Temporal Correlations Between Stimuli to Spatial Correlations Between Attractors

It is shown that a simple modification of synaptic structures (of the Hopfield type) constructed to produce autoassociative attractors, produces neural networks whose attractors are correlated with several (learned) patterns used in the construction of the matrix. The modification stores in the matrix a fixed sequence of uncorrelated patterns. The network then has correlated attractors, provoked by the uncorrelated stimuli. Thus, the network converts the temporal order (or temporal correlation) expressed by the sequence of patterns, into spatial correlations expressed in the distributions of neural activities in attractors. The model captures phenomena observed in single electrode recordings in performing monkeys by Miyashita et al. The correspondence is as close as to reproduce the fact that given uncorrelated patterns as sequentially learned stimuli, the attractors produced are significantly correlated up to a separation of 5 (five) in the sequence. This number 5 is universal in a range of parameters, and requires essentially no tuning. We then discuss learning scenarios that could lead to this synaptic structure as well as experimental predictions following from it. Finally, we speculate on the cognitive utility of such an arrangement.

[1]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[2]  M. Tsodyks,et al.  Capacity of networks with correlated attractors , 1994 .

[3]  L. F. Cugliandolo,et al.  Correlated Attractors from Uncorrelated Stimuli , 1994, Neural Computation.

[4]  Daniel J. Amit,et al.  Quantitative Study of Attractor Neural Network Retrieving at Low Spike Rates: I , 1991 .

[5]  Y. Miyashita,et al.  Neural organization for the long-term memory of paired associates , 1991, Nature.

[6]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[7]  Daniel J. Amit,et al.  Attractor neural networks with biological probe records , 1990 .

[8]  Joachim M. Buhmann,et al.  Noise-driven temporal association in neural networks , 1987 .

[9]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[11]  D. Amit,et al.  Quantitative study of attractor neural networks retrieving at low spike rates: II. Low-rate retrieval in symmetric networks , 1991 .

[12]  Daniel J. Amit,et al.  Learning in Neural Networks with Material Synapses , 1994, Neural Computation.

[13]  Ryan D. Tweney,et al.  Psychological Processing of Sign Language: Effects of Visual Disruption on Sign Intelligibility. , 1977 .

[14]  Daniel J. Amit,et al.  In defence of single-electrode recordings , 1992 .

[15]  Y. Miyashita Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[16]  G. Humphreys,et al.  Basic processes in reading : visual word recognition , 1993 .

[17]  J. Buhmann,et al.  Associative memory with high information content. , 1989, Physical review. A, General physics.

[18]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.