Paper Information - Analytic study of the memory storage capacity of a neural network

Analytic study of the memory storage capacity of a neural network

Abstract Previously, we developed a model of short and long term memory which was based on an analogy to the Ising spin system in a neural network. We assumed that the modification of the synaptic strengths was dependent upon the correlation of pre- and post-synaptic neuronal firing. This assumption we denote as the Hebb hypothesis. In this paper, we solve exactly a linearized version of the model and explicitly show that the capacity of the memory is related to the number of synapses rather than the much smaller number of neurons. In addition, we show that in order to utilize this large capacity, the network must store the major part of the information in the capability to generate patterns which evolve with time. We are also led to a modified Hebb hypothesis.

W. A. Little | Gordon L. Shaw | W. Little | G. Shaw

[1] Gordon L. Shaw,et al. Space-time correlations of neuronal firing related to memory storage capacity , 1978, Brain Research Bulletin.

[2] T J Teyler,et al. Relations between gross and unit evoked activity in pericruciate cortex of cat. , 1971, Physiology & behavior.

[3] Benedict Delisle Burns,et al. The uncertain nervous system , 1968 .

[4] E R John,et al. Switchboard versus statistical theories of learning and memory. , 1972, Science.

[5] Gordon L. Shaw,et al. Persistent states of neural networks and the random nature of synaptic transmission , 1974 .

[6] E R John,et al. Stable and plastic unit discharge patterns during behavioral generalization. , 1976, Science.

[7] G. F. Newell,et al. On the Theory of the Ising Model of Ferromagnetism , 1953 .

[8] B. Katz. Nerve, Muscle and Synapse , 1966 .

[9] J L McGaugh,et al. Time-Dependent Processes in Memory Storage , 1966, Science.

[10] W. E. Lamb,et al. The Propagation of Order in Crystal Lattices , 1943 .

[11] M. Verzeano,et al. Evoked potentials, neuronal activity and stimulus intensity in the visual system , 1968 .

[12] M. Verzeano,et al. Neuronal Activity in Cortical and Thalamic Networks : A study with multiple microelectrodes , 1960 .

[13] W A Little,et al. A statistical theory of short and long term memory. , 1975, Behavioral biology.