Dynamics and statistical mechanics of the Hopfield model

The authors present a study of the Hopfield model of the memory characteristics of a network of interconnected two-state neuron variables. The fraction of nominated configurations which the model stores without error is calculated analytically as a function of the number, N, of neurons and the number, n, of the nominated configurations. The calculation is tested by computer simulation. The noise-free (zero-temperature) phase diagram of the model is determined within a replica-symmetric solution of the mean-field equations. The model exhibits a phase transition at alpha ( identical to n/N)= alpha c approximately=0.069; at this point the thermodynamic states having macroscopic overlap with the nominated configurations disappear, implying a discontinuous change in the fraction of bits (of any nominated configuration) recalled correctly. Large scale Monte Carlo simulations using a distributed array processor provide some support for the existence of a phase transition close to the predicted value.

[1]  S. Kirkpatrick,et al.  Solvable Model of a Spin-Glass , 1975 .

[2]  S. Kirkpatrick,et al.  Infinite-ranged models of spin-glasses , 1978 .

[3]  Henri Orland,et al.  White and weighted averages over solutions of Thouless Anderson Palmer equations for the Sherrington Kirkpatrick spin glass , 1980 .

[4]  A. Bray,et al.  Metastable states in spin glasses , 1980 .

[5]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[6]  K.C. Bowler,et al.  Molecular dynamics and Monte Carlo simulations in solid-state and elementary particle physics , 1984, Proceedings of the IEEE.

[7]  M. Mézard,et al.  Replica symmetry breaking and the nature of the spin glass phase , 1984 .

[8]  M. Mézard,et al.  Nature of the Spin-Glass Phase , 1984 .

[9]  V S Dotsdernko,et al.  'Ordered' spin glass: a hierarchical memory machine , 1985 .

[10]  Gérard Weisbuch,et al.  Scaling laws for the attractors of Hopfield networks , 1985 .

[11]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[12]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[13]  Marc Mézard,et al.  Solvable models of working memories , 1986 .

[14]  Isabelle Guyon,et al.  A biologically constrained learning mechanism in networks of formal neurons , 1986 .

[15]  G. Parisi.  A memory which forgets , 1986 .

[16]  Kinzel.  Remanent magnetization of the infinite-range Ising spin glass. , 1986, Physical review. B, Condensed matter.

[17]  S Dehaene,et al.  Spin glass model of learning by selection. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[18]  A. Crisanti,et al.  Saturation Level of the Hopfield Model for Neural Network , 1986 .

[19]  K. Schilling,et al.  Lattice Gauge Theory: A Challenge in Large-Scale Computing , 1986 .

[20]  E. Gardner.  Structure of metastable states in the Hopfield model , 1986 .

[21]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[22]  E. Gardner.  Multiconnected neural network models , 1987 .