Optimised network for sparsely coded patterns

The performance of attractor neural networks storing sparsely coded patterns has been shown to be greatly improved on shifting from the -1, +1 representation of neural states to the 0, 1 representation. Here the authors show that when this shift is considered as a special case of the transformation of the dynamical variables which depends on a continuous parameter, the value of the parameter can be chosen to improve the performance of the network even further for every value of the bias in the patterns.

[1]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[2]  S. Kirkpatrick,et al.  Infinite-ranged models of spin-glasses , 1978 .

[3]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Gérard Weisbuch,et al.  Scaling laws for the attractors of Hopfield networks , 1985 .

[5]  I. Guyon,et al.  Information storage and retrieval in spin-glass like neural networks , 1985 .

[6]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[7]  D. Amit,et al.  Statistical mechanics of neural networks near saturation , 1987 .

[8]  D. J. Wallace,et al.  Dynamics and statistical mechanics of the Hopfield model , 1987 .

[9]  Kanter,et al.  Associative recall of memory without errors. , 1987, Physical review. A, General physics.

[10]  Sompolinsky,et al.  Information storage in neural networks with low levels of activity. , 1987, Physical review. A, General physics.

[11]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[12]  Gutfreund.  Neural networks with hierarchically correlated patterns. , 1988, Physical review. A, General physics.

[13]  E. Gardner.  The space of interactions in neural network models , 1988 .

[14]  Schulten,et al.  Associative memory with high information content. , 1989, Physical review. A, General physics.