Associative memory with nonmonotone dynamics

The dynamics of autocorrelation associative memory is examined, and a novel neural dynamics which greatly enhances the ability of associative neural networks is presented. This dynamics is such that the output of some particular neurons is reversed (for a discrete model) or the output function is not sigmoid but nonmonotonic (for an analog model). It is also shown by numerical experiments that most of the problems of the conventional model are overcome by the improved dynamics. These results are important not only for practical purposes but also for understanding dynamical properties of associative neural networks.

[1]  Masahiko Morita,et al.  Capacity of associative memory using a nonmonotonic neuron model , 1993, Neural Networks.

[2]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[3]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.

[4]  Masahiko Morita,et al.  Memory of Correlated Patterns by Associative Neural Networks with Improved Dynamics , 1990 .

[5]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[6]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[8]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[9]  E. Gardner.  Structure of metastable states in the Hopfield model , 1986 .

[10]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[11]  Meir,et al.  Exact solution of a layered neural network model. , 1987, Physical review letters.

[12]  Kaoru Nakano,et al.  Associatron-A Model of Associative Memory , 1972, IEEE Trans. Syst. Man Cybern..

[13]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.