Neural theory of association and concept-formation

The present paper looks for possible neural mechanism underlying such high-level brain functioning as association and concept-formation. Primitive neural models of association and concept-formation are presented, which will elucidate the distributed and multiply superposed manner of retaining knowledge in the brain. The models are subject to two rules of self-organization of synaptic weights, orthogonal and covariance learning. The convergence of self-organization is proved, and the characteristics of these learning rules are shown. The performances, especially the noise immunity, of the association net and concept-formation net are analyzed.

[1]  A. Dvoretzky.  On Stochastic Approximation , 1956 .

[2]  E. Caianiello.  Outline of a theory of thought-processes and thinking machines. , 1961, Journal of theoretical biology.

[3]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[4]  S. Grossberg.  On learning, information, lateral inhibition, and transmitters , 1969 .

[5]  M. T. Wasan.  Stochastic Approximation , 1969 .

[6]  D. N. Spinelli.  OCCAM: A COMPUTER MODEL FOR A CONTENT ADDRESSABLE MEMORY IN THE CENTRAL NERVOUS SYSTEM , 1970 .

[7]  Shun-ichi Amari,et al.  Characteristics of randomly connected threshold-element networks and network systems , 1971 .

[8]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[9]  Shun-ichi Amari,et al.  Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements , 1972, IEEE Transactions on Computers.

[10]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[11]  Kaoru Nakano,et al.  Associatron-A Model of Associative Memory , 1972, IEEE Trans. Syst. Man Cybern..

[12]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[13]  Teuvo Kohonen,et al.  An Adaptive Associative Memory Principle , 1974, IEEE Transactions on Computers.

[14]  Shun-ichi Amari,et al.  A Mathematical Approach to Neural Systems , 1977 .

[15]  S. Amari,et al.  A Mathematical Foundation for Statistical Neurodynamics , 1977 .

[16]  Roman Bek,et al.  Discourse on one way in which a quantum-mechanics language on the classical logical base can be built up , 1978, Kybernetika.

[17]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[18]  H. Wigström,et al.  A neuron model with learning capability and its relation to mechanisms of association , 1973, Kybernetik.

[19]  S. Amari.  Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[20]  S. Amari.  Homogeneous nets of neuron-like elements , 1975, Biological Cybernetics.

[21]  E. Pfaffelhuber.  Correlation memory models — a first approximation in a general learning scheme , 1975, Biological Cybernetics.

[22]  E. Oja,et al.  Fast adaptive formation of orthogonalizing filters and associative memory in recurrent networks of neuron-like elements , 1976, Biological Cybernetics.

[23]  Shun-ichi Amari,et al.  A method of statistical neurodynamics , 1974, Kybernetik.

[24]  C. Malsburg.  Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.