Mathematical theory of neural learning

A mathematical theory of learning is presented in a unified manner to be applicable to various architectures of networks. The theory is based on parameter modification driven by a time series of input signals generated from a stochastic information source. A network modifies its behavior such that it adapts to the environmental information structure. The theory is self-organization of a neural system. A typical discrete structure is automatically formed through continuous parameter modification by self-organization.

[1]  Shun-ichi Amari,et al.  Mathematical foundations of neurocomputing , 1990, Proc. IEEE.

[2]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[3]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  S. Amari,et al.  Formation of topographic maps and columnar microstructures in nerve fields , 1979, Biological Cybernetics.

[5]  T. Kohonen Self-organized formation of topographically correct feature maps , 1982 .

[6]  S. Amari,et al.  Mathematical theory on formation of category detecting nerve cells , 1978, Biological Cybernetics.

[7]  Shun-ichi Amari,et al.  Field theory of self-organizing neural nets , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  S. Amari Topographic organization of nerve fields , 1979, Neuroscience Letters.

[9]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory, Second Edition , 1988, Springer Series in Information Sciences.

[11]  T. Kohonen Self-Organized Formation of Correct Feature Maps , 1982 .

[12]  Shun-ichi Amari,et al.  A Theory of Adaptive Pattern Classifiers , 1967, IEEE Trans. Electron. Comput..

[13]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.