Mathematical Theory of Neural Networks: A Personal and Historical Survey

Mathematical neuroscience has become an important discipline of neuroscience, although it has not yet been fully established. We state historical remarks on the progress of mathematical neuroscience from the personal viewpoint. We also show some formulations of mathematical neuroscience with historical comments. We conclude with long-standing unsolved problems.

[1]  Shun-ichi Amari,et al.  Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements , 1972, IEEE Transactions on Computers.

[2]  Shun-ichi Amari,et al.  Mathematical foundations of neurocomputing , 1990, Proc. IEEE.

[3]  S.-I. Amari,et al.  Neural theory of association and concept-formation , 1977, Biological Cybernetics.

[4]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.

[5]  Shun-ichi Amari,et al.  The EM Algorithm and Information Geometry in Neural Network Learning , 1995, Neural Computation.

[6]  Shun-ichi Amari,et al.  Field theory of self-organizing neural nets , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[8]  S. Amari,et al.  Formation of topographic maps and columnar microstructures in nerve fields , 1979, Biological Cybernetics.

[9]  Shun-ichi Amari,et al.  A method of statistical neurodynamics , 1974, Kybernetik.

[10]  Shun-ichi Amari,et al.  A universal theorem on learning curves , 1993, Neural Networks.

[11]  Shun-ichi Amari,et al.  Information geometry of Boltzmann machines , 1992, IEEE Trans. Neural Networks.

[12]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[13]  S. Amari.  Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[14]  S. Amari,et al.  A Mathematical Foundation for Statistical Neurodynamics , 1977 .

[15]  Shun-ichi Amari,et al.  A Theory of Adaptive Pattern Classifiers , 1967, IEEE Trans. Electron. Comput..

[16]  S. Amari,et al.  Mathematical theory on formation of category detecting nerve cells , 1978, Biological Cybernetics.

[17]  Shun-ichi Amari,et al.  Characteristics of randomly connected threshold-element networks and network systems , 1971 .

[18]  Shun-ichi Amari,et al.  Conditional Mixture Model for Correlated Neuronal Spikes , 2010, Neural Computation.

[19]  Shun-ichi Amari,et al.  Learning and inference in hierarchical models with singularities , 2003, Systems and Computers in Japan.