Nonlinear principal component analysis by learning nerve fields united by inhibitory connections

The authors propose a model with feedforward and a recurrent self-organizing maps model which can extract nonlinear principal components. This model consists of several learning nerve fields that are mutually inhibiting each other, and is an extension of the self-organizing overlapping maps model proposed previously by the authors. The feedforward model is sufficient for nonlinear principal component analysis, but the recurrent model with symmetrical inhibitory connections between nerve fields has additional interesting characteristics. © 2004 Wiley Periodicals, Inc. Syst Comp Jpn, 35(3): 68–78, 2004; Published online in Wiley InterScience (). DOI 10.1002sscj.1230

[1]  Roman Bek,et al.  Discourse on one way in which a quantum-mechanics language on the classical logical base can be built up , 1978, Kybernetika.

[2]  Kunihiko Fukushima,et al.  Cognitron: A self-organizing multilayered neural network , 1975, Biological Cybernetics.

[3]  R Linsker,et al.  From basic network principles to neural architecture: emergence of spatial-opponent cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Shun-Ichi Amari,et al.  Topographic organization of nerve fields , 1979, Neuroscience Letters.

[5]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[6]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[7]  T. Kohonen Self-organized formation of topographically correct feature maps , 1982 .

[8]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[9]  S. Amari,et al.  Formation of topographic maps and columnar microstructures in nerve fields , 1979, Biological Cybernetics.

[10]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[11]  Koji Kurata,et al.  Separate Extraction of Two Kind of Information by Self-Organizing-Overlapping-Map. , 1999 .

[12]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.