Self–organized maps of sensory events

Over the years, many divergent meanings have been associated with the term ‘self–organization’, e.g. automatic creation of structured systems and optimization of parameters in adaptive learning. In this paper, we shall discuss a special type of data–driven self–organization, namely, automatic formation of ordered, compressed representations of sensory events. Such ordered and organized representations of an organism's experiences and environment exist in the nervous systems, where specific feature–sensitive information–processing functions are usually associated with these representations. As a matter of fact, three types of neuronal organization called ‘brain maps’ can be distinguished: sets of feature–sensitive cells, ordered projections between neuronal layers, and ordered maps of abstract features, respectively. The latter are most intriguing as they may also reflect quite abstract properties of the input data in an orderly fashion. It is proposed that such ‘maps’ are learned in a process that involves competition between sets of neural cells on common input data, and sensitization or tuning of the most strongly responding cells and their local neighbours to this input. While serving as a model for brain maps, the ‘self–organizing map’ principle has been used as an analytical tool in exploratory data analysis. In the latter, it has had practical applications ranging from industrial process control to marketing analyses, and from linguistics to bioinformatics.

[1]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[2]  Teuvo Kohonen,et al.  Physiological interpretationm of the self-organizing map algorithm , 1993 .

[3]  A. Naim,et al.  Galaxy Morphology without Classification: Self-organizing Maps , 1997 .

[4]  Olli Simula,et al.  Process Monitoring and Modeling Using the Self-Organizing Map , 1999, Integr. Comput. Aided Eng..

[5]  Yizong Cheng Convergence and Ordering of Kohonen's Batch Map , 1997, Neural Computation.

[6]  Helge J. Ritter,et al.  Neural computation and self-organizing maps - an introduction , 1992, Computation and neural systems series.

[7]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[8]  Erkki Oja,et al.  Kohonen Maps , 1999, Encyclopedia of Machine Learning.

[9]  Samuel Kaski,et al.  Bibliography of Self-Organizing Map (SOM) Papers: 1981-1997 , 1998 .

[10]  P. Gärdenfors Three levels of inductive inference , 1995 .

[11]  Teuvo Kohonen,et al.  Visual Explorations in Finance , 1998 .

[12]  Samuel Kaski,et al.  Winner-take-all networks for physiological models of competitive learning , 1994, Neural Networks.

[13]  Panu Somervuo,et al.  Self-organizing maps of symbol strings , 1998, Neurocomputing.

[14]  Samuel Kaski,et al.  Self organization of a massive document collection , 2000, IEEE Trans. Neural Networks Learn. Syst..

[15]  Hujun Yin,et al.  Advances in Self-Organising Maps, WSOM 2001, Lincoln, UK, 13-15 June, 2011 , 2001, WSOM.

[16]  Kikuo Fujimura,et al.  Applications of Self-Organizing Maps (SOM) to the Round-Robin CoNi Alloy Spectra Data , 1999 .

[17]  T. Kohonen,et al.  Visual Explorations in Finance with Self-Organizing Maps , 1998 .

[18]  Teuvo Kohonen,et al.  Physiological interpretation of the Self-Organizing Map algorithm , 1993, Neural Networks.

[19]  Lakhmi C. Jain,et al.  Self-Organizing neural networks: recent advances and applications , 2001 .

[20]  S. Amari Topographic organization of nerve fields , 1979, Neuroscience Letters.

[21]  Shun-Ichi Amari,et al.  Topographic organization of nerve fields , 1979, Neuroscience Letters.

[22]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[23]  Terrence J. Sejnowski,et al.  Self-Organizing Map Formation: Foundations of Neural Computation , 2001 .

[24]  Marc M. Van Hulle,et al.  Faithful Representations and Topographic Maps: From Distortion- to Information-Based Self-Organization , 2000 .

[25]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.