A comparison of map neuron labeling approaches for unsupervised self-organizing feature maps

The self-organizing map (SOM) is an unsupervised neural network approach that reduces a high-dimensional data set to a representative and compact two-dimensional grid. In so doing, a SOM reveals emergent clusters within the data. Research has shown that SOMs lend themselves to visual and computational analysis for exploratory and data mining purposes. However, an important requirement for many SOM interpretations is the characterization of the mappsilas emergent clusters. This process is often addressed by either a manual or automated map neuron labeling approach. This paper discusses techniques for the labeling of the unsupervised, supervised and semi-supervised variants of the SOM, and proposes some new methods. It also presents empirical results characterizing the performance of two automated labeling approaches for fully unsupervised SOMs when applied for example classification of experimental data sets.

[1]  Alan F. Murray,et al.  International Joint Conference on Neural Networks , 1993 .

[2]  Arno Siebes,et al.  Data Mining: the search for knowledge in databases. , 1994 .

[3]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[4]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[5]  Chung-Chih Lin,et al.  Model Free Functional MRI Analysis Using Kohonen Clustering Neural Network , 1999, IEEE Trans. Medical Imaging.

[6]  Juha Vesanto,et al.  SOM-based data visualization methods , 1999, Intell. Data Anal..

[7]  Mo M. Jamshidi,et al.  A novel weighted probabilistic neural network for MR image segmentation , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[8]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[9]  Alfred Ultsch,et al.  Automatic Acquisition of Symbolic Knowledge from Subsymbolic Neural Networks , 1993 .

[10]  D. J. Newman,et al.  UCI Repository of Machine Learning Database , 1998 .

[11]  Mu-Chun Su,et al.  An efficient initialization scheme for the self-organizing feature map algorithm , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[12]  John Fulcher,et al.  Computational Intelligence: An Introduction , 2008, Computational Intelligence: A Compendium.

[13]  Jan D. Miller,et al.  Agglomeration and magnetic deinking for office paper , 2000 .

[14]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[15]  Yanda Li,et al.  Self-organizing map as a new method for clustering and data analysis , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[16]  William H. Press,et al.  Numerical recipes in C , 2002 .

[17]  Andreas Rauber,et al.  Automatic Labeling of Self-Organizing Maps: Making a Treasure-Map Reveal Its Secrets , 1999, PAKDD.

[18]  Jorma Laaksonen,et al.  SOM_PAK: The Self-Organizing Map Program Package , 1996 .

[19]  Stefan Wermter,et al.  Data mining using rule extraction from Kohonen self-organising maps , 2006, Neural Computing & Applications.

[20]  Kai-Hsiang Chuang,et al.  Model-free functional MRI analysis using Kohonen clustering neural network and fuzzy C-means , 1999, IEEE Transactions on Medical Imaging.

[21]  W. Press,et al.  Numerical Recipes in C++: The Art of Scientific Computing (2nd edn)1 Numerical Recipes Example Book (C++) (2nd edn)2 Numerical Recipes Multi-Language Code CD ROM with LINUX or UNIX Single-Screen License Revised Version3 , 2003 .

[22]  Olli Simula,et al.  Interpretation and Comparison of Multidimensional Data Partitions , 2001 .

[23]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[24]  Alfred Ultsch Self Organizing Neural Networks perform different from statistical k-means clustering , 2003 .

[25]  Esa Alhoniemi Analysis of pulping data using the self-organizing map , 2000 .

[26]  Carlos Serrano-Cinca,et al.  Self organizing neural networks for financial diagnosis , 1996, Decision Support Systems.

[27]  Sandhya Samarasinghe,et al.  Neural Networks for Applied Sciences and Engineering: From Fundamentals to Complex Pattern Recognition , 2006 .

[28]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[30]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[31]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[32]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[33]  T. Kohonen Self-Organized Formation of Correct Feature Maps , 1982 .

[34]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[35]  A. Corradini,et al.  A hybrid stochastic-connectionist architecture for gesture recognition , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[36]  Esa Alhoniemi,et al.  Clustering of the self-organizing map , 2000, IEEE Trans. Neural Networks Learn. Syst..

[37]  T. Kohonen,et al.  Visual Explorations in Finance with Self-Organizing Maps , 1998 .