Class distributions on SOM surfaces for feature extraction and object retrieval

A Self-Organizing Map (SOM) is typically trained in unsupervised mode, using a large batch of training data. If the data contain semantically related object groupings or classes, subsets of vectors belonging to such user-defined classes can be mapped on the SOM by finding the best matching unit for each vector in the set. The distribution of the data vectors over the map forms a two-dimensional discrete probability density. Even from the same data, qualitatively different distributions can be obtained by using different feature extraction techniques. We used such feature distributions for comparing different classes and different feature representations of the data in the context of our content-based image retrieval system PicSOM. The information-theoretic measures of entropy and mutual information are suggested to evaluate the compactness of a distribution and the independence of two distributions. Also, the effect of low-pass filtering the SOM surfaces prior to the calculation of the entropy is studied.

[1]  日高 恒義,et al.  ISO/IEC JTC1 SC29/WG11 MPEG-2久里浜主観評価テスト報告 , 1992 .

[2]  Elias Pampalk,et al.  Using Smoothed Data Histograms for Cluster Visualization in Self-Organizing Maps , 2002, ICANN.

[3]  E. Oja,et al.  Clustering Properties of Hierarchical Self-Organizing Maps , 1992 .

[4]  Esa Alhoniemi,et al.  Clustering of the self-organizing map , 2000, IEEE Trans. Neural Networks Learn. Syst..

[5]  Jouko Lampinen,et al.  Clustering properties of hierarchical self-organizing maps , 1992, Journal of Mathematical Imaging and Vision.

[6]  Mika Rummukainen,et al.  An Efficiency Comparison of Two Content-Based Image Retrieval Systems, GIFT and PicSOM , 2003, CIVR.

[7]  Erkki Oja,et al.  PicSOM-self-organizing image retrieval with MPEG-7 content descriptors , 2002, IEEE Trans. Neural Networks.

[8]  Thomas M. Cover,et al.  Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) , 2006 .

[9]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[10]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[11]  Erkki Oja,et al.  Engineering applications of the self-organizing map , 1996, Proc. IEEE.

[12]  Nuno Vasconcelos,et al.  Learning from User Feedback in Image Retrieval Systems , 1999, NIPS.

[13]  Anil K. Jain,et al.  A nonlinear projection method based on Kohonen's topology preserving maps , 1995, IEEE Trans. Neural Networks.

[14]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[15]  Erkki Oja,et al.  Self-Organising Maps as a Relevance Feedback Technique in Content-Based Image Retrieval , 2001, Pattern Analysis & Applications.

[16]  Pasi Koikkalainen,et al.  Progress with the Tree-Structured Self-Organizing Map , 1994, ECAI.

[17]  Pasi Koikkalainen,et al.  Self-organizing hierarchical feature maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[18]  Christopher M. Bishop,et al.  GTM: The Generative Topographic Mapping , 1998, Neural Computation.

[19]  Timo Kostiainen,et al.  Generative probability density model in the self-organizing map , 2001 .

[20]  Lakhmi C. Jain,et al.  Self-Organizing neural networks: recent advances and applications , 2001 .

[21]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[22]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[23]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[25]  T. Kostiainen,et al.  Self-organizing map as a probability density model , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[26]  T. Heskes Energy functions for self-organizing maps , 1999 .

[27]  Vittorio Castelli,et al.  Image Databases: Search and Retrieval of Digital Imagery , 2002 .

[28]  Erkki Oja,et al.  Implementing Relevance Feedback as Convolutions of Local Neighborhoods on Self-Organizing Maps , 2002, ICANN.

[29]  Daniel Pullwitt Integrating contextual information to enhance SOM-based text document clustering , 2002, Neural Networks.

[30]  Stephen P. Luttrell Code vector density in topographic mappings: Scalar case , 1991, IEEE Trans. Neural Networks.

[31]  Michael S. Lew,et al.  Principles of Visual Information Retrieval , 2001, Advances in Pattern Recognition.

[32]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[33]  Jorma Laaksonen,et al.  Using Long-Term Learning to Improve Efficiency of Content-Based Image Retrieval , 2003, PRIS.

[34]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[35]  Erkki Oja,et al.  Kohonen Maps , 1999, Encyclopedia of Machine Learning.