Self-Organising Maps as a Relevance Feedback Technique in Content-Based Image Retrieval

Abstract:Self-Organising Maps (SOMs) can be used in implementing a powerful relevance feedback mechanism for Content-Based Image Retrieval (CBIR). This paper introduces the PicSOM CBIR system, and describes the use of SOMs as a relevance feedback technique in it. The technique is based on the SOM’s inherent property of topology-preserving mapping from a high-dimensional feature space to a two-dimensional grid of artificial neurons. On this grid similar images are mapped in nearby locations. As image similarity must, in unannotated databases, be based on low-level visual features, the similarity of images is dependent on the feature extraction scheme used. Therefore, in PicSOM there exists a separate tree-structured SOM for each different feature type. The incorporation of the relevance feedback and the combination of the outputs from the SOMs are performed as two successive processing steps. The proposed relevance feedback technique is described, analysed qualitatively, and visualised in the paper. Also, its performance is compared with a reference method.

[1]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[2]  Pasi Koikkalainen,et al.  Self-organizing hierarchical feature maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[3]  Pasi Koikkalainen,et al.  Progress with the Tree-Structured Self-Organizing Map , 1994, ECAI.

[4]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[5]  Sung-Hyon Myaeng,et al.  Image organization and retrieval with automatically constructed feature vectors , 1996, SIGIR '96.

[6]  Thomas P. Minka,et al.  An image database browser that learns from user interaction , 1996 .

[7]  Tom Minka,et al.  Modeling user subjectivity in image libraries , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  B. S. Manjunath,et al.  Texture features and learning similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Ingemar J. Cox,et al.  Target testing and the PicHunter Bayesian multimedia retrieval system , 1996, Proceedings of the Third Forum on Research and Technology Advances in Digital Libraries,.

[10]  Erkki Oja,et al.  Engineering applications of the self-organizing map , 1996, Proc. IEEE.

[11]  Andre Csillaghy,et al.  Neural Network-Generated Indexing Features and Retrieval Effectiveness , 1997 .

[12]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[13]  Marco La Cascia,et al.  Image Digestion and Relevance Feedback in the ImageRover WWW Search Engine , 1997 .

[14]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[15]  Tat-Seng Chua,et al.  Relevance feedback techniques for color-based image retrieval , 1998, Proceedings 1998 MultiMedia Modeling. MMM'98 (Cat. No.98EX200).

[16]  Yan Gong,et al.  Intelligent image databases - towards advanced image retrieval , 1997, The Kluwer international series in engineering and computer science.

[17]  Shih-Fu Chang,et al.  Using Relevance Feedback in Content-Based Image Metasearch , 1998, IEEE Internet Comput..

[18]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[19]  Henning Müller,et al.  Relevance Feedback and Term Weighting Schemes for Content-Based Image Retrieval , 1999, VISUAL.

[20]  Samuel Kaski,et al.  Self organization of a massive text document collection , 1999 .

[21]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[22]  Kai-Kuang Ma,et al.  Colour Image Indexing Using SOM for Region-of-Interest Retrieval , 1999, Pattern Analysis & Applications.

[23]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[24]  Raimondo Schettini,et al.  Similarity retrieval of trademark images , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[25]  Simone Santini,et al.  Similarity Measures , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Raimondo Schettini,et al.  Content-based color image retrieval with relevance feedback , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[27]  Ishwar K. Sethi,et al.  Image retrieval using hierarchical self-organizing feature maps , 1999, Pattern Recognit. Lett..

[28]  Erkki Oja,et al.  PicSOM - content-based image retrieval with self-organizing maps , 2000, Pattern Recognit. Lett..

[29]  Anton Leuski,et al.  Relevance and reinforcement in interactive browsing , 2000, CIKM '00.

[30]  HongJiang Zhang,et al.  A Scheme for Visual Feature based Image Indexing , 2002 .