Inter-Query Relevance Learning in PicSOM for Content-Based Image Retrieval

Content-based image retrieval (CBIR) addresses the problem of finding images that the user wants from unannotated databases, based only on low-level visual features like color or texture that can be automatically derived from the images. Due to the inherently weak connection between the high-level semantic concepts that the user has in mind, and the low-level visual features that the system is using, the performance of CBIR applications often remains quite modest. One method for improving CBIR results is to try to learn the user’s preferences with learning methods such as relevance feedback. This learning is essentially intra-query, meaning that learning is started all over again in the beginning of each new query session. However, the relevance information can also be used in long-term or inter-query learning. In this paper, a method for using long-term learning in our PicSOM system is presented. It is shown that the efficiency of the system can be substantially increased by using it in parallel with MPEG-7 visual descriptors.

[1]  M.L. Miller,et al.  Hidden annotation in content based image retrieval , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[2]  Douglas R. Heisterkamp Building a latent semantic index of an image database from patterns of relevance feedback , 2002, Object recognition supported by user interaction for service robots.

[3]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[4]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[5]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[6]  Erkki Oja,et al.  PicSOM-self-organizing image retrieval with MPEG-7 content descriptors , 2002, IEEE Trans. Neural Networks.

[7]  Pasi Koikkalainen,et al.  Self-organizing hierarchical feature maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[8]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .