Improving image retrieval performance by inter-query learning with one-class support vector machines

Relevance feedback (RF) is an iterative process which improves the performance of content-based image retrieval by modifying the query and similarity metric based on the user’s feedback on the retrieval results. This short-term learning within a single query session is called intra-query learning. However, the interaction history of previous users over all past queries may also be potentially exploited to help improve the retrieval performance for the current query. The long-term learning accumulated over the course of many query sessions is called inter-query learning. We present a novel RF framework that learns one-class support vector machines (1SVM) from retrieval experience to represent the set memberships of users’ high-level concepts and stores them in a “concept database”. The “concept database” provides a mechanism for accumulating inter-query learning obtained from previous queries. By doing a fuzzy classification of a query into the regions of support represented by the 1SVMs, past experience is merged with current intra-query learning. The geometric view of 1SVM allows a straightforward interpretation of the density of past interaction in a local area of the feature space and thus allows the decision of exploiting past information only if enough past exploration of the local area has occurred. The proposed approach is evaluated on real data sets and compared against both traditional intra-query-learning-only RF approaches and other methods that also exploit inter-query learning.

[1]  Bir Bhanu,et al.  Probabilistic Feature Relevance Learning for Content-Based Image Retrieval , 1999, Comput. Vis. Image Underst..

[2]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[3]  Kenneth G. Manton,et al.  Fuzzy Cluster Analysis , 2005 .

[4]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[5]  Bir Bhanu,et al.  Improving retrieval performance by long-term relevance information , 2002, Object recognition supported by user interaction for service robots.

[6]  Douglas R. Heisterkamp Building a latent semantic index of an image database from patterns of relevance feedback , 2002, Object recognition supported by user interaction for service robots.

[7]  Mingjing Li,et al.  Statistical correlation analysis in image retrieval , 2002, Pattern Recognit..

[8]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[9]  Marko Balabanovic,et al.  Exploring Versus Exploiting when Learning User Models for Text Recommendation , 2004, User Modeling and User-Adapted Interaction.

[10]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[11]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[12]  Qi Tian,et al.  Incorporate support vector machines to content-based image retrieval with relevance feedback , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[13]  Thomas S. Huang,et al.  One-class SVM for learning in image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[14]  Bernhard Schölkopf,et al.  SV Estimation of a Distribution's Support , 1999, NIPS 1999.

[15]  J. C. Peters,et al.  Fuzzy cluster analysis--a new method to predict future cardiac events in patients with positive stress tests. , 1998, Japanese circulation journal.

[16]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[17]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[18]  Pavel Zezula,et al.  M-tree: An Efficient Access Method for Similarity Search in Metric Spaces , 1997, VLDB.

[19]  Bikramjit Banerjee,et al.  Kernel Index for Relevance feedback Retrieval , 2002, International Conference on Fuzzy Systems and Knowledge Discovery.

[20]  David M. J. Tax,et al.  One-class classification , 2001 .

[21]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .