A multi-class relevance feedback approach to image retrieval

Relevance feedback methods for content-based image retrieval have shown promise in a variety of image database applications. These techniques assume two-class relevance feedback, relevant and irrelevant. While simple computationally, two-class relevance feedback often becomes inadequate in providing sufficient information to help rapidly improve retrieval performance. We propose a locally adaptive technique for content-based image retrieval that enables relevance feedback to take on multi-class form. For each given query, we estimate local feature relevance based on Chi-squared analysis using information provided by multiclass relevance feedback. Local feature relevance is then used to compute a flexible metric that is highly adaptive to query locations. As a result, local data distributions can be sufficiently exploited, whereby rapid performance improvement can be achieved. Experimental results using real image data validate the efficacy of our method.

[1]  Thomas S. Huang,et al.  Optimizing learning in image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Bir Bhanu,et al.  Probabilistic Feature Relevance Learning for Content-Based Image Retrieval , 1999, Comput. Vis. Image Underst..

[3]  Keinosuke Fukunaga,et al.  The optimal distance measure for nearest neighbor classification , 1981, IEEE Trans. Inf. Theory.

[4]  Nuno Vasconcelos,et al.  A probabilistic architecture for content-based image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[6]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[8]  David J. Hand,et al.  The multi-class metric problem in nearest neighbour discrimination rules , 1990, Pattern Recognit..

[9]  Ramesh C. Jain,et al.  Similarity measures for image databases , 1995, Electronic Imaging.

[10]  Jing Peng,et al.  Feature relevance learning with query shifting for content-based image retrieval , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.