Region-based Image Retrieval Using Probabilistic Feature Relevance Learning

Abstract:Region-Based Image Retrieval (RBIR), a specialisation of content-based image retrieval, is a promising and important research area. RBIR usually requires good segmentation, which is often difficult to achieve in practice for several reasons, such as varying environmental conditions and occlusion. It is, therefore, imperative to develop effective mechanisms for interactive, region-based visual query in order to provide confident retrieval performance. In this paper, we present a novel RBIR system, Finding Region In the Pictures (FRIP), that uses human-centric relevance feedback to create similarity metric on-the-fly in order to overcome some of the limitations associated with RBIR systems. We use features such as colour, texture, normalised area, shape and location, extracted from each region of a segmented image, to represent image content. For each given query, we estimate local feature relevance using probabilistic relevance model, from which to create a flexible metric that is highly adaptive to query location. As a result, local data densities can be sufficiently exploited, whereby rapid performance improvement can be achieved. The efficacy of our method is validated and compared against other competing techniques using real world image data.

[1]  Chahab Nastar,et al.  Efficient query refinement for image retrieval , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[2]  Raimondo Schettini,et al.  A relevance feedback mechanism for content-based image retrieval , 1999, Inf. Process. Manag..

[3]  Bir Bhanu,et al.  Probabilistic Feature Relevance Learning for Content-Based Image Retrieval , 1999, Comput. Vis. Image Underst..

[4]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[5]  Jerome H. Friedman,et al.  Flexible Metric Nearest Neighbor Classification , 1994 .

[6]  Sugata Ghosal,et al.  iPURE: perceptual and user-friendly retrieval of images , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[7]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[8]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[9]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[10]  Ingemar J. Cox,et al.  An optimized interaction strategy for Bayesian relevance feedback , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[11]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[12]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[13]  Hyeran Byun,et al.  Region-based image retrieval system using efficient feature description , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[15]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.