Face Clustering in Photo Album

Digital photo management is becoming indispensable for the explosively growing family photo albums due to the rapid popularization of digital cameras and mobile phone cameras. An effective photo management system could accurately and efficiently group all faces of the same person into a small number of clusters. In this paper, we present a novel photo grouping method based on spectral theory. The key idea is to utilize prior information of family photo albums to improve the performance. First, an individual can only appear once in one photo, which works as the similarity constraint in our graph construction. Second, an individual cannot show more times than the number of photos in each album. That is, the size of a cluster for an individual is at most the number of photos in an album. We consider this constraint as a Minimum Cost Flow (MCF) linear network optimization problem and therefore propose a constrained K-Means for data clustering after graph embedding. Two metrics, i.e., accuracy (AC) and normalized mutual information metric (NMI), are used to evaluate the clustering performance. Extensive experimental results demonstrate the effectiveness of the proposed method.

[1]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[3]  Qiang Ji,et al.  Constrained Clustering and Its Application to Face Clustering in Videos , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yuandong Tian,et al.  A Face Annotation Framework with Partial Clustering and Interactive Labeling , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  政子 鶴岡,et al.  1998 IEEE International Conference on SMCに参加して , 1998 .

[6]  Andrew W. Fitzgibbon,et al.  On Affine Invariant Clustering and Automatic Cast Listing in Movies , 2002, ECCV.

[7]  Yuandong Tian,et al.  EasyAlbum: an interactive photo annotation system based on face clustering and re-ranking , 2007, CHI.

[8]  Inderjit S. Dhillon,et al.  Semi-supervised graph clustering: a kernel approach , 2005, ICML '05.

[9]  Ioannis Pitas,et al.  A Mutual Information based Face Clustering Algorithm for Movies , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[10]  Zhengdong Lu,et al.  Penalized Probabilistic Clustering , 2007, Neural Computation.

[11]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[13]  Xinlei Chen,et al.  Large Scale Spectral Clustering with Landmark-Based Representation , 2011, AAAI.

[14]  Ayhan Demiriz,et al.  Constrained K-Means Clustering , 2000 .

[15]  Jiawei Han,et al.  Document clustering using locality preserving indexing , 2005, IEEE Transactions on Knowledge and Data Engineering.

[16]  Philippe A. Palanque,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2014, International Conference on Human Factors in Computing Systems.

[17]  Dimitrios Mavroeidis Accelerating spectral clustering with partial supervision , 2010, Data Mining and Knowledge Discovery.

[18]  Charles A. Micchelli,et al.  On Spectral Learning , 2010, J. Mach. Learn. Res..

[19]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[20]  Tsuhan Chen,et al.  Clothing cosegmentation for recognizing people , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Cordelia Schmid,et al.  Unsupervised metric learning for face identification in TV video , 2011, 2011 International Conference on Computer Vision.

[22]  Jian Sun,et al.  A rank-order distance based clustering algorithm for face tagging , 2011, CVPR 2011.