Sequential Coordinate-Wise DNMF for Face Recognition

This paper proposes the Sequential Coordinate-Wise Algorithm (SCWA) to Discriminant Nonnegative Matrix Factorization (DNMF) for improving face recognition. DNMF incorporates Linear Discriminant Analysis (LDA) into NMF using the multiplicative updating rules that are simple in use but usually require many iterations to converge and they do not guarantee the convergence to a stationary point. The SCWA solves the Quadratic Programming (QP) problemby updating only a single variable at each iterative step, which considerably accelerates the convergence for sequentially projected Least Squares (LS) problems that take place in NMF. Moreover, the limit point of the SCWA is the stationary point. The proposed algorithm is tested for supervised face recognition problems where the facial images are taken from the ORL database.

[1]  Massimo Tistarelli,et al.  Biometrics and Identity Management , 2008, Lecture Notes in Computer Science.

[2]  Ioannis Pitas,et al.  Discriminant Non-negative Matrix Factorization and Projected Gradients for Frontal Face Verification , 2008, BIOID.

[3]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[4]  Andrzej Cichocki,et al.  Fast Nonnegative Matrix Factorization Algorithms Using Projected Gradient Approaches for Large-Scale Problems , 2008, Comput. Intell. Neurosci..

[5]  Chih-Jen Lin,et al.  On the Convergence of Multiplicative Update Algorithms for Nonnegative Matrix Factorization , 2007, IEEE Transactions on Neural Networks.

[6]  Václav Hlavác,et al.  Sequential Coordinate-Wise Algorithm for the Non-negative Least Squares Problem , 2005, CAIP.

[7]  D. Guillamet,et al.  Classifying Faces with Non-negative Matrix Factorization , 2002 .

[8]  Inderjit S. Dhillon,et al.  Fast Newton-type Methods for the Least Squares Nonnegative Matrix Approximation Problem , 2007, SDM.

[9]  Stan Z. Li,et al.  Learning spatially localized, parts-based representation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Anastasios Tefas,et al.  Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification , 2006, IEEE Transactions on Neural Networks.

[11]  Jordi Vitrià,et al.  Non-negative Matrix Factorization for Face Recognition , 2002, CCIA.

[12]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[13]  Yunde Jia,et al.  FISHER NON-NEGATIVE MATRIX FACTORIZATION FOR LEARNING LOCAL FEATURES , 2004 .

[14]  Ioannis Pitas,et al.  Nonnegative Matrix Factorization in Polynomial Feature Space , 2008, IEEE Transactions on Neural Networks.