Nonnegative Matrix Factorization via Generalized Product Rule and Its Application for Classification

Nonnegative Matrix Factorization (NMF) is broadly used as a mathematical tool for processing tasks of tabulated data. In this paper, an extension of NMF based on a generalized product rule, defined with a nonlinear one-parameter function and its inverse, is proposed. From a viewpoint of subspace methods, the extended NMF constructs flexible subspaces which plays an important role in classification tasks. Experimental results on benchmark datasets show that the proposed extension improves classification accuracies.

[1]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[2]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[3]  A. Agresti Categorical data analysis , 1993 .

[4]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[5]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[6]  C. Genest Frank's family of bivariate distributions , 1987 .

[7]  P. Smaragdis,et al.  Non-negative matrix factorization for polyphonic music transcription , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[8]  Constantine Kotropoulos,et al.  Testing supervised classifiers based on non-negative matrix factorization to musical instrument classification , 2006, 2006 14th European Signal Processing Conference.

[9]  Zhi-Hua Zhou,et al.  Non-negative matrix factorization on Kernels , 2006 .

[10]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .

[11]  Bregman divergence and density integration , 2009 .

[12]  S. T. Buckland,et al.  An Introduction to the Bootstrap , 1994 .

[13]  Manfred K. Warmuth,et al.  Exponentiated Gradient Versus Gradient Descent for Linear Predictors , 1997, Inf. Comput..

[14]  Noboru Murata,et al.  A Generalization of Independence in Naive Bayes Model , 2010, IDEAL.

[15]  L. Bottou Stochastic Gradient Learning in Neural Networks , 1991 .

[16]  R. Nelsen An Introduction to Copulas , 1998 .

[17]  Constantine Kotropoulos,et al.  Applying Supervised Classifiers Based on Non-negative Matrix Factorization to Musical Instrument Classification , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[18]  R. Nelsen An Introduction to Copulas (Springer Series in Statistics) , 2006 .

[19]  Hujun Yin,et al.  Intelligent Data Engineering and Automated Learning - IDEAL 2010, 11th International Conference, Paisley, UK, September 1-3, 2010. Proceedings , 2010, IDEAL.

[20]  Michael W. Berry,et al.  Document clustering using nonnegative matrix factorization , 2006, Inf. Process. Manag..