Fast Nonnegative Tensor Factorization by Using Accelerated Proximal Gradient

Nonnegative tensor factorization (NTF) has been widely applied in high-dimensional nonnegative tensor data analysis. However, existing algorithms suffer from slow convergence caused by the nonnegativity constraint and hence their practical applications are severely limited. By combining accelerated proximal gradient and low-rank approximation, we propose a new NTF algorithm which is significantly faster than state-of-the-art NTF algorithms.

[1]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[2]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[3]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorizations : An algorithmic perspective , 2014, IEEE Signal Processing Magazine.

[4]  Peng Wu,et al.  Unsupervised Multi-Level Non-Negative Matrix Factorization Model: Binary Data Case , 2012, J. Information Security.

[5]  Andrzej Cichocki,et al.  Fast Nonnegative Matrix/Tensor Factorization Based on Low-Rank Approximation , 2012, IEEE Transactions on Signal Processing.

[6]  Zhigang Luo,et al.  NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization , 2012, IEEE Transactions on Signal Processing.

[7]  Tamara G. Kolda,et al.  MATLAB Tensor Toolbox , 2006 .

[8]  J. Kruskal.  Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[9]  Rasmus Bro,et al.  The N-way Toolbox for MATLAB , 2000 .

[10]  N. Sidiropoulos,et al.  On the uniqueness of multilinear decomposition of N‐way arrays , 2000 .

[11]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[12]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[13]  Peter Ladefoged,et al.  UCLA Working Papers in Phonetics, 23. , 1972 .

[14]  Gordon Wetzstein,et al.  Tensor displays , 2012, ACM Trans. Graph..

[15]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[16]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .