Computing the nonnegative 3-way tensor factorization using Tikhonov regularization

This paper deals with the minimum polyadic decomposition of a nonnegative three-way array. The main advantage of the nonnegativity constraint is that the approximation problem becomes well posed. To tackle this problem, we suggest the use of a cost function including penalty terms built with matrix exponentials. Gradient components are then derived, allowing to efficiently implement the decomposition using classical optimization algorithms. In our case ALS and conjugate gradient algorithms are studied and compared with another existing algorithm, thanks to computer simulations performed in the context of data analysis.

[1]  Pierre Comon,et al.  Nonnegative 3-way tensor factorization via conjugate gradient with globally optimal stepsize , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  P. Comon,et al.  Tensor decompositions, alternating least squares and other tales , 2009 .

[3]  Rasmus Bro,et al.  Multi-way Analysis with Applications in the Chemical Sciences , 2004 .

[4]  Qiang Zhang,et al.  Tensor methods for hyperspectral data analysis: a space object material identification study. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[6]  C. G. Bollini,et al.  On the Reduction Formula of Feinberg and Pais , 1965 .

[7]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[8]  Pierre Comon,et al.  Tensors versus matrices usefulness and unexpected properties , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[9]  L. Lathauwer Tensor decompositions and applications : a survey , 2009 .

[10]  R. Bro PARAFAC. Tutorial and applications , 1997 .

[11]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[12]  Thomas Lickteig Typical tensorial rank , 1985 .

[13]  F. L. Hitchcock The Expression of a Tensor or a Polyadic as a Sum of Products , 1927 .

[14]  P. Paatero Construction and analysis of degenerate PARAFAC models , 2000 .

[15]  Pierre Comon,et al.  Nonnegative approximations of nonnegative tensors , 2009, ArXiv.