Nonnegative 3-way tensor factorization taking in to account possible missing data

This paper deals with the problem of incomplete data i.e. data with missing, unknown or unreliable values, in the polyadic decomposition of a nonnegative three-way tensor. The main advantage of the nonnegativity constraint is that the approximation problem becomes well posed. To tackle simultaneously these two problems, we suggest the use of a weighted least square cost function whose weights are gradually modified through the iterations. Moreover, the nonnegative nature of the loading matrices is taken into account directly in the problem parameterization. Then, the three gradient components can be explicitly derived allowing to efficiently implement the CP decomposition using standard optimization algorithms. In our case, we focus on the conjugate gradient and the BFGS algorithms. Finally, the good behaviour of the proposed approaches and their robustness versus possible model errors is illustrated through computer simulations in the context of data analysis.

[1]  Rasmus Bro,et al.  Multi-way Analysis with Applications in the Chemical Sciences , 2004 .

[2]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[3]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[4]  P. Paatero Construction and analysis of degenerate PARAFAC models , 2000 .

[5]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[6]  P. Paatero A weighted non-negative least squares algorithm for three-way ‘PARAFAC’ factor analysis , 1997 .

[7]  Pierre Comon,et al.  Computing the nonnegative 3-way tensor factorization using Tikhonov regularization , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  R. Bro,et al.  PARAFAC and missing values , 2005 .

[9]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[10]  Tamara G. Kolda,et al.  Scalable Tensor Factorizations for Incomplete Data , 2010, ArXiv.

[11]  P. Comon,et al.  Tensor decompositions, alternating least squares and other tales , 2009 .

[12]  Pierre Comon,et al.  Computing the polyadic decomposition of nonnegative third order tensors , 2011, Signal Process..

[13]  R. Bro,et al.  A fast non‐negativity‐constrained least squares algorithm , 1997 .

[14]  F. L. Hitchcock The Expression of a Tensor or a Polyadic as a Sum of Products , 1927 .

[15]  Pierre Comon,et al.  Nonnegative approximations of nonnegative tensors , 2009, ArXiv.