Fast and Efficient Algorithms for Nonnegative Tucker Decomposition

In this paper, we propose new and efficient algorithms for nonnegative Tucker decomposition (NTD): Fast i¾?-NTD algorithm which is much precise and faster than i¾?-NTD [1]; and β-NTD algorithm based on the βdivergence. These new algorithms include efficient normalization and initialization steps which help to reduce considerably the running time and increase dramatically the performance. Moreover, the multilevel NTD scheme is also presented, allowing further improvements (almost perfect reconstruction). The performance was also compared to other well-known algorithms (HONMF, HOOI, ALS algorithms) for synthetic and real-world data as well.

[1]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[2]  Tamara G. Kolda,et al.  MATLAB Tensor Toolbox , 2006 .

[3]  Lars Kai Hansen,et al.  Algorithms for Sparse Nonnegative Tucker Decompositions , 2008, Neural Computation.

[4]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[5]  Zhaoshui He,et al.  Extended SMART Algorithms for Non-negative Matrix Factorization , 2006, ICAISC.

[6]  Andrzej Cichocki,et al.  Non-Negative Tensor Factorization using Alpha and Beta Divergences , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[7]  Rasmus Bro,et al.  The N-way Toolbox for MATLAB , 2000 .

[8]  Andrzej Cichocki,et al.  Nonnegative Tucker decomposition with alpha-divergence , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Ryszard Tadeusiewicz,et al.  Artificial Intelligence and Soft Computing - ICAISC 2006, 8th International Conference, Zakopane, Poland, June 25-29, 2006, Proceedings , 2006, International Conference on Artificial Intelligence and Soft Computing.

[10]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[11]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[12]  Yizhou Yu,et al.  Hierarchical Tensor Approximation of Multidimensional Images , 2007, 2007 IEEE International Conference on Image Processing.