Globally convergent Jacobi-type algorithms for simultaneous orthogonal symmetric tensor diagonalization

In this paper, we consider a family of Jacobi-type algorithms for a simultaneous orthogonal diagonalization problem of symmetric tensors. For the Jacobi-based algorithm of [M. Ishteva, P.-A. Absil, and P. Van Dooren, SIAM J. Matrix Anal. Appl., 34 (2013), pp. 651--672], we prove its global convergence for simultaneous orthogonal diagonalization of symmetric matrices and 3rd-order tensors. We also propose a new Jacobi-based algorithm in the general setting and prove its global convergence for sufficiently smooth functions.

[1]  Tamara G. Kolda,et al.  Orthogonal Tensor Decompositions , 2000, SIAM J. Matrix Anal. Appl..

[2]  Pierre Comon Independent component analysis - a new concept? signal processing , 1994 .

[3]  Harold R. Parks,et al.  A Primer of Real Analytic Functions , 1992 .

[4]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[5]  Sabine Van Huffel,et al.  Tucker compression and local optima , 2011 .

[6]  P. Comon,et al.  TENSOR DIAGONALIZATION BY ORTHOGONAL TRANSFORMS , 2007 .

[7]  Pierre Comon,et al.  Tensors : A brief introduction , 2014, IEEE Signal Processing Magazine.

[8]  W. Marsden I and J , 2012 .

[9]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[10]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2014, Math. Program..

[11]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[12]  Liqi Wang,et al.  On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors , 2014, SIAM J. Matrix Anal. Appl..

[13]  Joos Vandewalle,et al.  Blind source separation by simultaneous third-order tensor diagonalization , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[14]  Robert E. Mahony,et al.  Optimization Algorithms on Matrix Manifolds , 2007 .

[15]  相良 節夫 10th IFAC Symposium on System Identification (SYSID'94) , 1994 .

[16]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[17]  Daniel Kressner,et al.  Structure-Preserving Low Multilinear Rank Approximation of Antisymmetric Tensors , 2016, SIAM J. Matrix Anal. Appl..

[18]  P. Comon Tensor Diagonalization, A useful Tool in Signal Processing , 1994 .

[19]  A. Uschmajew,et al.  A new convergence proof for the higher-order power method and generalizations , 2014, 1407.4586.

[20]  Pierre Comon,et al.  Nonnegative approximations of nonnegative tensors , 2009, ArXiv.

[21]  Robert E. Mahony,et al.  Convergence of the Iterates of Descent Methods for Analytic Cost Functions , 2005, SIAM J. Optim..

[22]  C. Chaux,et al.  A new penalized nonnegative third‐order tensor decomposition using a block coordinate proximal gradient approach: Application to 3D fluorescence spectroscopy , 2017 .

[23]  Gene H. Golub,et al.  Symmetric Tensors and Symmetric Tensor Rank , 2008, SIAM J. Matrix Anal. Appl..

[24]  Joos Vandewalle,et al.  Independent component analysis and (simultaneous) third-order tensor diagonalization , 2001, IEEE Trans. Signal Process..

[25]  Carla D. Moravitz Martin,et al.  A Jacobi-Type Method for Computing Orthogonal Tensor Decompositions , 2008, SIAM J. Matrix Anal. Appl..

[26]  L. De Lathauwer,et al.  Algebraic methods after prewhitening , 2010 .

[27]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[28]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[29]  Reinhold Schneider,et al.  Convergence Results for Projected Line-Search Methods on Varieties of Low-Rank Matrices Via Łojasiewicz Inequality , 2014, SIAM J. Optim..

[30]  Paul Van Dooren,et al.  Jacobi Algorithm for the Best Low Multilinear Rank Approximation of Symmetric Tensors , 2013, SIAM J. Matrix Anal. Appl..

[31]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..