General tensor decomposition, moment matrices and applications

The tensor decomposition addressed in this paper may be seen as a generalization of Singular Value Decomposition of matrices. We consider general multilinear and multihomogeneous tensors. We show how to reduce the problem to a truncated moment matrix problem and give a new criterion for flat extension of Quasi-Hankel matrices. We connect this criterion to the commutation characterization of border bases. A new algorithm is described. It applies for general multihomogeneous tensors, extending the approach on binary forms by J.J. Sylvester. An example illustrates the algebraic operations involved in this approach and how the decomposition can be recovered from eigenvector computation.

[1]  N. Trung,et al.  On the Ideals of Secant Varieties to Certain Rational Varieties , 2006 .

[2]  P. Comon,et al.  Symmetric tensor decomposition , 2009, 2009 17th European Signal Processing Conference.

[3]  L. Chiantini,et al.  Weakly defective varieties , 2001 .

[4]  Pierre Comon,et al.  Multihomogeneous polynomial decomposition using moment matrices , 2011, ISSAC '11.

[5]  Xiang-dong Hou,et al.  Multivariate polynomials , 2013, Handbook of Finite Fields.

[6]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[7]  Grazia Lotti,et al.  O(n2.7799) Complexity for n*n Approximate Matrix Multiplication , 1979, Inf. Process. Lett..

[8]  A. Geramita,et al.  Ranks of tensors, secant varieties of Segre varieties and fat points , 2002 .

[9]  Jerry M. Mendel,et al.  Applications of cumulants to array processing - I. Aperture extension and array calibration , 1995, IEEE Trans. Signal Process..

[10]  Antonio Laface,et al.  Secant varieties of Segre-Veronese embeddings of $$(\mathbb{P }^1)^r$$ , 2013 .

[11]  Laurent Albera,et al.  On the virtual array concept for higher order array processing , 2005, IEEE Transactions on Signal Processing.

[12]  Alessandra Bernardi,et al.  Ideals of varieties parameterized by certain symmetric tensors , 2007, 0705.1942.

[13]  P. Comon,et al.  Tensor decompositions, alternating least squares and other tales , 2009 .

[14]  J. M. Landsberg,et al.  On the Ideals of Secant Varieties of Segre Varieties , 2004, Found. Comput. Math..

[15]  Huy Tai Ha Box-shaped matrices and the defining ideal of certain blowup surfaces , 2002 .

[16]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[17]  Nikos D. Sidiropoulos,et al.  Parallel factor analysis in sensor array processing , 2000, IEEE Trans. Signal Process..

[18]  Bernard Mourrain,et al.  A Sparse Flat Extension Theorem for Moment Matrices , 2008, ArXiv.

[19]  J. Landsberg,et al.  Equations for secant varieties of Veronese and other varieties , 2011, 1111.4567.

[20]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[21]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[22]  J. M. Landsberg,et al.  Geometry and the complexity of matrix multiplication , 2007, ArXiv.

[23]  J. M. Landsberg,et al.  Equations for secant varieties via vector bundles , 2010, 1010.1825.

[24]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[25]  David A. Cox,et al.  Using Algebraic Geometry , 1998 .

[26]  Pierre Comon,et al.  Decomposition of quantics in sums of powers of linear forms , 1996, Signal Process..

[27]  M. Atkinson,et al.  On the maximal multiplicative complexity of a family of bilinear forms , 1979 .

[28]  J. Landsberg,et al.  On the ideals and singularities of secant varieties of Segre varieties , 2006, math/0601452.

[29]  Elizabeth S. Allman,et al.  Phylogenetic ideals and varieties for the general Markov model , 2004, Adv. Appl. Math..

[30]  Ananthram Swami,et al.  Multichannel ARMA processes , 1994, IEEE Trans. Signal Process..

[31]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[32]  Arogyaswami Paulraj,et al.  An analytical constant modulus algorithm , 1996, IEEE Trans. Signal Process..

[33]  J. Landsberg,et al.  Generalizations of Strassen's Equations for Secant Varieties of Segre Varieties , 2006, math/0601097.

[34]  Nikos D. Sidiropoulos,et al.  Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models with constant modulus constraints , 2004, IEEE Transactions on Signal Processing.

[35]  Volker Strassen,et al.  Algebraic Complexity Theory , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[36]  Mohamed Elkadi,et al.  Introduction à la résolution des systèmes polynomiaux , 2007 .

[37]  David Zhang,et al.  Signal and Image Processing , 2000 .

[38]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[39]  A. Iarrobino,et al.  Power Sums, Gorenstein Algebras, and Determinantal Loci , 2000 .

[40]  Robert Grone,et al.  Decomposable tensors as a quadratic variety , 1977 .

[41]  Victor Y. Pan,et al.  Multivariate Polynomials, Duality, and Structured Matrices , 2000, J. Complex..

[42]  Bernard Mourrain,et al.  A generalized flat extension theorem for moment matrices , 2009 .

[43]  Bernard Mourrain,et al.  A New Criterion for Normal Form Algorithms , 1999, AAECC.

[44]  C. D. Boor,et al.  Polynomial interpolation in several variables , 1994 .

[45]  Joseph M. Landsberg,et al.  The complexity of matrix multiplication , 2011 .

[46]  Tomas Sauer,et al.  Polynomial interpolation in several variables , 2000, Adv. Comput. Math..

[47]  Henk A. L. Kiers,et al.  An efficient algorithm for PARAFAC of three-way data with large numbers of observation units , 1991 .

[48]  R. Bro PARAFAC. Tutorial and applications , 1997 .

[49]  Pascal Chevalier,et al.  Optimal separation of independent narrow-band sources: Concept and performance , 1999, Signal Process..

[50]  Giorgio Ottaviani,et al.  On Generic Identifiability of 3-Tensors of Small Rank , 2011, SIAM J. Matrix Anal. Appl..

[51]  Gonzalo Comas,et al.  On the Rank of a Binary Form , 2011, Found. Comput. Math..

[52]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[53]  Pierre Comon,et al.  Symmetric tensor decomposition , 2009, 2009 17th European Signal Processing Conference.

[54]  Alessandra Bernardi,et al.  Computing symmetric rank for symmetric tensors , 2009, J. Symb. Comput..

[55]  J. Landsberg,et al.  Equations for secant varieties to Veronese varieties , 2010, 1006.0180.

[56]  Chris Peterson,et al.  Induction for secant varieties of Segre varieties , 2006, math/0607191.

[57]  Michael Clausen,et al.  Algebraic complexity theory , 1997, Grundlehren der mathematischen Wissenschaften.

[58]  V. Strassen Rank and optimal computation of generic tensors , 1983 .

[59]  L. Lathauwer,et al.  On the Best Rank-1 and Rank-( , 2004 .

[60]  Mario Pucci,et al.  The Veronese Variety and Catalecticant Matrices , 1998 .

[61]  Ravi P. Agarwal,et al.  The Canonical Forms , 2009 .

[62]  David A. Cox,et al.  Ideals, Varieties, and Algorithms , 1997 .

[63]  J. Sylvester,et al.  LX. On a remarkable discovery in the theory of canonical forms and of hyperdeterminants , 1851 .

[64]  Nikos D. Sidiropoulos,et al.  Blind PARAFAC receivers for DS-CDMA systems , 2000, IEEE Trans. Signal Process..

[65]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[66]  H A Huy,et al.  Box-shaped Matrices and the Defining Ideal of Certain Blowup Surfaces , 2002 .

[67]  Anne Ferréol,et al.  On the behavior of current second and higher order blind source separation methods for cyclostationary sources , 2000, IEEE Trans. Signal Process..

[68]  E. Ballico,et al.  Stratification of the fourth secant variety of Veronese varieties via the symmetric rank , 2010, 1005.3465.

[69]  Lieven De Lathauwer,et al.  Tensor-based techniques for the blind separation of DS-CDMA signals , 2007, Signal Process..

[70]  G. Ottaviani An Invariant Regarding Waring’s Problem for Cubic Polynomials , 2007, Nagoya Mathematical Journal.

[71]  J. M. Landsberg,et al.  Determinantal equations for secant varieties and the Eisenbud–Koh–Stillman conjecture , 2010, J. Lond. Math. Soc..