Tensor Decompositions, State of the Art and Applications

In this paper, we present a partial survey of the tools borrowed from tensor algebra, which have been utilized recently in Statistics and Signal Processing. It is shown why the decompositions well known in linear algebra can hardly be extended to tensors. The concept of rank is itself difficult to define, and its calculation raises difficulties. Numerical algorithms have nevertheless been developed, and some are reported here, but their limitations are emphasized. These reports hopefully open research perspectives for enterprising readers.

[1]  Gian-Carlo Rota,et al.  Apolarity and Canonical Forms for Homogeneous Polynomials , 1993, Eur. J. Comb..

[2]  P. Hoyer,et al.  DENOISING OF NONGAUSSIAN DATA BY INDEPENDENT COMPONENT ANALYSIS AND SPARSE CODING , 1999 .

[3]  P. Comon Tensor Diagonalization, A useful Tool in Signal Processing , 1994 .

[4]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[5]  O. Grellier,et al.  Closed-form blind channel identification with MSK inputs , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[6]  Ali Mansour,et al.  Blind Separation of Sources , 1999 .

[7]  P. Regalia,et al.  Tensor displacement structures and polyspectral matching , 1999 .

[8]  R. Bro PARAFAC. Tutorial and applications , 1997 .

[9]  Pierre Comon,et al.  Decomposition of quantics in sums of powers of linear forms , 1996, Signal Process..

[10]  P. Gomon,et al.  Block methods for channel identification and source separation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[11]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[12]  T. Rao,et al.  Tensor Methods in Statistics , 1989 .

[13]  B. Reznick Sums of Even Powers of Real Linear Forms , 1992 .

[14]  S. Haykin Unsupervised adaptive filtering, vol. 1: Blind source separation , 2000 .

[15]  T. Howell,et al.  Global properties of tensor rank , 1978 .

[16]  Terrence J. Sejnowski,et al.  Blind source separation of more sources than mixtures using overcomplete representations , 1999, IEEE Signal Processing Letters.

[17]  J. Levin Three-mode factor analysis. , 1965, Psychological bulletin.

[18]  Nikos D. Sidiropoulos,et al.  Parallel factor analysis in sensor array processing , 2000, IEEE Trans. Signal Process..

[19]  G. Bienvenu,et al.  Optimality of high resolution array processing using the eigensystem approach , 1983 .

[20]  G. Rota,et al.  The invariant theory of binary forms , 1984 .

[21]  Anne Ferréol,et al.  On the behavior of current second and higher order blind source separation methods for cyclostationary sources , 2000, IEEE Trans. Signal Process..

[22]  Alle-Jan van der Veen,et al.  IEEE TRANSACTIONS ON SIGNAL PROCESSING 1 Analytical Method for Blind Binary Signal Separation , 2022 .

[23]  O. Grellier,et al.  Analytical blind identification of a SISO communication channel , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[24]  Pierre Comon,et al.  From source separation to blind equalization, contrast-based approaches , 2001 .

[25]  O. Grellier NON LINEAR INVERSION OF UNDERDETERMINED MIXTURES Pierre COMON and Olivier GRELLIER , 1999 .

[26]  Paul Geladi,et al.  Analysis of multi-way (multi-mode) data , 1989 .

[27]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[28]  Lang Tong,et al.  Identification of multichannel MA parameters using higher-order statistics , 1996, Signal Process..

[29]  Mats Viberg,et al.  Blind estimation of multiple co-channel digital signals arriving at an antenna array , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[30]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[31]  S. Leurgans,et al.  A Decomposition for Three-Way Arrays , 1993, SIAM J. Matrix Anal. Appl..

[32]  Pierre Comon,et al.  Analytical blind discrete source separation , 2000, 2000 10th European Signal Processing Conference.

[33]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[34]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[35]  J. Kruskal,et al.  Candelinc: A general approach to multidimensional analysis of many-way arrays with linear constraints on parameters , 1980 .

[36]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[37]  Fabrice Gamboa,et al.  Source separation when the input sources are discrete or have constant modulus , 1997, IEEE Trans. Signal Process..

[38]  Arogyaswami Paulraj,et al.  An analytical constant modulus algorithm , 1996, IEEE Trans. Signal Process..

[39]  P. Comon,et al.  ICA-based technique for radiating sources estimation: application to airport surveillance , 1993 .

[40]  J. Cardoso,et al.  A tetradic decomposition of 4th-order tensors: Application to the source separation problem , 1995 .

[41]  G. Bergman Ranks of tensors and change of base field , 1969 .

[42]  Gene H. Golub,et al.  Matrix computations , 1983 .

[43]  Thomas Kailath,et al.  Fast reliable algorithms for matrices with structure , 1999 .

[44]  L. Castedo,et al.  Maximizing the information transfer for adaptive unsupervised source separation , 1997, First IEEE Signal Processing Workshop on Signal Processing Advances in Wireless Communications.

[45]  Pierre Comon,et al.  Blind channel identification and extraction of more sources than sensors , 1998, Optics & Photonics.

[46]  L. Lathauwer,et al.  Fetal electrocardiogram extraction by source subspace separation , 1995 .

[47]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[48]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[49]  Ruey-Wen Liu,et al.  General approach to blind source separation , 1996, IEEE Trans. Signal Process..

[50]  Eric Moreau,et al.  Self-adaptive source separation .I. Convergence analysis of a direct linear network controlled by the Herault-Jutten algorithm , 1997, IEEE Trans. Signal Process..

[51]  Jean-Francois Cardoso,et al.  Source separation using higher order moments , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[52]  Calyampudi R. Rao,et al.  Characterization Problems in Mathematical Statistics , 1976 .

[53]  P. Comon Independent Component Analysis , 1992 .

[54]  Alle-Jan van der Veen,et al.  Direction-of-arrival estimation for constant modulus signals , 1999, IEEE Trans. Signal Process..

[55]  P. Comon,et al.  Higher-order power method - application in independent component analysis , 1995 .

[56]  Richard A. Harshman,et al.  Determination and Proof of Minimum Uniqueness Conditions for PARAFAC1 , 1972 .

[57]  George Salmon Lessons introductory to the modern higher algebra , 1885 .

[58]  I. Shafarevich Basic algebraic geometry , 1974 .

[59]  L. Lathauwer,et al.  Signal Processing based on Multilinear Algebra , 1997 .

[60]  B. De Moor,et al.  ICA algorithms for 3 sources and 2 sensors , 1999, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics. SPW-HOS '99.

[61]  Maurice G. Kendall,et al.  The advanced theory of statistics , 1945 .

[62]  P. Comon Separation Of Stochastic Processes , 1989, Workshop on Higher-Order Spectral Analysis.

[63]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[64]  Terrence J. Sejnowski,et al.  Learning Nonlinear Overcomplete Representations for Efficient Coding , 1997, NIPS.

[65]  J. Pesquet,et al.  Generalized contrasts for multichannel blind deconvolution of linear systems , 1997, IEEE Signal Processing Letters.

[66]  S. S. Wilks,et al.  The Advanced Theory of Statistics. I. Distribution Theory , 1959 .

[67]  Joos Vandewalle,et al.  A singular value decomposition for higher-order tensors , 1993 .

[68]  Arogyaswami Paulraj,et al.  Blind separation of synchronous co-channel digital signals using an antenna array. I. Algorithms , 1996, IEEE Trans. Signal Process..

[69]  Jean Pierre Delmas,et al.  Robustness of least-squares and subspace methods for blind channel identification/equalization with respect to effective channel undermodeling/overmodeling , 1999, IEEE Trans. Signal Process..

[70]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[71]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[72]  L. Lathauwer,et al.  From Matrix to Tensor : Multilinear Algebra and Signal Processing , 1996 .