Joint analysis of multiple datasets by cross-cumulant tensor (block) diagonalization

In this paper, we propose approximate diagonalization of a cross-cumulant tensor as a means to achieve independent component analysis (ICA) in several linked datasets. This approach generalizes existing cumulant-based independent vector analysis (IVA). It leads to uniqueness, identifiability and resilience to noise that exceed those in the literature, in certain scenarios. The proposed method can achieve blind identification of underdetermined mixtures when single-dataset cumulant-based methods that use the same order of statistics fall short. In addition, it is possible to analyse more than two datasets in a single tensor factorization. The proposed approach readily extends to independent subspace analysis (ISA), by tensor block-diagonalization. The proposed approach can be used as-is or as an ingredient in various data fusion frameworks, using coupled decompositions. The core idea can be used to generalize existing ICA methods from one dataset to an ensemble.

[1]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[2]  A. Cichocki,et al.  Non-Orthogonal Tensor Diagonalization, a Tool for Block Tensor Decompositions , 2014 .

[3]  Lieven De Lathauwer,et al.  Simultaneous Matrix Diagonalization : the Overcomplete Case , 2003 .

[4]  Te-Won Lee,et al.  Independent Vector Analysis: An Extension of ICA to Multivariate Components , 2006, ICA.

[5]  Pierre Comon,et al.  Blind Identification of Underdetermined Mixtures Based on the Characteristic Function: The Complex Case , 2011, IEEE Transactions on Signal Processing.

[6]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[7]  Ronald Phlypo,et al.  Independent vector analysis, the Kotz distribution, and performance bounds , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2006, Signal Process..

[9]  Vince D. Calhoun,et al.  Multidataset independent subspace analysis extends independent vector analysis , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[10]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[11]  L. Lathauwer,et al.  Blind source separation by higher-order singular value decomposition , 1994 .

[12]  P. Comon.  Tensor Diagonalization, A useful Tool in Signal Processing , 1994 .

[13]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part III: Alternating Least Squares Algorithms , 2008, SIAM J. Matrix Anal. Appl..

[14]  Qiu-Hua Lin,et al.  Non-orthogonal tensor diagonalization based on successive rotations and LU decomposition , 2015, 2015 11th International Conference on Natural Computation (ICNC).

[15]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[16]  B. De Moor,et al.  ICA algorithms for 3 sources and 2 sensors , 1999, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics. SPW-HOS '99.

[17]  F. L. Hitchcock.  The Expression of a Tensor or a Polyadic as a Sum of Products , 1927 .

[18]  Pierre Comon,et al.  Approximate tensor diagonalization by invertible transforms , 2009, 2009 17th European Signal Processing Conference.

[19]  Lieven De Lathauwer,et al.  Coupled Canonical Polyadic Decompositions and (Coupled) Decompositions in Multilinear Rank-(Lr, n, Lr, n, 1) Terms - Part I: Uniqueness , 2015, SIAM J. Matrix Anal. Appl..

[20]  D. Brillinger.  Time series - data analysis and theory , 1981, Classics in applied mathematics.

[21]  Tülay Adali,et al.  Second and Higher-Order Correlation Analysis of Multiple Multidimensional Variables by Joint Diagonalization , 2010, LVA/ICA.

[22]  Joos Vandewalle,et al.  Independent component analysis and (simultaneous) third-order tensor diagonalization , 2001, IEEE Trans. Signal Process..

[23]  Tülay Adali,et al.  Joint blind source separation by generalized joint diagonalization of cumulant matrices , 2011, Signal Process..

[24]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[25]  Eric Moreau,et al.  A generalization of joint-diagonalization criteria for source separation , 2001, IEEE Trans. Signal Process..

[26]  Tülay Adali,et al.  Joint blind source separation from second-order statistics: Necessary and sufficient identifiability conditions , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Pierre Comon,et al.  Canonical Polyadic Decomposition with a Columnwise Orthonormal Factor Matrix , 2012, SIAM J. Matrix Anal. Appl..

[28]  Christian Jutten,et al.  Joint Independent Subspace Analysis Using Second-Order Statistics , 2016, IEEE Transactions on Signal Processing.

[29]  Mgh Jansen.  CONTRIBUTIONS TO MATHEMATICAL PSYCHOLOGY, PSYCHOMETRICS, AND METHODOLOGY , 1994 .

[30]  Fabian J. Theis,et al.  Towards a general independent subspace analysis , 2006, NIPS.

[31]  Lieven De Lathauwer,et al.  Decompositions of a Higher-Order Tensor in Block Terms - Part II: Definitions and Uniqueness , 2008, SIAM J. Matrix Anal. Appl..

[32]  N. Sidiropoulos,et al.  On the uniqueness of multilinear decomposition of N‐way arrays , 2000 .

[33]  J. Kruskal.  Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .

[34]  P. Comon.  Independent Component Analysis , 1992 .

[35]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[36]  Tülay Adali,et al.  Joint Blind Source Separation With Multivariate Gaussian Model: Algorithms and Performance Analysis , 2012, IEEE Transactions on Signal Processing.

[37]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[38]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[39]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[40]  L. Lathauwer,et al.  Fetal electrocardiogram extraction by source subspace separation , 1995 .