An alternative proof for the identifiability of independent vector analysis using second order statistics

In this paper, we present an alternative proof for characterizing the (non-) identifiability conditions of independent vector analysis (IVA). IVA extends blind source separation to several mixtures by taking into account statistical dependencies between mixtures. We focus on IVA in the presence of real Gaussian data with temporally independent and identically distributed samples. This model is always non-identifiable when each mixture is considered separately. However, it can be shown to be generically identifiable within the IVA framework. Our proof differs from previous ones by being based on direct factorization of a closed-form expression for the Fisher information matrix. Our analysis is based on a rigorous linear algebraic formulation, and leads to a new type of factorization of a structured matrix. Therefore, the proposed approach is of potential interest for a broader range of problems.

[1]  Matthew Anderson,et al.  Independent vector analysis: Theory, algorithms, and applications , 2013 .

[2]  Jean-Francois Cardoso,et al.  THE THREE EASY ROUTES TO INDEPENDENT COMPONENT ANALYSIS; CONTRASTS AND GEOMETRY , 2001 .

[3]  R. Cattell.  “Parallel proportional profiles” and other principles for determining the choice of factors by rotation , 1944 .

[4]  P. Ruiz,et al.  Extraction Of Independent Sources From Correlated Inputs A Solution Based On Cumulants , 1989, Workshop on Higher-Order Spectral Analysis.

[5]  Hagit Messer,et al.  Identifiability of second-order multidimensional ICA , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[6]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[7]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[8]  J. J. Lacoume,et al.  Sources indentification: a solution based on the cumulants , 1988, Fourth Annual ASSP Workshop on Spectrum Estimation and Modeling.

[9]  Christian Jutten,et al.  Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects , 2015, Proceedings of the IEEE.

[10]  Tülay Adali,et al.  Joint blind source separation from second-order statistics: Necessary and sufficient identifiability conditions , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Tülay Adalı,et al.  Diversity in Independent Component and Vector Analyses: Identifiability, algorithms, and applications in medical imaging , 2014, IEEE Signal Processing Magazine.

[12]  Lieven De Lathauwer,et al.  Coupled Canonical Polyadic Decompositions and (Coupled) Decompositions in Multilinear Rank-(Lr, n, Lr, n, 1) Terms - Part I: Uniqueness , 2015, SIAM J. Matrix Anal. Appl..

[13]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[14]  Christian Jutten,et al.  Joint Independent Subspace Analysis Using Second-Order Statistics , 2016, IEEE Transactions on Signal Processing.

[15]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[16]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[17]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[18]  Te-Won Lee,et al.  Independent Vector Analysis: An Extension of ICA to Multivariate Components , 2006, ICA.

[19]  Vince D. Calhoun,et al.  Dynamic changes of spatial functional network connectivity in healthy individuals and schizophrenia patients using independent vector analysis , 2014, NeuroImage.

[20]  Ronald Phlypo,et al.  Orthogonal and non-orthogonal joint blind source separation in the least-squares sense , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[21]  Tülay Adali,et al.  A maximum likelihood approach for independent vector analysis of Gaussian data sets , 2011, 2011 IEEE International Workshop on Machine Learning for Signal Processing.

[22]  Vince D. Calhoun,et al.  Data-driven fusion of EEG, functional and structural MRI: A comparison of two models , 2014, 2014 48th Annual Conference on Information Sciences and Systems (CISS).

[23]  Rasmus Bro,et al.  MULTI-WAY ANALYSIS IN THE FOOD INDUSTRY Models, Algorithms & Applications , 1998 .

[24]  Ronald Phlypo,et al.  Independent Vector Analysis: Identification Conditions and Performance Bounds , 2013, IEEE Transactions on Signal Processing.

[25]  Christian Jutten,et al.  A Generalization to Schur's Lemma with an Application to Joint Independent Subspace Analysis , 2016 .