CONFAC Decomposition Approach to Blind Identification of Underdetermined Mixtures Based on Generating Function Derivatives

This work proposes a new tensor-based approach to solve the problem of blind identification of underdetermined mixtures of complex-valued sources exploiting the cumulant generating function (CGF) of the observations. We show that a collection of second-order derivatives of the CGF of the observations can be stored in a third-order tensor following a constrained factor (CONFAC) decomposition with known constrained structure. In order to increase the diversity, we combine three derivative types into an extended third-order CONFAC decomposition. A detailed uniqueness study of this decomposition is provided, from which easy-to-check sufficient conditions ensuring the essential uniqueness of the mixing matrix are obtained. From an algorithmic viewpoint, we develop a CONFAC-based enhanced line search (CONFAC-ELS) method to be used with an alternating least squares estimation procedure for accelerated convergence, and also analyze the numerical complexities of two CONFAC-based algorithms (namely, CONFAC-ALS and CONFAC-ELS) in comparison with the Levenberg-Marquardt (LM)-based algorithm recently derived to solve the same problem. Simulation results compare the proposed approach with some higher-order methods. Our results also corroborate the advantages of the CONFAC-based approach over the competing LM-based approach in terms of performance and computational complexity.

[1]  H. B. Curry The method of steepest descent for non-linear minimization problems , 1944 .

[2]  P. Comon,et al.  Blind Identification of Overcomplete MixturEs of sources (BIOME) , 2004 .

[3]  Lieven De Lathauwer,et al.  Blind Identification of Underdetermined Mixtures by Simultaneous Matrix Diagonalization , 2008, IEEE Transactions on Signal Processing.

[4]  J. Berge,et al.  On uniqueness in candecomp/parafac , 2002 .

[5]  Age K. Smilde,et al.  Constrained three‐mode factor analysis as a tool for parameter estimation with second‐order instrumental data , 1998 .

[6]  Alwin Stegeman,et al.  On Uniqueness of the Canonical Tensor Decomposition with Some Form of Symmetry , 2011, SIAM J. Matrix Anal. Appl..

[7]  A. Smilde,et al.  Non‐triviality and identification of a constrained Tucker3 analysis , 2002 .

[8]  A. Ferreol,et al.  Blind identification of underdetermined mixtures based on the hexacovariance , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Alwin Stegeman,et al.  On Uniqueness of the nth Order Tensor Decomposition into Rank-1 Terms with Linear Independence in One Mode , 2010, SIAM J. Matrix Anal. Appl..

[10]  Daniel M. Dunlavy,et al.  A scalable optimization approach for fitting canonical tensor decompositions , 2011 .

[11]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[12]  Laurent Albera,et al.  Blind identification of underdetermined mixtures based on the hexacovariance and higher-order cyclostationarity , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[13]  Lieven De Lathauwer,et al.  Blind Deconvolution of DS-CDMA Signals by Means of Decomposition in Rank-$(1,L,L)$ Terms , 2008, IEEE Transactions on Signal Processing.

[14]  Nikos D. Sidiropoulos,et al.  Batch and Adaptive PARAFAC-Based Blind Separation of Convolutive Speech Mixtures , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  P. Paatero The Multilinear Engine—A Table-Driven, Least Squares Program for Solving Multilinear Problems, Including the n-Way Parallel Factor Analysis Model , 1999 .

[16]  Lieven De Lathauwer,et al.  Fourth-Order Cumulant-Based Blind Identification of Underdetermined Mixtures , 2007, IEEE Transactions on Signal Processing.

[17]  Nikos D. Sidiropoulos,et al.  Blind PARAFAC receivers for DS-CDMA systems , 2000, IEEE Trans. Signal Process..

[18]  L. Lathauwer,et al.  Fetal electrocardiogram extraction by source subspace separation , 1995 .

[19]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[20]  Nobuhiko Kitawaki,et al.  Combined approach of array processing and independent component analysis for blind separation of acoustic signals , 2003, IEEE Trans. Speech Audio Process..

[21]  A. Stegeman,et al.  On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition , 2007 .

[22]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[23]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[24]  Rasmus Bro,et al.  A comparison of algorithms for fitting the PARAFAC model , 2006, Comput. Stat. Data Anal..

[25]  Pierre Comon,et al.  Blind Identification of Complex Under-Determined Mixtures , 2004, ICA.

[26]  Pierre Comon,et al.  Enhanced Line Search: A Novel Method to Accelerate PARAFAC , 2008, SIAM J. Matrix Anal. Appl..

[27]  Athina P. Petropulu,et al.  PARAFAC-Based Blind Estimation Of Possibly Underdetermined Convolutive MIMO Systems , 2008, IEEE Transactions on Signal Processing.

[28]  Jean-Francois Cardoso,et al.  Super-symmetric decomposition of the fourth-order cumulant tensor. Blind identification of more sources than sensors , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[29]  Lieven De Lathauwer,et al.  A Block Component Model-Based Blind DS-CDMA Receiver , 2008, IEEE Transactions on Signal Processing.

[30]  Pierre Comon,et al.  Blind identification and source separation in 2×3 under-determined mixtures , 2004, IEEE Trans. Signal Process..

[31]  StegemanAlwin On Uniqueness of the $n$th Order Tensor Decomposition into Rank-1 Terms with Linear Independence in One Mode , 2010 .

[32]  Lieven De Lathauwer,et al.  A Link between the Canonical Decomposition in Multilinear Algebra and Simultaneous Matrix Diagonalization , 2006, SIAM J. Matrix Anal. Appl..

[33]  Lieven De Lathauwer,et al.  An enhanced line search scheme for complex-valued tensor decompositions. Application in DS-CDMA , 2008, Signal Process..

[34]  A. Franc Etude algébrique des multitableaux : apports de l'algèbre tensorielle , 1992 .

[35]  João Cesar M. Mota,et al.  Blind channel identification algorithms based on the Parafac decomposition of cumulant tensors: The single and multiuser cases , 2008, Signal Process..

[36]  R. Bro PARAFAC. Tutorial and applications , 1997 .

[37]  Volker Strassen,et al.  Algebraic Complexity Theory , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[38]  G. Favier,et al.  Space-Time Multiplexing Codes: A Tensor Modeling Approach , 2006, 2006 IEEE 7th Workshop on Signal Processing Advances in Wireless Communications.

[39]  Zbynek Koldovský,et al.  Weight Adjusted Tensor Method for Blind Separation of Underdetermined Mixtures of Nonstationary Sources , 2011, IEEE Transactions on Signal Processing.

[40]  Joos Vandewalle,et al.  Computation of the Canonical Decomposition by Means of a Simultaneous Generalized Schur Decomposition , 2005, SIAM J. Matrix Anal. Appl..

[41]  P. Comon,et al.  Tensor decompositions, alternating least squares and other tales , 2009 .

[42]  P. Comon,et al.  Ica: a potential tool for bci systems , 2008, IEEE Signal Processing Magazine.

[43]  Nikos D. Sidiropoulos,et al.  Parallel factor analysis in sensor array processing , 2000, IEEE Trans. Signal Process..

[44]  André Lima Férrer de Almeida,et al.  A Constrained Factor Decomposition With Application to MIMO Antenna Systems , 2008, IEEE Transactions on Signal Processing.

[45]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[46]  Pierre Comon,et al.  Blind identification of under-determined mixtures based on the characteristic function , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[47]  Arie Yeredor,et al.  Blind source separation via the second characteristic function , 2000, Signal Process..

[48]  André De Almeida,et al.  Tensor modeling and signal processing for wireless communication systems. (Modélisation et traitement tensoriel du signal pour les systèmes de communication sans-fil) , 2007 .

[49]  André Lima Férrer de Almeida,et al.  Constrained Tensor Modeling Approach to Blind Multiple-Antenna CDMA Schemes , 2008, IEEE Transactions on Signal Processing.

[50]  Pierre Comon,et al.  Blind Identification of Underdetermined Mixtures Based on the Characteristic Function: The Complex Case , 2011, IEEE Transactions on Signal Processing.

[51]  André Lima Férrer de Almeida,et al.  PARAFAC-based unified tensor modeling for wireless communication systems with application to blind multiuser equalization , 2007, Signal Process..

[52]  Nikos D. Sidiropoulos,et al.  Kruskal's permutation lemma and the identification of CANDECOMP/PARAFAC and bilinear models with constant modulus constraints , 2004, IEEE Transactions on Signal Processing.

[53]  Anisse Taleb,et al.  An algorithm for the blind identification of N independent signals with 2 sensors , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[54]  Richard A. Harshman,et al.  Determination and Proof of Minimum Uniqueness Conditions for PARAFAC1 , 1972 .

[55]  André Lima Férrer de Almeida,et al.  Uniqueness Conditions for Constrained Three-Way Factor Decompositions with Linearly Dependent Loadings , 2009, SIAM J. Matrix Anal. Appl..

[56]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[57]  Athina P. Petropulu,et al.  Frequency domain blind MIMO system identification based on second and higher order statistics , 2001, IEEE Trans. Signal Process..

[58]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[59]  L. Lathauwer,et al.  An enhanced plane search scheme for complex-valued tensor decompositions , 2010 .

[60]  Rasmus Bro,et al.  MULTI-WAY ANALYSIS IN THE FOOD INDUSTRY Models, Algorithms & Applications , 1998 .

[61]  R. Bro,et al.  Tracing dissolved organic matter in aquatic environments using a new approach to fluorescence spectroscopy , 2003 .

[62]  Yuanning Yu,et al.  Blind MIMO System Estimation Based on PARAFAC Decomposition of Higher Order Output Tensors , 2006, IEEE Transactions on Signal Processing.

[63]  J. Kruskal Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics , 1977 .