Separation of instantaneous mixtures of a particular set of dependent sources using classical ICA methods

This article deals with the problem of blind source separation in the case of a linear and instantaneous mixture. We first investigate the behavior of known independent component analysis (ICA) methods in the case where the independence assumption is violated: specific dependent sources are introduced and it is shown that, depending on the source vector, the separation may be successful or not. For sources which are a probability mixture of the previous dependent ones and of independent sources, we introduce an extended ICA model. More generally, depending on the value of a hidden latent process at the same time, the unknown components of the linear mixture are assumed either mutually independent or dependent. We propose for this model a separation method which combines: (i) a classical ICA separation performed using the set of samples whose components are conditionally independent, and (ii) a method for estimation of the latent process. The latter task is performed by iterative conditional estimation (ICE). It is an estimation technique in the case of incomplete data, which is particularly appealing because it requires only weak conditions.

[1]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[2]  Pierre Comon,et al.  Blind identification and source separation in 2×3 under-determined mixtures , 2004, IEEE Trans. Signal Process..

[3]  Aapo Hyvärinen,et al.  Topographic Independent Component Analysis , 2001, Neural Computation.

[4]  Harold W. Gutch,et al.  An ISA algorithm with unknown group sizes identifies meaningful clusters in metabolomics data , 2011, 2011 19th European Signal Processing Conference.

[5]  Pierre Comon,et al.  Blind Separation of Instantaneous Mixtures of Dependent Sources , 2007, ICA.

[6]  Kathryn B. Laskey,et al.  Uncertainty in Artificial Intelligence 15 , 1999 .

[7]  Jean Pierre Delmas,et al.  An equivalence of the EM and ICE algorithm for exponential family , 1997, IEEE Trans. Signal Process..

[8]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[9]  Masayuki Noro,et al.  A Computer Algebra System , 2022 .

[10]  M. Castella,et al.  Inversion of Polynomial Systems and Separation of Nonlinear Mixtures of Finite-Alphabet Sources , 2008, IEEE Transactions on Signal Processing.

[11]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[12]  José M. Bioucas-Dias,et al.  Phase Locked Matrix Factorization , 2011, 2011 19th European Signal Processing Conference.

[13]  E. Kuruoglu,et al.  A Minimax Entropy Method for Blind Separation of Dependent Components in Astrophysical Images , 2006 .

[14]  W. Pieczynski Sur la convergence de l'estimation conditionnelle itérative , 2008 .

[15]  O. Grellier NON LINEAR INVERSION OF UNDERDETERMINED MIXTURES Pierre COMON and Olivier GRELLIER , 1999 .

[16]  P. Loubaton,et al.  Blind deconvolution of multivariate signals: A deflation approach , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[17]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[18]  Simon P. Wilson,et al.  Dependent Gaussian mixture models for source separation , 2011, 2011 19th European Signal Processing Conference.

[19]  David H. Bailey,et al.  Algorithms and applications , 1988 .

[20]  Marc Castella,et al.  An extension of the ICA model using latent variables , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Shotaro Akaho Conditionally independent component analysis for supervised feature extraction , 2002, Neurocomputing.

[22]  Ibon Saratxaga,et al.  Detection of synthetic speech for the problem of imposture , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Christoph Lossen,et al.  Singular: a computer algebra system , 2003, Comput. Sci. Eng..

[24]  Aapo Hyvärinen,et al.  A Quasi-stochastic Gradient Algorithm for Variance-Dependent Component Analysis , 2006, ICANN.

[25]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[26]  Stéphane Derrode,et al.  Signal and image segmentation using pairwise Markov chains , 2004, IEEE Transactions on Signal Processing.

[27]  Ercan E. Kuruoglu,et al.  Dependent Component Analysis for Cosmology: A Case Study , 2010, LVA/ICA.

[28]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[29]  P. Comon Contrasts, independent component analysis, and blind deconvolution , 2004 .

[30]  J. Skilling,et al.  Algorithms and Applications , 1985 .

[31]  Te-Won Lee,et al.  Independent Vector Analysis: Definition and Algorithms , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[32]  Pierre Lanchantin,et al.  Unsupervised segmentation of randomly switching data hidden with non-Gaussian correlated noise , 2011, Signal Process..

[33]  Pierre A. Devijver,et al.  Baum's forward-backward algorithm revisited , 1985, Pattern Recognit. Lett..

[34]  Klaus Nordhausen,et al.  Scatter matrices with independent block property and ISA , 2011, 2011 19th European Signal Processing Conference.

[35]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[36]  Michael I. Jordan,et al.  Tree-dependent Component Analysis , 2002, UAI.

[37]  Dorothea Kolossa,et al.  Non-independent BSS: A Model for Evoked MEG Signals with Controllable Dependencies , 2009, ICA.

[38]  Ta-Hsin Li,et al.  Finite-alphabet information and multivariate blind deconvolution and identification of linear systems , 2003, IEEE Trans. Inf. Theory.

[39]  Alan F. Murray,et al.  Synaptic Rewiring for Topographic Map Formation , 2008, ICANN.

[40]  Wojciech Pieczynski,et al.  Adaptive Mixture Estimation and Unsupervised Local Bayesian Image Segmentation , 1995, CVGIP Graph. Model. Image Process..