Robust blind source separation algorithms using cumulants

Abstract In this paper we propose a new approach to blind separation of independent source signals that, while avoiding the imposition of an orthogonal mixing matrix, is robust with respect to the existence of additive Gaussian noise in the mixture. We demonstrate that, for the wide class of source distributions with certain non-null cumulants and a pre-specified scaling, separation is always a saddle point of a cumulant-based cost function. We propose a quasi-Newton approach for determining this saddle point. This enables us to obtain a family of separation algorithms which, based on higher order statistics, yields unbiased estimates even in the presence of large Gaussian noise and has the interesting property of local isotropic convergence. Another family of algorithms that incorporates second-order statistics loses the former desirable convergence properties but it provides more precise estimates in the absence of noise. Extensive computer simulations confirm robustness and the excellent performance of the resulting algorithms.

[1]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[2]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[3]  Shun-ichi Amari,et al.  Natural Gradient Learning for Over- and Under-Complete Bases in ICA , 1999, Neural Computation.

[4]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[5]  C. Kelley Iterative Methods for Linear and Nonlinear Equations , 1987 .

[6]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[7]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[8]  Asoke K. Nandi,et al.  Adaptive blind source separation for virtually any source probability density function , 2000, IEEE Trans. Signal Process..

[9]  B. A. D. H. Brandwood A complex gradient operator and its applica-tion in adaptive array theory , 1983 .

[10]  Ali Mansour,et al.  Blind Separation of Sources , 1999 .

[11]  Te-Won Lee,et al.  Independent Component Analysis , 1998, Springer US.

[12]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[13]  Ruey-Wen Liu,et al.  General approach to blind source separation , 1996, IEEE Trans. Signal Process..

[14]  Shun-ichi Amari,et al.  Adaptive Online Learning Algorithms for Blind Separation: Maximum Entropy and Minimum Mutual Information , 1997, Neural Computation.

[15]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[16]  Eric Moreau,et al.  High order contrasts for self-adaptive source separation criteria for complex source separation , 1996 .

[17]  C. L. Nikias,et al.  Higher-order spectra analysis : a nonlinear signal processing framework , 1993 .

[18]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[19]  J. Cardoso Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[20]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[21]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[22]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[23]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[24]  John G. Proakis,et al.  Digital Communications , 1983 .

[25]  Mark A. Girolami,et al.  An Alternative Perspective on Adaptive Independent Component Analysis Algorithms , 1998, Neural Computation.

[26]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.

[27]  Sergio Cruces,et al.  An iterative inversion approach to blind source separation , 2000, IEEE Trans. Neural Networks Learn. Syst..

[28]  Shun-ichi Amari,et al.  Blind source separation-semiparametric statistical approach , 1997, IEEE Trans. Signal Process..