Quasi-optimal EASI algorithm based on the Score Function Difference (SFD)

Equivariant adaptive separation via independence (EASI) is one of the most successful algorithms for blind source separation (BSS). However, the user has to choose non-linearities, and usually simple (but non-optimal) cubic polynomials are applied. In this paper, the optimal choice of these non-linearities is addressed. We show that this optimal non-linearity is the output score function difference (SFD). Contrary to simple non-linearities usually used in EASI (such as cubic polynomials), the optimal choice is neither component-wise nor fixed: it is a multivariate function which depends on the output distributions. Finally, we derive three adaptive algorithms for estimating the SFD and achieving ''quasi-optimal'' EASI algorithms, whose separation performance is much better than ''standard'' EASI and which especially converges for any sources.

[1]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[2]  Dinh-Tuan Pham,et al.  Criteria based on mutual information minimization for blind source separation in post nonlinear mixtures , 2005, Signal Process..

[3]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[6]  Dinh-Tuan Pham,et al.  Mutual information approach to blind separation of stationary sources , 2002, IEEE Trans. Inf. Theory.

[7]  Massoud Babaiezadeh Malmiri On blind source separation in convolutive and nonlinear mixtures , 2002 .

[8]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[9]  Christian Jutten,et al.  A general approach for mutual information minimization and its application to blind source separation , 2005, Signal Process..

[10]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[11]  P. Comon Independent Component Analysis , 1992 .

[12]  Christian Jutten,et al.  Differential of the mutual information , 2004, IEEE Signal Processing Letters.

[13]  D. Cox A penalty method for nonparametric estimation of the logarithmic derivative of a density function , 1985 .

[14]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[15]  Christian Jutten,et al.  Entropy Optimization - Application to Blind Source Separation , 1997, ICANN.