Criteria based on mutual information minimization for blind source separation in post nonlinear mixtures

This work deals with the problem of blind source separation solved by minimization of mutual information. After having chosen a model for the mixture, we focus on two methods. One is based on the minimization of an estimation of I, the mutual information. The other one uses a minimization of an estimation of C, the mutual information after transforming all the joint entropy terms. We show the differences between these two approaches by studying statistical properties of the two estimators.In this paper, we derive the bias of the estimators of the two criteria I and C. It is shown that under the hypothesis of independence, the estimator of I is asymptotically unbiased even if the bandwidth is kept fixed, whereas with a fixed bandwidth the estimator of C is not asymptotically unbiased.Further, the minimization is achieved by a relative gradient descent method and we show the differences between criteria I and C through the expression of their relative gradients.

[1]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[2]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[3]  Dinh-Tuan Pham Flexible parametrization of postnonlinear mixtures model in blind sources separation , 2004, IEEE Signal Processing Letters.

[4]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixture of sources via an independent component analysis , 1996, IEEE Trans. Signal Process..

[5]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[6]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[7]  Sophie Achard,et al.  Mesures de dépendance pour la séparation aveugle de sources : application aux mélanges post non linéaires , 2003 .

[8]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[9]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[10]  E. Oja,et al.  Independent Component Analysis , 2013 .

[11]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[12]  Dinh Tuan Pham,et al.  BLIND SOURCE SEPARATION IN POST NONLINEAR MIXTURES , 2001 .

[13]  P. Hall,et al.  On the estimation of entropy , 1993 .

[14]  Jan Eriksson,et al.  Novel Characteristic Function Based Criteria For Ica , 2001 .

[15]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[16]  H. Joe Estimation of entropy and other functionals of a multivariate density , 1989 .

[17]  P. Comon Independent Component Analysis , 1992 .

[18]  Christian Jutten,et al.  MINIMIZATION-PROJECTION (MP) APPROACH FOR BLIND SOURCE SEPARATION IN DIFFERENT MIXING MODELS , 2003 .

[19]  Pierre Comon Independent component analysis - a new concept? signal processing , 1994 .

[20]  Massoud Babaiezadeh Malmiri On blind source separation in convolutive and nonlinear mixtures , 2002 .