On the Cramér-Rao Bound for Estimating the Mixing Matrix in Noisy Sparse Component Analysis

In this letter, we address the theoretical limitations in estimating the mixing matrix in noisy sparse component analysis (SCA) for the two-sensor case. We obtain the Cramer-Rao lower bound (CRLB) error estimation of the mixing matrix. Using the Bernouli-Gaussian (BG) sparse distribution, and some simple assumptions, an approximation of the Fisher information matrix (FIM) is calculated. Moreover, this CRLB is compared to some of the main methods of mixing matrix estimation in the literature.

[1]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations Pau Bo # lla , 2001 .

[2]  Arie Yeredor,et al.  Cramér–Rao-Induced Bound for Blind Separation of Stationary Parametric Gaussian Sources , 2007, IEEE Signal Processing Letters.

[3]  Serge Dégerine,et al.  Separation of an instantaneous mixture of Gaussian autoregressive sources by the exact maximum likelihood approach , 2004, IEEE Transactions on Signal Processing.

[4]  Jean-Francois Cardoso,et al.  Separation of non stationary sources; achievable performance , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[5]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[6]  L. Vielva,et al.  UNDERDETERMINED BLIND SOURCE SEPARATION USING A PROBABILISTIC SOURCE SPARSITY MODEL , 2001 .

[7]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[8]  Wei Zhang,et al.  A New Two-Stage Approach to Underdetermined Blind Source Separation using Sparse Representation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[9]  C. Jutten,et al.  Source Estimation in Noisy Sparse Component Analysis , 2007, 2007 15th International Conference on Digital Signal Processing.

[10]  Rémi Gribonval,et al.  A survey of Sparse Component Analysis for blind source separation: principles, perspectives, and new challenges , 2006, ESANN.

[11]  Daniel W. C. Ho,et al.  Underdetermined blind source separation based on sparse representation , 2006, IEEE Transactions on Signal Processing.

[12]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[13]  N. Mitianoudis,et al.  Simple mixture model for sparse overcomplete ICA , 2004 .

[14]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[15]  E. Oja,et al.  Performance Analysis of the FastICA Algorithm and Cramér – Rao Bounds for Linear Independent Component Analysis , 2010 .

[16]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[17]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[18]  Christian Jutten,et al.  Sparse ICA via cluster-wise PCA , 2006, Neurocomputing.

[19]  Nikolaos Mitianoudis,et al.  Overcomplete source separation using Laplacian mixture models , 2005, IEEE Signal Processing Letters.

[20]  Fabian J. Theis,et al.  A geometric algorithm for overcomplete linear ICA , 2004, Neurocomputing.