Cramer-Rao lower bound for linear independent component analysis

This paper derives a closed-form expression for the Cramer-Rao bound (CRB) on estimating the source signals in the linear independent component analysis problem, assuming that all independent components have finite variance. It is also shown that the fixed-point algorithm known as FastICA can approach the CRB (the estimate can be nearly efficient) in two situations: (1) when the distribution of the sources is not too much different from Gaussian, for the symmetric version of the algorithm using any of the custom nonlinear functions (pow3, tanh, gauss); (2) when the distribution of the sources is very different from Gaussian (e.g. has long tails) and the nonlinear function in the algorithm equals the score function of each independent component.

[1]  Fathi M. A. Salam,et al.  Blind source recovery using an adaptive generalized Gaussian score function , 2002, The 2002 45th Midwest Symposium on Circuits and Systems, 2002. MWSCAS-2002..

[2]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[3]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[4]  E. Oja,et al.  Convergence of the symmetrical FastICA algorithm , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[5]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[6]  Zbynek Koldovský,et al.  Optimal pairing of signal components separated by blind techniques , 2004, IEEE Signal Processing Letters.

[7]  Vwani P. Roychowdhury,et al.  Independent component analysis based on nonparametric density estimation , 2004, IEEE Transactions on Neural Networks.

[8]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[9]  John W. Fisher,et al.  ICA Using Spacings Estimates of Entropy , 2003, J. Mach. Learn. Res..

[10]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[11]  Erkki Oja,et al.  An Experimental Comparison of Neural Algorithms for Independent Component Analysis and Blind Separation , 1999, Int. J. Neural Syst..