Robust Independent Component Analysis by Iterative Maximization of the Kurtosis Contrast With Algebraic Optimal Step Size

Independent component analysis (ICA) aims at decomposing an observed random vector into statistically independent variables. Deflation-based implementations, such as the popular one-unit FastICA algorithm and its variants, extract the independent components one after another. A novel method for deflationary ICA, referred to as RobustICA, is put forward in this paper. This simple technique consists of performing exact line search optimization of the kurtosis contrast function. The step size leading to the global maximum of the contrast along the search direction is found among the roots of a fourth-degree polynomial. This polynomial rooting can be performed algebraically, and thus at low cost, at each iteration. Among other practical benefits, RobustICA can avoid prewhitening and deals with real- and complex-valued mixtures of possibly noncircular sources alike. The absence of prewhitening improves asymptotic performance. The algorithm is robust to local extrema and shows a very high convergence speed in terms of the computational cost required to reach a given source extraction quality, particularly for short data records. These features are demonstrated by a comparative numerical analysis on synthetic data. RobustICA's capabilities in processing real-world data involving noncircular complex strongly super-Gaussian sources are illustrated by the biomedical problem of atrial activity (AA) extraction in atrial fibrillation (AF) electrocardiograms (ECGs), where it outperforms an alternative ICA-based technique.

[1]  D. Godard,et al.  Self-Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication Systems , 1980, IEEE Trans. Commun..

[2]  B. A. D. H. Brandwood A complex gradient operator and its applica-tion in adaptive array theory , 1983 .

[3]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[4]  Jitendra K. Tugnait,et al.  Comments on 'New criteria for blind deconvolution of nonminimum phase systems (channels)' , 1992, IEEE Trans. Inf. Theory.

[5]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[6]  J. Cardoso On the Performance of Orthogonal Source Separation Algorithms , 1994 .

[7]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[8]  Eric Moreau,et al.  A one stage self-adaptive algorithm for source separation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  P. Comon Tensor Diagonalization, A useful Tool in Signal Processing , 1994 .

[10]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[11]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[12]  Jitendra K. Tugnait,et al.  Identification and deconvolution of multichannel linear non-Gaussian processes using higher order statistics and inverse filter criteria , 1997, IEEE Trans. Signal Process..

[13]  A. Hyvärinen,et al.  One-unit contrast functions for independent component analysis: a statistical analysis , 1997 .

[14]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[15]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[16]  Pierre Comon,et al.  Improved contrast dedicated to blind separation in communications , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  A. Hyvarinen,et al.  One-unit contrast functions for independent component analysis: a statistical analysis , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[18]  A. Kuzminskiy A robust step size adaptation scheme for LMS adaptive filters , 1997, Proceedings of 13th International Conference on Digital Signal Processing.

[19]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[20]  P. Comon,et al.  Blind separation of discrete sources , 1998, IEEE Signal Processing Letters.

[21]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[22]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[23]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[24]  Erkki Oja,et al.  An Experimental Comparison of Neural Algorithms for Independent Component Analysis and Blind Separation , 1999, Int. J. Neural Syst..

[25]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[26]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[27]  A. Nandi Blind estimation using higher-order statistics , 1999 .

[28]  Constantinos B. Papadias,et al.  Globally convergent blind source separation based on a multiuser kurtosis maximization criterion , 2000, IEEE Trans. Signal Process..

[29]  Zhi Ding,et al.  Stationary points of a kurtosis maximization algorithm for blind signal separation and antenna beamforming , 2000, IEEE Trans. Signal Process..

[30]  Aapo Hyvärinen,et al.  c ○ World Scientific Publishing Company A FAST FIXED-POINT ALGORITHM FOR INDEPENDENT COMPONENT ANALYSIS OF COMPLEX VALUED SIGNALS , 2000 .

[31]  V. Fuster,et al.  ACC/AHA/ESC Guidelines for the Management of Patients With Atrial Fibrillation: Executive Summary A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and the European Society of Cardiology Committee for Practice Guidelines and Policy Conference , 2001, Circulation.

[32]  Tapani Ristaniemi,et al.  Advanced ICA-based receivers for block fading DS-CDMA channels , 2002, Signal Process..

[33]  Phillip A. Regalia A finite-interval constant modulus algorithm , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[34]  William H. Press,et al.  Numerical recipes in C , 2002 .

[35]  Phillip A. Regalia,et al.  Monotonic convergence of fixed-point algorithms for ICA , 2003, IEEE Trans. Neural Networks.

[36]  José Millet-Roig,et al.  Atrial activity extraction for atrial fibrillation analysis using blind source separation , 2004, IEEE Transactions on Biomedical Engineering.

[37]  Sergio Cruces,et al.  From blind signal extraction to blind instantaneous signal separation: criteria, algorithms, and stability , 2004, IEEE Transactions on Neural Networks.

[38]  A. Ferreol,et al.  Comparative performance analysis of eight blind source separation methods on radiocommunications signals , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[39]  Pierre Comon,et al.  Blind channel equalization with algebraic optimal step size , 2005, 2005 13th European Signal Processing Conference.

[40]  Jacob Benesty,et al.  Optimal step size of the adaptive multichannel LMS algorithm for blind SIMO identification , 2005, IEEE Signal Processing Letters.

[41]  Pierre Comon,et al.  Semi-blind constant modulus equalization with optimal step size , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[42]  José Millet-Roig,et al.  Spatiotemporal blind source separation approach to atrial activity estimation in atrial tachyarrhythmias , 2005, IEEE Transactions on Biomedical Engineering.

[43]  P. Tichavský,et al.  Efficient variant of algorithm fastica for independent component analysis attaining the cramer-RAO lower bound , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[44]  Jonathon A. Chambers,et al.  Fetal electrocardiogram extraction by sequential source separation in the wavelet domain , 2005, IEEE Transactions on Biomedical Engineering.

[45]  Sergio Bermejo,et al.  Finite sample effects in higher order statistics contrast functions for sequential blind source separation , 2005, IEEE Signal Processing Letters.

[46]  Wai Lok Woo,et al.  Nonlinear blind signal separation with intelligent controlled learning , 2005 .

[47]  P. Comon,et al.  Blind and semi-blind equalization based on the constant power criterion , 2005, IEEE Transactions on Signal Processing.

[48]  P. Langley,et al.  Analysis of surface electrocardiograms in atrial fibrillation: techniques, research, and clinical applications. , 2006, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[49]  Erkki Oja,et al.  Average Convergence Behavior of the FastICA Algorithm for Blind Source Separation , 2006, ICA.

[50]  Erkki Oja,et al.  Efficient Variant of Algorithm FastICA for Independent Component Analysis Attaining the CramÉr-Rao Lower Bound , 2006, IEEE Transactions on Neural Networks.

[51]  Pierre Comon,et al.  How fast is FastICA? , 2006, 2006 14th European Signal Processing Conference.

[52]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[53]  Patrick A. Naylor,et al.  Generalized Optimal Step-Size for Blind Multichannel LMS System Identification , 2006, IEEE Signal Processing Letters.

[54]  Erkki Oja,et al.  The FastICA Algorithm Revisited: Convergence Analysis , 2006, IEEE Transactions on Neural Networks.

[55]  E. Oja,et al.  Corrections to "Performance Analysis of the FastICA Algorithm and Cram´ er-Rao Bounds for Linear Independent Component Analysis", TSP 04/06 , 2007 .

[56]  Changyuan Fan,et al.  On the Convergence Behavior of the FastICA Algorithm with the Kurtosis Cost Function , 2007, Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007).

[57]  J. Ornato,et al.  ACC/AHA/ESC 2006 guidelines for the management of patients with atrial fibrillation--executive summary: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and the European Society of Cardiology Committee for Practice Guidelines (Writing Commit , 2006, Journal of the American College of Cardiology.

[58]  Pierre Comon,et al.  Comparative Speed Analysis of FastICA , 2007, ICA.

[59]  Scott C. Douglas,et al.  Fixed-Point Algorithms for the Blind Separation of Arbitrary Complex-Valued Non-Gaussian Signal Mixtures , 2007, EURASIP J. Adv. Signal Process..

[60]  Sergio Bermejo,et al.  Finite sample effects of the fast ICA algorithm , 2007, Neurocomputing.

[61]  Tülay Adali,et al.  Complex ICA by Negentropy Maximization , 2008, IEEE Transactions on Neural Networks.

[62]  Tülay Adali,et al.  On Extending the Complex FastICA Algorithm to Noncircular Sources , 2008, IEEE Transactions on Signal Processing.

[63]  Pierre Comon,et al.  Optimal Step-Size Constant Modulus Algorithm , 2008, IEEE Transactions on Communications.

[64]  Pierre Comon,et al.  Robust independent component analysis for blind source separation and extraction with application in electrocardiography , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[65]  Hualiang Li,et al.  A Class of Complex ICA Algorithms Based on the Kurtosis Cost Function , 2008, IEEE Transactions on Neural Networks.

[66]  Pierre Comon,et al.  ROBUST INDEPENDENT COMPONENT ANALYSIS , 2009 .

[67]  Peter Tino,et al.  IEEE Transactions on Neural Networks , 2009 .

[68]  E. Oja,et al.  Performance Analysis of the FastICA Algorithm and Cramér – Rao Bounds for Linear Independent Component Analysis , 2010 .

[69]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[70]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.