Consistency and asymptotic normality of FastICA and bootstrap FastICA

Independent component analysis (ICA) is possibly the most widespread approach to solve the blind source separation problem. Many different algorithms have been proposed, together with several highly successful applications. There is also an extensive body of work on the theoretical foundations and limits of the ICA methodology. One practical concern about the use of ICA with real world data is the robustness of its estimates. Slight variations in the estimates, may stem from the inherent stochastic nature of the algorithms used or some deviations from the theoretical assumptions. To overcome this problem, different approaches have been proposed, most of which are based on the use of multiple runs of ICA algorithms with bootstrap. Here we show the consistency and asymptotic normality of FastICA and bootstrap FastICA, based on empirical process theory, including Z-estimators and Hoeffding's inequality. These results give theoretical grounds for the robust use of FastICA, in a multiple run, bootstrap and randomly initialized manner. In this framework, it is also possible to assess the convergence of the algorithm through a normality test.

[1]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[2]  Samuel Kaski,et al.  Dependencies between stimuli and spatially independent fMRI sources: Towards brain correlates of natural stimuli , 2009, NeuroImage.

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  Jianhua Z. Huang,et al.  Bootstrap consistency for general semiparametric $M$-estimation , 2009, 0906.1310.

[5]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[6]  Aapo Hyvärinen,et al.  Validating the independent components of neuroimaging time series via clustering and visualization , 2004, NeuroImage.

[7]  Jarkko Ylipaavalniemi,et al.  Analyzing consistency of independent components: An fMRI illustration , 2008, NeuroImage.

[8]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[9]  P. Comon Independent Component Analysis , 1992 .

[10]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[11]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[12]  Klaus-Robert Müller,et al.  Injecting noise for analysing the stability of ICA components , 2004, Signal Process..

[13]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[14]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[15]  Jarkko Ylipaavalniemi,et al.  Arabica: Robust ICA in a Pipeline , 2009, ICA.

[16]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[17]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[18]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[19]  Erkki Oja,et al.  The FastICA Algorithm Revisited: Convergence Analysis , 2006, IEEE Transactions on Neural Networks.

[20]  Norbert Henze,et al.  A class of invariant consistent tests for multivariate normality , 1990 .

[21]  A. Ruszczynski,et al.  Nonlinear Optimization , 2006 .

[22]  Yul-Wan Sung,et al.  Functional magnetic resonance imaging , 2004, Scholarpedia.

[23]  E. Oja,et al.  Independent Component Analysis , 2001 .