A comparison of neural ICA algorithms using real-world data

We compare the performance of five prominent neural or semi-neural algorithms designed for independent component analysis (ICA) using three different real-world data sets. The task is either to find interesting directions in the data for visualisation purposes or blind source separation. We develop criteria for selecting the most meaningful basis vectors of ICA or measuring the goodness of results. The comparison reveals characteristic differences between the studied neural ICA algorithms, complementing our previous results (1998) obtained for artificially generated data.

[1]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[2]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[3]  Pierre Comon Independent component analysis - a new concept? signal processing , 1994 .

[4]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[5]  A. Hyvarinen A family of fixed-point algorithms for independent component analysis , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Erkki Oja,et al.  An Experimental Comparison of Neural ICA Algorithms , 1998 .

[7]  Erkki Oja,et al.  Independent Component Analysis for Identification of Artifacts in Magnetoencephalographic Recordings , 1997, NIPS.

[8]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[9]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[10]  J. Friedman Exploratory Projection Pursuit , 1987 .

[11]  P. Pajunen,et al.  Blind source separation and tracking using nonlinear PCA criterion: a least-squares approach , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[12]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.

[13]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[14]  Xavier Giannakopoulos,et al.  Comparison of Adaptive Independent Component Analysis Algorithms Comparison of Adaptive Independent Component Analysis Algorithms Author: Supervisors at Hut: Professor Erkki Oja And , 1998 .

[15]  Shun-ichi Amari,et al.  Adaptive Online Learning Algorithms for Blind Separation: Maximum Entropy and Minimum Mutual Information , 1997, Neural Computation.

[16]  C. Fyfe,et al.  Generalised independent component analysis through unsupervised learning with emergent Bussgang properties , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[17]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[18]  Aapo Hyvärinen,et al.  A family of fixed-point algorithms for independent component analysis , 1997, ICASSP.

[19]  Terrence J. Sejnowski,et al.  Blind separation and blind deconvolution: an information-theoretic approach , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.