Independent Component Analysis for Mixed Sub- Gaussian and Super- Gaussian Sources

An extension of the infomax algorithm of Bell & Sejnowski (1995) is presented that is able to separate the mixed suband super-Gaussian source distributions. The same learning rule has been derived by Giiolami & Fyfe (1997) from the negentropy perspective for projection pursuit. Using a Laplacian prior we also propose a learning rule that is especially convenient to realize in hardware. The natural gradient extension is presented fiom different perspectives and the use of preprocessing steps is proposed to further speed up the convergence. Simulation results show that the algorithm is able to separate 20 source with a variety of source distributions. On real data, Jung et al. (1997) and McKeown et al. (1997) demonstrate the successful use of the extended ICA algorithm to analyze EEG and fMRI recordings.

[1]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[2]  C. J.,et al.  Maximum Likelihood and Covariant Algorithms for Independent Component Analysis , 1996 .

[3]  R. Lambert.  Multichannel blind deconvolution: FIR matrix algebra and separation of multipath mixtures , 1996 .

[4]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[5]  Yoram Baram,et al.  Multidimensional density shaping by sigmoids , 1996, IEEE Trans. Neural Networks.

[6]  Pierre Comon.  Independent component analysis - a new concept? signal processing , 1994 .

[7]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[8]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[9]  Mark Girolami,et al.  Extraction of independent signal sources using a deflationary exploratory projection pursuit network , 1997 .

[10]  Reinhold Orglmeister,et al.  Blind source separation of real world signals , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[11]  J. Cardoso.  Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[12]  Barak A. Pearlmutter,et al.  A Context-Sensitive Generalization of ICA , 1996 .

[13]  Tzyy-Ping Jung,et al.  Extended ICA Removes Artifacts from Electroencephalographic Recordings , 1997, NIPS.

[14]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[15]  Reinhold Orglmeister,et al.  Improving the Performance of Infomax Using Statistical Signal Processing Techniques , 1997, ICANN.

[16]  Erkki Oja,et al.  A class of neural networks for independent component analysis , 1997, IEEE Trans. Neural Networks.