Natural gradient learning for second-order nonstationary source separation

In this paper we consider a problem of source separation when sources are second-order nonstationary stochastic processes. We employ the natural gradient method and develop learning algorithms for both linear feedback and feedforward neural networks. Thus our algorithms possess equivariant property. The local stability analysis shows that separating solutions are always locally stable stationary points of the proposed algorithms, regardless of probability distributions of sources.

[1]  Seungjin Choi,et al.  Natural Gradient Learning for Spatio-Temporal Decorrelation: Recurrent Network , 2000 .

[2]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[3]  S.C. Douglas,et al.  Multichannel blind deconvolution and equalization using the natural gradient , 1997, First IEEE Signal Processing Workshop on Signal Processing Advances in Wireless Communications.

[4]  Kiyotoshi Matsuoka,et al.  A neural net for blind separation of nonstationary signals , 1995, Neural Networks.

[5]  Andrzej Cichocki,et al.  Second Order Nonstationary Source Separation , 2002, J. VLSI Signal Process..

[6]  Seungjin Choi,et al.  Blind separation of nonstationary and temporally correlated sources from noisy mixtures , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[7]  Zhi Ding,et al.  A matrix-pencil approach to blind separation of colored nonstationary signals , 2000, IEEE Trans. Signal Process..

[8]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[9]  Andrzej Cichocki,et al.  Equivariant nonstationary source separation , 2002, Neural Networks.

[10]  Andrzej Cichocki,et al.  Stability Analysis of Learning Algorithms for Blind Source Separation , 1997, Neural Networks.

[11]  S. Haykin Unsupervised adaptive filtering, vol. 1: Blind source separation , 2000 .

[12]  Andrzej Cichocki,et al.  Nonholonomic Orthogonal Learning Algorithms for Blind Source Separation , 2000, Neural Computation.

[13]  Seungjin Choi,et al.  Blind separation of second-order nonstationary and temporally colored sources , 2001, Proceedings of the 11th IEEE Signal Processing Workshop on Statistical Signal Processing (Cat. No.01TH8563).

[14]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[15]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[16]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixtures of nonstationary sources , 2001, IEEE Trans. Signal Process..