论文信息 - Natural gradient algorithm for blind separation of overdetermined mixture with additive noise

Natural gradient algorithm for blind separation of overdetermined mixture with additive noise

We study the natural gradient approach to blind separation of overdetermined mixtures. First we introduce a Lie group on the manifold of overdetermined mixtures, and endow a Riemannian metric on the manifold based on the property of the Lie group. Then we derive the natural gradient on the manifold using the isometry of the Riemannian metric. Using the natural gradient, we present a new learning algorithm based on the minimization of mutual information.

[1] Terrence J. Sejnowski,et al. An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[2] Andrzej Cichocki,et al. A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[3] Jean-François Cardoso,et al. Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[4] Andrzej Cichocki,et al. Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[5] S. Amari,et al. Maximum Likelihood Source Separation: Equivariance and Adaptivity , 1997 .

[6] S. Amari,et al. Multichannel blind separation and deconvolution of sources with arbitrary distributions , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[7] Shun-ichi Amari,et al. Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[8] Shun-ichi Amari,et al. Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[9] T. Ens,et al. Blind signal separation : statistical principles , 1998 .

[10] S. Amari,et al. Natural Gradient Approach To Blind Separation Of Over- And Under-Complete Mixtures , 1999 .

[11] Terrence J. Sejnowski,et al. Blind source separation of more sources than mixtures using overcomplete representations , 1999, IEEE Signal Processing Letters.