Self-adaptive neural networks for blind separation of sources

Novel on-line learning algorithms with self adaptive learning rates (parameters) for blind separation of signals are proposed. The main motivation for development of new learning rules is to improve convergence speed and to reduce cross-talk, especially for non-stationary signals. Furthermore, we have discovered that under some conditions the proposed neural network models with associated learning algorithms exhibit a random switch of attention, i.e. they have the ability of chaotic or random switching or cross-over of output signals in such way that a specified separated signal may appear at various outputs at different time windows. Validity, performance and dynamic properties of the proposed learning algorithms are investigated by computer simulation experiments.

[1]  Shun-ichi Amari,et al.  A Theory of Adaptive Pattern Classifiers , 1967, IEEE Trans. Electron. Comput..

[2]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[3]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Processing.

[4]  Adel Belouchrani,et al.  A new composite criterion for adaptive and iterative blind source separation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Kiyotoshi Matsuoka,et al.  A neural net for blind separation of nonstationary signal sources , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[6]  J. Hopfield,et al.  Decomposition of a mixture of signals in a model of the olfactory bulb. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[8]  Erkki Oja,et al.  Signal Separation by Nonlinear Hebbian Learning , 1995 .

[9]  Kiyotoshi Matsuoka,et al.  A neural net for blind separation of nonstationary signals , 1995, Neural Networks.

[10]  Shun-ichi Amari,et al.  Recurrent Neural Networks For Blind Separation of Sources , 1995 .

[11]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.