A Cascade Neural Network for Blind Signal Extraction without Spurious Equilibria

We present a cascade neural network for blind source extraction We propose a family of unconstrained opti mization criteria from which we derive a learning rule that can extract a single source signal from a linear mixture of source sig nals To prevent the newly extracted source signal from being extracted again in the next processing unit we propose another unconstrained optimization criterion that uses knowledge of this signal From this criterion we then derive a learning rule that de ates from the mixture the newly extracted signal By virtue of blind extraction and de ation processing the presented cascade neural network can cope with a practical case where the number of mixed signals is equal to or larger than the number of sources with the number of sources not known in advance We prove an alytically that the proposed criteria both for blind extraction and de ation processing have no spurious equilibria In addition the proposed criteria do not require whitening of mixed signals We also demonstrate the validity and performance of the presented neural network by computer simulation experiments key words blind source separation and extraction neural net works on line adaptive algorithms

[1]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[2]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[3]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[4]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[5]  Shun-ichi Amari,et al.  Blind signal extraction using self-adaptive nonlinear Hebbian learning rule , 1996 .

[6]  Erkki Oja,et al.  Simple Neuron Models for Independent Component Analysis , 1996, Int. J. Neural Syst..

[7]  Shun-ichi Amari,et al.  Self-adaptive neural networks for blind separation of sources , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[8]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[9]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[10]  Zied Malouche,et al.  Extended anti-Hebbian adaptation for unsupervised source extraction , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[11]  Andrzej Cichocki,et al.  Blind extraction of source signals with specified stochastic features , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  T. Sato,et al.  On-line algorithms for blind deconvolution of multichannel linear time-invariant systems , 1997, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics.

[13]  Shun-ichi Amari,et al.  Sequential blind signal extraction in order specified by stochastic properties , 1997 .

[14]  Shun-ichi Amari,et al.  Dual cascade networks for blind signal extraction , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[15]  Colin Fyfe,et al.  Stochastic ICA Contrast Maximisation Using Oja's Nonlinear PCA Algorithm , 1997, Int. J. Neural Syst..

[16]  Carlos J. Escudero,et al.  A blind signal separation method for multiuser communications , 1997, IEEE Trans. Signal Process..

[17]  Zied Malouche,et al.  Adaptive unsupervised extraction of one component of a linear mixture with a single neuron , 1998, IEEE Trans. Neural Networks.

[18]  Yujiro Inouye,et al.  Blind Deconvolution of Multichannel Linear Time-Invariant Systems of Nonminimum Phase , 2018, Statistical Methods in Control & Signal Processing.

[19]  S. Amari Natural Gradient Works Eciently in Learning , 2022 .