Stability Analysis Of Adaptive Blind Source Separation

Recently a number of adaptive learning algorithms have been proposed for blind source separation. Although the underlying principles and approaches are dierent, most of them have very similar forms. Two important issues have remained to be elucidated further: the statistical eciency and the stability of learning algorithms. The present letter analyzes a general form of statistically ecient algorithm and give a necessary and sucient condition for the separating solution to be a stable equilibrium of a general learning algorithm. Moreover, when the separating solution is unstable, a simple method is given for stabilizing the separating solution by modifying the algorithm.

[1]  Shun-ichi Amari,et al.  A Theory of Adaptive Pattern Classifiers , 1967, IEEE Trans. Electron. Comput..

[2]  Christian Jutten,et al.  Space or time adaptive signal processing by neural network models , 1987 .

[3]  J. Fort.  Stabilité de l'algorithme de séparation de sources de Jutten et Hérault , 1991 .

[4]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[5]  Esfandiar Sorouchyari,et al.  Blind separation of sources, part III: Stability analysis , 1991, Signal Process..

[6]  P. Bickel.  Efficient and Adaptive Estimation for Semiparametric Models , 1993 .

[7]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[8]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[9]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[10]  Marimuthu Palaniswami,et al.  Computational Intelligence: A Dynamic System Perspective , 1995 .

[11]  Shun-ichi Amari,et al.  Recurrent Neural Networks For Blind Separation of Sources , 1995 .

[12]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[13]  Yannick Deville,et al.  A unified stability analysis of the Hérault-Jutten source separation neural network , 1996, Signal Process..

[14]  Shun-ichi Amari,et al.  Self-adaptive neural networks for blind separation of sources , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[15]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[16]  S. Amari,et al.  Estimating Functions in Semiparametric Statistical Models , 1997 .

[17]  Eric Moreau,et al.  Self-adaptive source separation .I. Convergence analysis of a direct linear network controlled by the Herault-Jutten algorithm , 1997, IEEE Trans. Signal Process..

[18]  S. Amari,et al.  Information geometry of estimating functions in semi-parametric statistical models , 1997 .

[19]  S. Amari.  Natural Gradient Works Eciently in Learning , 2022 .