Neural networks for blind decorrelation of signals

We analyze and extend a class of adaptive networks for second-order blind decorrelation of instantaneous signal mixtures. First, we compare the performance of the single-layer neural network employing global knowledge of the adaptive coefficients with a similar structure whose coefficients are adapted via local output connections. Through statistical analyzes, the convergence behaviors and stability bounds for the algorithms' step sizes are studied and derived. Second, we analyze the behaviors of locally adaptive multilayer decorrelation networks and quantify their performances for poorly conditioned signal mixtures. Third, we derive a robust locally adaptive network structure based on a posteriori output signals that remains stable for any step-size value. Finally, we present an extension of the locally adaptive network for linear-phase temporal and spatial whitening of multichannel signals. Simulations verify the analyses and indicate the usefulness of the locally adaptive networks for decorrelating signals in space and time.

[1]  M. C. GOODALL,et al.  Performance of a Stochastic Net , 1960, Nature.

[2]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[3]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[4]  W. Gardner Learning characteristics of stochastic-gradient-descent algorithms: A general study, analysis, and critique , 1984 .

[5]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[6]  Fuyun Ling,et al.  The LMS algorithm with delayed coefficient adaptation , 1989, IEEE Trans. Acoust. Speech Signal Process..

[7]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .

[8]  Pierre Comon,et al.  Blind separation of sources, part II: Problems statement , 1991, Signal Process..

[9]  Joseph J. Atick,et al.  Convergent Algorithm for Sensory Receptive Field Development , 1993, Neural Computation.

[10]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[11]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[12]  Teresa H. Y. Meng,et al.  Normalized data nonlinearities for LMS adaptation , 1994, IEEE Trans. Signal Process..

[13]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[14]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[15]  Shun-ichi Amari,et al.  Multi-Layer Neural Networks with a Local Adaptive Learning Rule for Blind Separation of Source Signa , 1995 .

[16]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[17]  Sen M. Kuo,et al.  Active Noise Control Systems: Algorithms and DSP Implementations , 1996 .

[18]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[19]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[20]  S. Douglas,et al.  A posteriori updates for adaptive filters , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).