论文信息 - A Unifying Approach to the Derivation of the Class of PNLMS Algorithms

A Unifying Approach to the Derivation of the Class of PNLMS Algorithms

unifying approach to the derivation of the class of proportionate normalised least mean square (PNLMS) algorithms is provided. This is an important class of algorithms where the two most used algorithms are introduced empirically. It is shown that it is possible to derive PNLMS algorithms as a result of an optimisation procedure. This is achieved in a rigorous way, starting from the standard LMS through to the PNLMS with the "sparsification" factor in both the numerator and denominator of the weight update. The proposed approach is generic and also applies to other LMS types of adaptive algorithms. Simulations on benchmark sparse impulse responses support the approach.

[1] Andrzej Cichocki,et al. Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[2] Jacob Benesty,et al. The LMS, PNLMS, and exponentiated gradient algorithms , 2004, 2004 12th European Signal Processing Conference.

[3] S. Haykin,et al. Adaptive Filter Theory , 1986 .

[4] Javier Calpe-Maravilla,et al. An easy demonstration of the optimum value of the adaptation constant in the LMS algorithm [FIR filt , 1998 .

[5] Andrzej Cichocki,et al. Adaptive blind signal and image processing , 2002 .

[6] Danilo P. Mandic,et al. Recurrent Neural Networks for Prediction , 2001 .

[7] Donald L. Duttweiler,et al. Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[8] S.L. Gay,et al. An efficient, fast converging adaptive filter for network echo cancellation , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[9] C. Richard Johnson,et al. Exploiting sparsity in adaptive filters , 2002, IEEE Trans. Signal Process..