Statistical convergence behavior of affine projection algorithms

Class of algorithms referring to the affine projection algorithms (APA) applies updates to the weights in a direction that is orthogonal to the most recent input vectors. This speeds up the convergence of the algorithm over that of the normalized least mean square (NLMS) algorithm, especially for highly colored input processes. In this paper a new statistical analysis model is used to analyze the APA class of algorithms with unity step size. Four assumptions are made, which are based on the direction vector for the APA class. Under these assumptions, deterministic recursive equations for the weight error and for the mean-square error are derived. We also analyze the steady-state behavior of the APA class. The new model is applicable to input processes that are autoregressive as well as autoregressive-moving average, and therefore is useful under more general conditions than previous models for prediction of the mean square error of the APA class. Simulation results are provided to corroborate the analytical results.

[1]  A. A. Beex,et al.  Convergence behavior of affine projection algorithms , 2000, IEEE Trans. Signal Process..

[2]  Steven L. Gay,et al.  The fast affine projection algorithm , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[3]  Claude Samson,et al.  Fixed point error analysis of the normalized ladder algorithm , 1983 .

[4]  Tokunbo Ogunfunmi,et al.  On the Convergence Behavior of the Affine Projection Algorithm for Adaptive Filters , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[5]  Sérgio J. M. de Almeida,et al.  A Stochastic Model for a Pseudo Affine Projection Algorithm , 2009, IEEE Transactions on Signal Processing.

[6]  Dennis R. Morgan,et al.  On a class of computationally efficient, rapidly converging, generalized NLMS algorithms , 1996, IEEE Signal Processing Letters.

[7]  Sérgio J. M. de Almeida,et al.  A statistical analysis of the affine projection algorithm for unity step size and autoregressive inputs , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  A.A. Beex,et al.  On affine projection direction vector (non)whiteness , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[9]  I. Pitas,et al.  New affine projection algorithms based on Gauss-Seidel method , 2005, International Symposium on Signals, Circuits and Systems, 2005. ISSCS 2005..

[10]  J.C.M. Bermudez,et al.  A stochastic model for the convergence behavior of the affine projection algorithm for Gaussian inputs , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[11]  D. Rajan.  Probability, Random Variables, and Stochastic Processes , 2017 .

[12]  A. A. Beex,et al.  Fast generalized affine projection algorithm , 2000 .

[13]  Steven G. Kratzer,et al.  The Partial-Rank Algorithm for Adaptive Beamforming , 1986, Optics & Photonics.

[14]  Ru Li,et al.  On the Convergence Behavior of Affine Projection Algorithm with Direction Error , 2014 .

[15]  Dirk T. M. Slock,et al.  On the convergence behavior of the LMS and the normalized LMS algorithms , 1993, IEEE Trans. Signal Process..

[16]  Kazuhiko Ozeki,et al.  An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties , 1984 .

[17]  A.A. Beex,et al.  Normalized LMS algorithm with orthogonal correction factors , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[18]  Ali H. Sayed,et al.  Mean-square performance of a family of affine projection algorithms , 2004, IEEE Transactions on Signal Processing.

[19]  M. Bellanger.  Adaptive filter theory: by Simon Haykin, McMaster University, Hamilton, Ontario L8S 4LB, Canada, in: Prentice-Hall Information and System Sciences Series, published by Prentice-Hall, Englewood Cliffs, NJ 07632, U.S.A., 1986, xvii+590 pp., ISBN 0-13-004052-5 025 , 1987 .

[20]  Zhi,et al.  A New Affine Projection Algorithm and Its Statistical Behavior , 2013 .

[21]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[22]  Markus Rupp.  A family of adaptive filter algorithms with decorrelating properties , 1998, IEEE Trans. Signal Process..