Convergence rate of moments in stochastic approximation with simultaneous perturbation gradient approximation and resetting

The sequence of recursive estimators for function minimization generated by Spall's (1998) simultaneous perturbation stochastic approximation (SPSA) method, combined with a suitable restarting mechanism is considered. It is proved that this sequence converges under certain conditions with rate O(n/sup -/spl beta//2/) for some /spl beta/>0, the best value being /spl beta/=2/3, where the rate is measured by the L/sub q/-norm of the estimation error for any 1/spl les/q</spl infin/. The authors also present higher order SPSA methods. It is shown that the error exponent /spl beta//2 can be arbitrarily close to 1/2 if the Hessian matrix of the cost function at the minimizing point has all its eigenvalues to the right of 1/2, the cost function is sufficiently smooth, and a sufficiently high-order approximation of the derivative is used.

[1]  D. Politis,et al.  Statistical Estimation , 2022 .

[2]  V. Fabian.  Stochastic Approximation of Minima with Improved Asymptotic Speed , 1967 .

[3]  Y. Davydov.  Convergence of Distributions Generated by Stationary Stochastic Processes , 1968 .

[4]  V. Fabian.  On Asymptotic Normality in Stochastic Approximation , 1968 .

[5]  N. Bingham.  INDEPENDENT AND STATIONARY SEQUENCES OF RANDOM VARIABLES , 1973 .

[6]  J. Koronacki.  Random-seeking methods for the stochastic unconstrained optimization , 1975 .

[7]  F. Móricz.  Moment inequalities and the strong laws of large numbers , 1976 .

[8]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[9]  N. Krylov.  Controlled Diffusion Processes , 1980 .

[10]  R. Z. Khasʹminskiĭ,et al.  Statistical estimation : asymptotic theory , 1981 .

[11]  M. Metivier,et al.  Applications of a Kushner and Clark lemma to general classes of stochastic algorithms , 1984, IEEE Trans. Inf. Theory.

[12]  L. Gerencsér.  On a class of mixing processes , 1989 .

[13]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[14]  L. Gerencsér.  Strong approximation results in estimation and adaptive control , 1991 .

[15]  L. Gerencser.  Asymptotics of predictive stochastic complexity , 1991, DCC 1991.

[16]  R. Ober.  Balanced parametrization of classes of linear systems , 1991 .

[17]  L. Gerencsér.  Rate of convergence of recursive estimators , 1992 .

[18]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[19]  Håkan Hjalmarsson.  Aspects on Incomplete Modeling in System Identification , 1993 .

[20]  Han-Fu Chen,et al.  A Stochastic Approximation Algorithm with Random Differences , 1996 .

[21]  Harold J. Kushner,et al.  Stochastic Approximation Algorithms and Applications , 1997, Applications of Mathematics.

[22]  J. Spall,et al.  Model-free control of nonlinear stochastic systems with discrete-time measurements , 1998, IEEE Trans. Autom. Control..

[23]  Tamer Basar,et al.  Analysis of Recursive Stochastic Algorithms , 2001 .

[24]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.