AN OVERVIEW OF THE SIMULTANEOUS PERTURBATION METHOD FOR EFFICIENT OPTIMIZATION

ultivariate stochastic optimization plays a major role in the analysis and control of many engineering systems. In almost all real-world optimization problems, it is necessary to use a mathematical algorithm that iteratively seeks out the solution because an analytical (closed-form) solution is rarely available. In this spirit, the “simultaneous perturbation stochastic approximation (SPSA)” method for difficult multivariate optimization problems has been developed. SPSA has recently attracted considerable international attention in areas such as statistical parameter estimation, feedback control, simulation-based optimization, signal and image processing, and experimental design. The essential feature of SPSA—which accounts for its power and relative ease of implementation—is the underlying gradient approximation that requires only two measurements of the objective function regardless of the dimension of the optimization problem. This feature allows for a significant decrease in the cost of optimization, especially in problems with a large number of variables to be optimized. (

[1]  J. Kiefer,et al.  Stochastic Estimation of the Maximum of a Regression Function , 1952 .

[2]  Philip G. Smith Evaluation and Practical Deliberations in Education. , 1978 .

[3]  J. Spall A stochastic approximation algorithm for large-dimensional systems in the Kiefer-Wolfowitz setting , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[4]  J. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[5]  Gert Cauwenberghs Analog VLSI autonomous systems for learning and optimization , 1994 .

[6]  D. C. Chin,et al.  A more efficient global optimization algorithm based on Styblinski and Tang , 1994, Neural Networks.

[7]  J. Spall,et al.  Nonlinear adaptive control using neural networks: estimation with a smoothed form of simultaneous perturbation gradient approximation , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[8]  Fahimeh Rezayat On the use of an SPSA-based model-free controller in quality improvement , 1995, Autom..

[9]  M. Fu,et al.  Transfer optimization via simultaneous perturbation stochastic approximation , 1995, Winter Simulation Conference Proceedings, 1995..

[10]  Yutaka Maeda,et al.  A learning rule of neural networks via simultaneous perturbation and its hardware implementation , 1995, Neural Networks.

[11]  M. Fu,et al.  Optimization of discrete event systems via simultaneous perturbation stochastic approximation , 1997 .

[12]  James C. Spall,et al.  A one-measurement form of simultaneous perturbation stochastic approximation , 1997, Autom..

[13]  Harold J. Kushner,et al.  Stochastic Approximation Algorithms and Applications , 1997, Applications of Mathematics.

[14]  J. Spall Accelerated second-order stochastic optimization using only function measurements , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[15]  S. D. Hill,et al.  SPSA/SIMMOD optimization of air traffic delay cost , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[16]  D. C. Chin,et al.  Comparative study of stochastic algorithms for system optimization based on gradient approximations , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[17]  D. C. Chin,et al.  Traffic-responsive signal timing for system-wide traffic control , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[18]  Yangsheng Xu,et al.  Human control strategy: abstraction, verification, and replication , 1997 .

[19]  Thomas Parisini,et al.  Nonlinear modeling of complex large-scale plants using neural networks and stochastic approximation , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[20]  Rui J. P. de Figueiredo,et al.  Learning rules for neuro-controller via simultaneous perturbation , 1997, IEEE Trans. Neural Networks.

[21]  James C. Spall,et al.  A neural network controller for systems with unmodeled dynamics with applications to wastewater treatment , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Payman Sadegh,et al.  Constrained optimization via stochastic approximation with a simultaneous perturbation gradient approximation , 1997, Autom..

[23]  James C. Spall,et al.  EVALUATION AND PRACTICAL CONSIDERATIONS FOR THE S-TRAC SYSTEM-WIDE TRAFFIC SIGNAL CONTROL , 1998 .

[24]  A Orman,et al.  Optimization of Stochastic Models: The Interface Between Simulation and Optimization , 2012, J. Oper. Res. Soc..

[25]  J. Spall Implementation of the simultaneous perturbation algorithm for stochastic optimization , 1998 .

[26]  D. C. Chin The simultaneous perturbation method for processing magnetospheric images , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[27]  J. Spall,et al.  Model-free control of nonlinear stochastic systems with discrete-time measurements , 1998, IEEE Trans. Autom. Control..

[28]  J. Spall,et al.  Optimal sensor configuration for complex systems , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[29]  J. Spall Stochastic Optimization, Stochastic Approximation and Simulated Annealing , 1999 .