Optimization of stochastic systems

This paper gives a short survey of Monte Carlo algorithms for stochastic optimization. Both discrete and continuous parameter stochastic optimization are discussed, with emphasis on the analysis of convergence rate. Some future research directions for the area are also indicated.