Feature Article: Optimization for simulation: Theory vs. Practice

Probably one of the most successful interfaces between operations research and computer science has been the development of discrete-event simulation software. The recent integration of optimization techniques into simulation practice, specically into commercial software, has become nearly ubiquitous, as most discrete-event simulation packages now include some form of ?optimization? routine. The main thesis of this article, how-ever,is that there is a disconnect between research in simulation optimization--which has addressed the stochastic nature of discrete-event simulation by concentratingon theoretical results of convergence and specialized algorithms that are mathematically elegant--and the recent software developments, which implement very general algorithms adopted from techniques in the deterministic optimization metaheuristic literature (e.g., genetic algorithms, tabu search, artificial neural networks). A tutorial exposition that summarizes the approaches found in the research literature is included, as well as a discussion contrasting these approaches with the algorithms implemented in commercial software. The article concludes with the author's speculations on promising research areas and possible future directions in practice.

[1]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[2]  S. Varadhan Large Deviations and Applications , 1984 .

[3]  L. Schruben,et al.  A Review of Techniques for Simulation Optimization , 1986 .

[4]  S. Jacobson,et al.  Techniques for simulation response optimization , 1989 .

[5]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[6]  Ronald W. Wolff,et al.  Stochastic Modeling and the Theory of Queues , 1989 .

[7]  James A. Bucklew,et al.  Large Deviation Techniques in Decision, Simulation, and Estimation , 1990 .

[8]  Paul Glasserman,et al.  Gradient Estimation Via Perturbation Analysis , 1990 .

[9]  Harald Niederreiter,et al.  Random number generation and Quasi-Monte Carlo methods , 1992, CBMS-NSF regional conference series in applied mathematics.

[10]  Yu-Chi Ho,et al.  Ordinal optimization of DEDS , 1992, Discret. Event Dyn. Syst..

[11]  J. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[12]  Michael C. Fu,et al.  Optimization via simulation: A review , 1994, Ann. Oper. Res..

[13]  L. Dai Convergence properties of ordinal comparison in the simulation of discrete event dynamic systems , 1995 .

[14]  Jason H. Goodfriend,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1995 .

[15]  Michael C. Fu,et al.  Sensitivity Analysis for Monte Carlo Simulation of Option Pricing , 1995, Probability in the Engineering and Informational Sciences.

[16]  A. Tamhane Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[17]  George Ch. Pflug,et al.  Optimization of Stochastic Models , 1996 .

[18]  Sigrún Andradóttir,et al.  A Global Search Method for Discrete Stochastic Optimization , 1996, SIAM J. Optim..

[19]  Stephen M. Robinson,et al.  Analysis of Sample-Path Optimization , 1996, Math. Oper. Res..

[20]  M. Fu,et al.  Optimization of discrete event systems via simultaneous perturbation stochastic approximation , 1997 .

[21]  Saul I. Gass,et al.  Encyclopedia of Operations Research and Management Science , 1997 .

[22]  Jack P. C. Kleijnen,et al.  Experimental Design for Sensitivity Analysis, Optimization and Validation of Simulation Models , 1997 .

[23]  Chun-Hung Chen,et al.  Rates of Convergence of Ordinal Comparison for Dependent Discrete Event Dynamic Systems , 1997 .

[24]  Michael C. Fu,et al.  Conditional Monte Carlo , 1997 .

[25]  R. Caflisch Monte Carlo and quasi-Monte Carlo methods , 1998, Acta Numerica.

[26]  Russell R. Barton,et al.  Simulation metamodels , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[27]  J. Banks,et al.  Handbook of Simulation , 1998 .

[28]  Barry L. Nelson,et al.  Search and selection for large-scale stochastic optimization , 1999 .

[29]  Gül Gürkan,et al.  Sample-path solution of stochastic variational inequalities , 1999, Math. Program..

[30]  Fred W. Glover,et al.  New advances for wedding optimization and simulation , 1999, WSC '99.

[31]  Barry L. Nelson,et al.  A ranking and selection project: experiences from a university-industry collaboration , 1999, WSC '99.

[32]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[33]  Roman Kapuscinski,et al.  Optimal Policies and Simulation-Based Optimization for Capacitated Production Inventory Systems , 1999 .

[34]  Marco Dorigo,et al.  From Natural to Artificial Swarm Intelligence , 1999 .

[35]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[36]  László Gerencsér,et al.  Optimization over discrete sets via SPSA , 1999, WSC '99.

[37]  Susan M. Sanchez,et al.  Design of experiments: robust design: seeking the best of all possible worlds , 2000, WSC.

[38]  Christos G. Cassandras,et al.  Ordinal optimisation and simulation , 2000, J. Oper. Res. Soc..

[39]  Fred W. Glover,et al.  Integrating optimization and simulation: research and practice , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[40]  Chun-Hung Chen,et al.  Computing efforts allocation for ordinal optimization and discrete event simulation , 2000, IEEE Trans. Autom. Control..

[41]  Susan M. Sanchez,et al.  Robust design: seeking the best of all possible worlds , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[42]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[43]  Leyuan Shi,et al.  Nested Partitions Method for Global Optimization , 2000, Oper. Res..

[44]  Julie L. Swann,et al.  Simple Procedures for Selecting the Best Simulated System When the Number of Alternatives is Large , 2001, Oper. Res..

[45]  Sigurdur Olafsson,et al.  Simulation optimization , 2002, Proceedings of the Winter Simulation Conference.

[46]  Barry L. Nelson,et al.  Using Ranking and Selection to "Clean Up" after Simulation Optimization , 2003, Oper. Res..

[47]  Barry L. Nelson,et al.  A framework for simulation-optimization software , 2003 .