A distributional interpretation of robust optimization

Motivated by data-driven decision making and sampling problems, we investigate probabilistic interpretations of Robust Optimization (RO). We establish a connection between RO and Distributionally Robust Stochastic Programming (DRSP), showing that the solution to any RO problem is also a solution to a DRSP problem. Specifically, we consider the case where multiple uncertain parameters belong to the same fixed dimensional space, and find the set of distributions of the equivalent DRSP. The equivalence we derive enables us to construct RO formulations that are statistically consistent, and in the process, provides a systematic approach for tuning the uncertainty set.

[1]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[2]  Shie Mannor,et al.  The Robustness-Performance Tradeoff in Markov Decision Processes , 2006, NIPS.

[3]  Alexander Shapiro,et al.  Worst-case distribution analysis of stochastic programs , 2006, Math. Program..

[4]  J. Dupacová.  The minimax approach to stochastic programming and an illustrative application , 1987 .

[5]  Yurii Nesterov,et al.  Primal-dual subgradient methods for convex problems , 2005, Math. Program..

[6]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[7]  Richard A. Davis,et al.  Remarks on Some Nonparametric Estimates of a Density Function , 2011 .

[8]  Michael I. Jordan,et al.  A Robust Minimax Approach to Classification , 2003, J. Mach. Learn. Res..

[9]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[10]  John M. Wilson,et al.  Introduction to Stochastic Programming , 1998, J. Oper. Res. Soc..

[11]  Laurent El Ghaoui,et al.  Robust Optimization , 2021, ICORES.

[12]  Laurent El Ghaoui,et al.  Robust Solutions to Least-Squares Problems with Uncertain Data , 1997, SIAM J. Matrix Anal. Appl..

[13]  Boaz Golany,et al.  Supplier-Retailer Flexible Commitments Contracts : A Robust Optimization Approach , 2003 .

[14]  Thomas Hofmann,et al.  The Robustness-Performance Tradeoff in Markov Decision Processes , 2007 .

[15]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[16]  R. Wets,et al.  Epi‐consistency of convex stochastic programs , 1991 .

[17]  András Prékopa.  Static Stochastic Programming Models , 1995 .

[18]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[19]  A. Ben-Tal,et al.  Adjustable robust solutions of uncertain linear programs , 2004, Math. Program..

[20]  P. Kall,et al.  Stochastric programming with recourse: upper bounds and moment problems: a review , 1988 .

[21]  Alexander Shapiro,et al.  On the Rate of Convergence of Optimal Solutions of Monte Carlo Approximations of Stochastic Programs , 2000, SIAM J. Optim..

[22]  Arkadi Nemirovski,et al.  Robust solutions of uncertain linear programs , 1999, Oper. Res. Lett..

[23]  Boaz Golany,et al.  Retailer-Supplier Flexible Commitments Contracts: A Robust Optimization Approach , 2005, Manuf. Serv. Oper. Manag..

[24]  Shie Mannor,et al.  Robust Regression and Lasso , 2008, IEEE Transactions on Information Theory.

[25]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[26]  Alexander Shapiro,et al.  Asymptotic analysis of stochastic programs , 1991, Ann. Oper. Res..

[27]  Shie Mannor,et al.  Percentile Optimization for Markov Decision Processes with Parameter Uncertainty , 2010, Oper. Res..

[28]  Ioana Popescu,et al.  Robust Mean-Covariance Solutions for Stochastic Optimization , 2007, Oper. Res..

[29]  K. Isii.  On sharpness of tchebycheff-type inequalities , 1962 .

[30]  Shie Mannor,et al.  Robustness and Regularization of Support Vector Machines , 2008, J. Mach. Learn. Res..

[31]  Allen L. Soyster,et al.  Technical Note - Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming , 1973, Oper. Res..

[32]  Melvyn Sim,et al.  Distributionally Robust Optimization and Its Tractable Approximations , 2010, Oper. Res..

[33]  Arkadi Nemirovski,et al.  Robust Modeling of Multi-Stage Portfolio Problems , 2000 .

[34]  Shun-ichi Amari,et al.  A Theory of Pattern Recognition , 1968 .

[35]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[36]  Alexander J. Smola,et al.  Second Order Cone Programming Approaches for Handling Missing and Uncertain Data , 2006, J. Mach. Learn. Res..

[37]  Ingo Steinwart,et al.  Consistency of support vector machines and other regularized kernel classifiers , 2005, IEEE Transactions on Information Theory.

[38]  L. Devroye,et al.  Nonparametric density estimation : the L[1] view , 1987 .

[39]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[40]  David W. Scott,et al.  Multivariate Density Estimation: Theory, Practice, and Visualization , 1992, Wiley Series in Probability and Statistics.

[41]  Stephen P. Boyd,et al.  Digital Circuit Optimization via Geometric Programming , 2005, Oper. Res..

[42]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[43]  Peter L. Bartlett,et al.  Neural Network Learning - Theoretical Foundations , 1999 .

[44]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[45]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[46]  Luc Devroye,et al.  Nonparametric Density Estimation , 1985 .

[47]  A. Shapiro,et al.  On rate of convergence of Monte Carlo approximations of stochastic programs , 1998 .

[48]  柳井 浩,et al.  A Min Max Solution of an inventory problem , 1959 .

[49]  Arkadi Nemirovski,et al.  Robust solutions of Linear Programming problems contaminated with uncertain data , 2000, Math. Program..