Robust and Reliable Solutions in Bilevel Optimization Problems Under Uncertainties

Abstract Bilevel optimization problems have received a growing attention in the recent past due to their relevance in practice. A number of studies on bilevel applications and solution methodologies are available for deterministic setup, but studies on uncertainties in bilevel optimization are rare. In this paper, we suggest methodologies for handling uncertainty in both lower and upper level decision variables that may occur from different practicalities. For the first time, we discuss and demonstrate the effect of uncertainties in each level along with the definition of a robustness and reliability in the context of bilevel optimization. To begin with, the definitions of robustness and reliability in the presence of uncertain upper and lower level variables are introduced. The issues and complexities introduced due to such uncertainties are then studied through a number of test cases. Finally, two real world bilevel test problems involving uncertainties in decision variables are solved. The first problem is an electrical circuit design problem where the objective is to maximize the gain at upper level with a stability requirement at the lower level. The second problem is a constrained navy ship design problem involving physical design parameters at the upper level and operating parameters at the lower level.

[1]  R. Kevin Wood,et al.  Shortest‐path network interdiction , 2002, Networks.

[2]  Kalyanmoy Deb,et al.  Handling inverse optimal control problems using evolutionary bilevel optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[3]  Richard L. Church,et al.  A bilevel mixed-integer program for critical infrastructure protection planning , 2008, Comput. Oper. Res..

[4]  Hae Chang Gea,et al.  Two-Level Approximation Method for Reliability-Based Design Optimization , 2004, DAC 2004.

[5]  Eitaro Aiyoshi,et al.  HIERARCHICAL DECENTRALIZED SYSTEM AND ITS NEW SOLUTION BY A BARRIER METHOD. , 1980 .

[6]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[7]  Xiangyong Li,et al.  A Hierarchical Particle Swarm Optimization for Solving Bilevel Programming Problems , 2006, ICAISC.

[8]  Kalyanmoy Deb,et al.  A bilevel optimization approach to automated parameter tuning , 2014, GECCO.

[9]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[10]  Thomas A. Cruse,et al.  Reliability-Based Mechanical Design , 1997 .

[11]  Lucio Bianco,et al.  A Bilevel flow model for HazMat transportation network design , 2008 .

[12]  Gerald G. Brown,et al.  Defending Critical Infrastructure , 2006, Interfaces.

[13]  Jian-Bo Yang,et al.  Multiple Criteria Decision Support in Engineering Design , 1998 .

[14]  James K. Lowe,et al.  Homeland Security: Operations Research Initiatives and Applications , 2006, Interfaces.

[15]  Kalyanmoy Deb,et al.  An improved bilevel evolutionary algorithm based on Quadratic Approximations , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[16]  Mohammad Mehdi Sepehri,et al.  Linear bilevel programming solution by genetic algorithm , 2002, Comput. Oper. Res..

[17]  Robert F. Stengel,et al.  Robust control system design using random search and genetic algorithms , 1997, IEEE Trans. Autom. Control..

[18]  Yan Jiang,et al.  Application of particle swarm optimization based on CHKS smoothing function for solving nonlinear bilevel programming problem , 2013, Appl. Math. Comput..

[19]  L. N. Vicente,et al.  Descent approaches for quadratic bilevel programming , 1994 .

[20]  Mikkel T. Jensen,et al.  Generating robust and flexible job shop schedules using genetic algorithms , 2003, IEEE Trans. Evol. Comput..

[21]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[22]  Tapabrata Ray,et al.  A PARALLEL HYBRID OPTIMIZATION ALGORITHM FOR ROBUST AIRFOIL DESIGN , 2004 .

[23]  Laurent El Ghaoui,et al.  Robust Optimization , 2021, ICORES.

[24]  Martin P. Bendsøe,et al.  Optimization of Structural Topology, Shape, And Material , 1995 .

[25]  Kalyanmoy Deb,et al.  Introducing Robustness in Multi-Objective Optimization , 2006, Evolutionary Computation.

[26]  Jun Castro,et al.  Designing Multimodal Freight Transport Networks: A Heuristic Approach and Applications , 2009, Transp. Sci..

[27]  Martine Labbé,et al.  A Bilevel Model for Toll Optimization on a Multicommodity Transportation Network , 2000, Transp. Sci..

[28]  Kalyanmoy Deb,et al.  Finding optimal strategies in a multi-period multi-leader-follower Stackelberg game using an evolutionary algorithm , 2013, Comput. Oper. Res..

[29]  J. Herskovits,et al.  Contact shape optimization: a bilevel programming approach , 2000 .

[30]  A. Plotkin,et al.  Robust-Optimal Design of a Lightweight Space Structure Using a Genetic Algorithm , 2003 .

[31]  M. Patriksson,et al.  Stochastic bilevel programming in structural optimization , 2001 .

[32]  Gerald G. Brown,et al.  A Two-Sided Optimization for Theater Ballistic Missile Defense , 2005, Oper. Res..

[33]  I. K. Altinel,et al.  Competitive facility location problem with attractiveness adjustment of the follower: A bilevel programming model and its solution , 2011, Eur. J. Oper. Res..

[34]  Shigeyoshi Tsutsui,et al.  Genetic algorithms with a robust solution searching scheme , 1997, IEEE Trans. Evol. Comput..

[35]  Gao Zi-You,et al.  A bi-level programming model and solution algorithm for the location of logistics distribution centers , 2008 .

[36]  Robert H. Storer,et al.  Robustness Measures and Robust Scheduling for Job Shops , 1994 .

[37]  Lawrence M. Wein,et al.  OR Forum - Homeland Security: From Mathematical Models to Policy Implementation: The 2008 Philip McCord Morse Lecture , 2009, Oper. Res..

[38]  Mahyar A. Amouzegar,et al.  Determining optimal pollution control policies: An application of bilevel programming , 1999, Eur. J. Oper. Res..

[39]  Seungjae Lee,et al.  Stochastic multi-objective models for network design problem , 2010, Expert Syst. Appl..

[40]  Kalyanmoy Deb,et al.  Multi-objective Stackelberg game between a regulating authority and a mining company: A case study in environmental economics , 2013, 2013 IEEE Congress on Evolutionary Computation.

[41]  Shi Feng Bi-level Simulated Annealing Algorithm for Facility Location , 2007 .

[42]  Lorenz T. Biegler,et al.  Mathematical programs with equilibrium constraints (MPECs) in process engineering , 2003, Comput. Chem. Eng..

[43]  Kalyanmoy Deb,et al.  Reliability-Based Optimization Using Evolutionary Algorithms , 2009, IEEE Transactions on Evolutionary Computation.

[44]  William R. Smith,et al.  Chemical Reaction Equilibrium Analysis: Theory and Algorithms , 1982 .

[45]  P. Marcotte,et al.  A bilevel model of taxation and its application to optimal highway pricing , 1996 .

[46]  Randy B Machemehl,et al.  Bi-Level Optimization Model for Public Transportation Network Redesign Problem , 2011 .

[47]  Arthur W. Westerberg,et al.  Bilevel programming for steady-state chemical process design , 1990 .

[48]  Takeshi Uno,et al.  An evolutionary multi-agent based search method for stackelberg solutions of bilevel facility location problems , 2008 .

[49]  Adrian Thompson,et al.  Evolutionary techniques for fault tolerance , 1996 .

[50]  Jonathan F. Bard,et al.  An explicit solution to the multi-level programming problem , 1982, Comput. Oper. Res..

[51]  A. M. Hasofer,et al.  Exact and Invariant Second-Moment Code Format , 1974 .

[52]  T. Arima,et al.  Aerodynamic Optimization for the Transonic Compressor Stator Blade , 2002 .

[53]  Ankur Sinha,et al.  Incorporating data envelopment analysis solution methods into bilevel multi-objective optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[54]  Jing Hu,et al.  Bilevel Optimization and Machine Learning , 2008, WCCI.

[55]  Ian C. Parmee,et al.  Improving the Robustness of COGA: The Dynamic Adaptive Filter , 2000 .

[56]  Michael Florian,et al.  Optimizing frequencies in a transit network: a nonlinear bi-level programming approach , 1995 .

[57]  Kalyanmoy Deb,et al.  Solving optimistic bilevel programs by iteratively approximating lower level optimal value function , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).