Bilevel Optimization Based on Kriging Approximations of Lower Level Optimal Value Function

A large number of application problems involve two levels of optimization, where one optimization task is nested inside the other. These problems are known as bilevel optimization problems and have been widely studied by researchers in the area of mathematical optimization. Bilevel optimization problems are known to be difficult and computationally demanding. Most of the solution procedures proposed until now are either computationally very expensive or applicable to only a narrow class of bilevel optimization problems involving small number of variables. In this paper, we propose a global optimization algorithm for bilevel optimization using Kriging approximation based model that tries to reduce the computational expense by iteratively approximating an important mapping in bilevel optimization; namely, the lower level optimal value function mapping. The lower level optimal value function is useful in reducing the two level optimization task to one; however, identifying this function is not straightforward. Our approach aims at meta-modeling this mapping and solving a number of auxiliary single level problems to arrive at the bilevel optimum. In our study, we test the methodology on a number of test problems. The preliminary results are quite promising which suggest the viability of the approach in solving more complicated bilevel test problem. To the best knowledge of the authors, such kind of a solution procedure based on iterative approximation of the optimal lower level value function using a stochastic process has not been widely used in bilevel optimization.

[1]  Gilles Savard,et al.  The steepest descent direction for the nonlinear bilevel programming problem , 1990, Oper. Res. Lett..

[2]  Stephan Dempe,et al.  Foundations of Bilevel Programming , 2002 .

[3]  Eitaro Aiyoshi,et al.  Double penalty method for bilevel optimization problems , 1992, Ann. Oper. Res..

[4]  Gerald G. Brown,et al.  A Two-Sided Optimization for Theater Ballistic Missile Defense , 2005, Oper. Res..

[5]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[6]  Yan Jiang,et al.  Application of particle swarm optimization based on CHKS smoothing function for solving nonlinear bilevel programming problem , 2013, Appl. Math. Comput..

[7]  G. Anandalingam,et al.  Genetic algorithm based approach to bi-level linear programming , 1994 .

[8]  L. N. Vicente,et al.  Descent approaches for quadratic bilevel programming , 1994 .

[9]  Helio J. C. Barbosa,et al.  Differential evolution for bilevel programming , 2013, 2013 IEEE Congress on Evolutionary Computation.

[10]  Arthur W. Westerberg,et al.  Bilevel programming for steady-state chemical process design—I. Fundamentals and algorithms , 1990 .

[11]  Jonathan F. Bard,et al.  An explicit solution to the multi-level programming problem , 1982, Comput. Oper. Res..

[12]  Yafeng Yin,et al.  Genetic-Algorithms-Based Approach for Bilevel Programming Models , 2000 .

[13]  Xianjia Wang,et al.  A Hybrid Differential Evolution Algorithm for Solving Nonlinear Bilevel Programming with Linear Constraints , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[14]  Kalyanmoy Deb,et al.  Finding optimal strategies in a multi-period multi-leader-follower Stackelberg game using an evolutionary algorithm , 2013, Comput. Oper. Res..

[15]  Patrice Marcotte,et al.  A trust region algorithm for nonlinear bilevel programming , 2001, Oper. Res. Lett..

[16]  Heinrich von Stackelberg,et al.  Stackelberg (Heinrich von) - The Theory of the Market Economy, translated from the German and with an introduction by Alan T. PEACOCK. , 1953 .

[17]  Kalyanmoy Deb,et al.  Using Karush-Kuhn-Tucker proximity measure for solving bilevel optimization problems , 2019, Swarm Evol. Comput..

[18]  Lawrence M. Wein,et al.  OR Forum - Homeland Security: From Mathematical Models to Policy Implementation: The 2008 Philip McCord Morse Lecture , 2009, Oper. Res..

[19]  Hecheng Li,et al.  A genetic algorithm using a finite search space for solving nonlinear/linear fractional bilevel programming problems , 2015, Ann. Oper. Res..

[20]  Guoshan Liu,et al.  A trust region algorithm for bilevel programing problems , 1998 .

[21]  Peter Värbrand,et al.  A global optimization approach for the linear two-level program , 1993, J. Glob. Optim..

[22]  William R. Smith,et al.  Chemical Reaction Equilibrium Analysis: Theory and Algorithms , 1982 .

[23]  Jonathan F. Bard,et al.  A Branch and Bound Algorithm for the Bilevel Programming Problem , 1990, SIAM J. Sci. Comput..

[24]  P. Marcotte,et al.  A bilevel model of taxation and its application to optimal highway pricing , 1996 .

[25]  Kalyanmoy Deb,et al.  Transportation policy formulation as a multi-objective bilevel optimization problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[26]  Jerome Bracken,et al.  Mathematical Programs with Optimization Problems in the Constraints , 1973, Oper. Res..

[27]  Omar Ben-Ayed,et al.  Bilevel linear programming , 1993, Comput. Oper. Res..

[28]  G. Anandalingam,et al.  A penalty function approach for solving bi-level linear programs , 1993, J. Glob. Optim..

[29]  Kalyanmoy Deb,et al.  Approximated set-valued mapping approach for handling multiobjective bilevel problems , 2017, Comput. Oper. Res..

[30]  Kalyanmoy Deb,et al.  Evolutionary bilevel optimization using KKT proximity measure , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[31]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[32]  Jonathan F. Bard,et al.  Algorithms for nonlinear bilevel mathematical programs , 1991, IEEE Trans. Syst. Man Cybern..

[33]  Kalyanmoy Deb,et al.  Evolutionary algorithm for bilevel optimization using approximations of the lower level optimal solution mapping , 2017, Eur. J. Oper. Res..

[34]  Jane J. Ye,et al.  New Necessary Optimality Conditions for Bilevel Programs by Combining the MPEC and Value Function Approaches , 2010, SIAM J. Optim..

[35]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[36]  Kalyanmoy Deb,et al.  Bilevel optimization based on iterative approximation of multiple mappings , 2020, J. Heuristics.

[37]  Helio J. C. Barbosa,et al.  Differential Evolution assisted by a surrogate model for bilevel programming problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[38]  Eitaro Aiyoshi,et al.  HIERARCHICAL DECENTRALIZED SYSTEM AND ITS NEW SOLUTION BY A BARRIER METHOD. , 1980 .

[39]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[40]  Ue-Pyng Wen,et al.  Linear Bi-level Programming Problems — A Review , 1991 .

[41]  Yuping Wang,et al.  An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint-handling scheme , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[42]  Xiangyong Li,et al.  A Hierarchical Particle Swarm Optimization for Solving Bilevel Programming Problems , 2006, ICAISC.

[43]  Kalyanmoy Deb,et al.  An improved bilevel evolutionary algorithm based on Quadratic Approximations , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[44]  Patrice Marcotte,et al.  A Trust-Region Method for Nonlinear Bilevel Programming: Algorithm and Computational Experience , 2005, Comput. Optim. Appl..

[45]  Mohammad Mehdi Sepehri,et al.  Linear bilevel programming solution by genetic algorithm , 2002, Comput. Oper. Res..

[46]  Jonathan F. Bard,et al.  Practical Bilevel Optimization: Algorithms and Applications , 1998 .

[47]  Miles G. Nicholls,et al.  Aluminum Production Modeling - A Nonlinear Bilevel Programming Approach , 1995, Oper. Res..

[48]  Yuping Wang,et al.  A New Evolutionary Algorithm for a Class of Nonlinear Bilevel Programming Problems and Its Global Convergence , 2011, INFORMS J. Comput..

[49]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[50]  Kalyanmoy Deb,et al.  Multi-objective Stackelberg game between a regulating authority and a mining company: A case study in environmental economics , 2013, 2013 IEEE Congress on Evolutionary Computation.

[51]  Kalyanmoy Deb,et al.  Test Problem Construction for Single-Objective Bilevel Optimization , 2014, Evolutionary Computation.

[52]  Martine Labbé,et al.  A Bilevel Model for Toll Optimization on a Multicommodity Transportation Network , 2000, Transp. Sci..

[53]  José Fortuny-Amat,et al.  A Representation and Economic Interpretation of a Two-Level Programming Problem , 1981 .

[54]  E. Aiyoshi,et al.  A solution method for the static constrained Stackelberg problem via penalty method , 1984 .

[55]  Kalyanmoy Deb,et al.  Solving Bilevel Multicriterion Optimization Problems With Lower Level Decision Uncertainty , 2016, IEEE Transactions on Evolutionary Computation.

[56]  Kalyanmoy Deb,et al.  A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applications , 2017, IEEE Transactions on Evolutionary Computation.

[57]  Daniel Ralph,et al.  Using EPECs to Model Bilevel Games in Restructured Electricity Markets with Locational Prices , 2007, Oper. Res..

[58]  Panos M. Pardalos,et al.  Global optimization of concave functions subject to quadratic constraints: An application in nonlinear bilevel programming , 1992, Ann. Oper. Res..

[59]  Kalyanmoy Deb,et al.  An Efficient and Accurate Solution Methodology for Bilevel Multi-Objective Programming Problems Using a Hybrid Evolutionary-Local-Search Algorithm , 2010, Evolutionary Computation.

[60]  Kalyanmoy Deb,et al.  Solving optimistic bilevel programs by iteratively approximating lower level optimal value function , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).