Using Karush-Kuhn-Tucker proximity measure for solving bilevel optimization problems

Abstract A common technique to solve bilevel optimization problems is by reducing the problem to a single level and then solving it as a standard optimization problem. A number of single level reduction formulations exist, but one of the most common ways is to replace the lower level optimization problem with its Karush-Kuhn-Tucker (KKT) conditions. Such a reduction strategy has been widely used in the classical optimization as well as the evolutionary computation literature. However, KKT conditions contain a set of non-linear equality constraints that are often found hard to satisfy. In this paper, we discuss a single level reduction of a bilevel problem using recently proposed relaxed KKT conditions. The conditions are relaxed; therefore, approximate, but the error in terms of distance from the true lower level KKT point is bounded. There is a proximity measure associated to the new KKT conditions, which gives an idea of the KKT error and distance from the optimum. We utilize this reduction method within an evolutionary algorithm to solve bilevel optimization problems. The proposed algorithm is compared against a number of recently proposed approaches. The idea is found to lead to significant computational savings, especially, in the lower level function evaluations. The idea is promising and might be useful for further developments on bilevel optimization both in the domain of classical as well as evolutionary optimization research.

[1]  Wayne F. Bialas,et al.  Two-Level Linear Programming , 1984 .

[2]  P. Marcotte,et al.  A bilevel model of taxation and its application to optimal highway pricing , 1996 .

[3]  Kalyanmoy Deb,et al.  Transportation policy formulation as a multi-objective bilevel optimization problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[4]  Omar Ben-Ayed,et al.  Bilevel linear programming , 1993, Comput. Oper. Res..

[5]  Yafeng Yin,et al.  Genetic-Algorithms-Based Approach for Bilevel Programming Models , 2000 .

[6]  Xianjia Wang,et al.  A Hybrid Differential Evolution Algorithm for Solving Nonlinear Bilevel Programming with Linear Constraints , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[7]  G. Anandalingam,et al.  A penalty function approach for solving bi-level linear programs , 1993, J. Glob. Optim..

[8]  Kalyanmoy Deb,et al.  Approximate KKT points and a proximity measure for termination , 2013, J. Glob. Optim..

[9]  Yan Jiang,et al.  Application of particle swarm optimization based on CHKS smoothing function for solving nonlinear bilevel programming problem , 2013, Appl. Math. Comput..

[10]  Kalyanmoy Deb,et al.  Bilevel optimization based on iterative approximation of multiple mappings , 2020, J. Heuristics.

[11]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[12]  L. N. Vicente,et al.  Descent approaches for quadratic bilevel programming , 1994 .

[13]  Gerald G. Brown,et al.  A Two-Sided Optimization for Theater Ballistic Missile Defense , 2005, Oper. Res..

[14]  Jonathan F. Bard,et al.  A Branch and Bound Algorithm for the Bilevel Programming Problem , 1990, SIAM J. Sci. Comput..

[15]  Patrice Marcotte,et al.  A trust region algorithm for nonlinear bilevel programming , 2001, Oper. Res. Lett..

[16]  Lawrence M. Wein,et al.  OR Forum - Homeland Security: From Mathematical Models to Policy Implementation: The 2008 Philip McCord Morse Lecture , 2009, Oper. Res..

[17]  Peter Värbrand,et al.  A global optimization approach for the linear two-level program , 1993, J. Glob. Optim..

[18]  Mahyar A. Amouzegar,et al.  Determining optimal pollution control policies: An application of bilevel programming , 1999, Eur. J. Oper. Res..

[19]  Kalyanmoy Deb,et al.  Approximated set-valued mapping approach for handling multiobjective bilevel problems , 2017, Comput. Oper. Res..

[20]  Jerome Bracken,et al.  Mathematical Programs with Optimization Problems in the Constraints , 1973, Oper. Res..

[21]  Xiangyong Li,et al.  A Hierarchical Particle Swarm Optimization for Solving Bilevel Programming Problems , 2006, ICAISC.

[22]  M. Florian,et al.  ON THE GEOMETRIC STRUCTURE OF LINEAR BILEVEL PROGRAMS: A DUAL APPROACH , 1992 .

[23]  Kalyanmoy Deb,et al.  An improved bilevel evolutionary algorithm based on Quadratic Approximations , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[24]  Mohammad Mehdi Sepehri,et al.  Linear bilevel programming solution by genetic algorithm , 2002, Comput. Oper. Res..

[25]  Jirí Vladimír Outrata,et al.  On the numerical solution of a class of Stackelberg problems , 1990, ZOR Methods Model. Oper. Res..

[26]  Kalyanmoy Deb,et al.  An Efficient and Accurate Solution Methodology for Bilevel Multi-Objective Programming Problems Using a Hybrid Evolutionary-Local-Search Algorithm , 2010, Evolutionary Computation.

[27]  Kalyanmoy Deb,et al.  Solving optimistic bilevel programs by iteratively approximating lower level optimal value function , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[28]  Kalyanmoy Deb,et al.  Multi-objective Stackelberg game between a regulating authority and a mining company: A case study in environmental economics , 2013, 2013 IEEE Congress on Evolutionary Computation.

[29]  Gilles Savard,et al.  The steepest descent direction for the nonlinear bilevel programming problem , 1990, Oper. Res. Lett..

[30]  Pierre Hansen,et al.  New Branch-and-Bound Rules for Linear Bilevel Programming , 1989, SIAM J. Sci. Comput..

[31]  Eitaro Aiyoshi,et al.  Double penalty method for bilevel optimization problems , 1992, Ann. Oper. Res..

[32]  L. Lasdon,et al.  Derivative evaluation and computational experience with large bilevel mathematical programs , 1990 .

[33]  Kalyanmoy Deb,et al.  Test Problem Construction for Single-Objective Bilevel Optimization , 2014, Evolutionary Computation.

[34]  Martine Labbé,et al.  A Bilevel Model for Toll Optimization on a Multicommodity Transportation Network , 2000, Transp. Sci..

[35]  Jonathan F. Bard,et al.  Algorithms for nonlinear bilevel mathematical programs , 1991, IEEE Trans. Syst. Man Cybern..

[36]  Jonathan F. Bard,et al.  Practical Bilevel Optimization: Algorithms and Applications , 1998 .

[37]  Kalyanmoy Deb,et al.  Evolutionary algorithm for bilevel optimization using approximations of the lower level optimal solution mapping , 2017, Eur. J. Oper. Res..

[38]  Jie Lu,et al.  An extended Kuhn-Tucker approach for linear bilevel programming , 2005, Appl. Math. Comput..

[39]  Eitaro Aiyoshi,et al.  HIERARCHICAL DECENTRALIZED SYSTEM AND ITS NEW SOLUTION BY A BARRIER METHOD. , 1980 .

[40]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[41]  Helio J. C. Barbosa,et al.  Differential Evolution assisted by a surrogate model for bilevel programming problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[42]  Yuping Wang,et al.  A New Evolutionary Algorithm for a Class of Nonlinear Bilevel Programming Problems and Its Global Convergence , 2011, INFORMS J. Comput..

[43]  Kalyanmoy Deb,et al.  A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applications , 2017, IEEE Transactions on Evolutionary Computation.

[44]  Daniel Ralph,et al.  Using EPECs to Model Bilevel Games in Restructured Electricity Markets with Locational Prices , 2007, Oper. Res..

[45]  Panos M. Pardalos,et al.  Global optimization of concave functions subject to quadratic constraints: An application in nonlinear bilevel programming , 1992, Ann. Oper. Res..

[46]  Hecheng Li,et al.  A genetic algorithm using a finite search space for solving nonlinear/linear fractional bilevel programming problems , 2015, Ann. Oper. Res..

[47]  Jessica Andrea Carballido,et al.  On Stopping Criteria for Genetic Algorithms , 2004, SBIA.

[48]  Helio J. C. Barbosa,et al.  Differential evolution for bilevel programming , 2013, 2013 IEEE Congress on Evolutionary Computation.

[49]  Jonathan F. Bard,et al.  An explicit solution to the multi-level programming problem , 1982, Comput. Oper. Res..

[50]  Kalyanmoy Deb,et al.  Finding optimal strategies in a multi-period multi-leader-follower Stackelberg game using an evolutionary algorithm , 2013, Comput. Oper. Res..

[51]  Heinrich von Stackelberg,et al.  Stackelberg (Heinrich von) - The Theory of the Market Economy, translated from the German and with an introduction by Alan T. PEACOCK. , 1953 .

[52]  José Fortuny-Amat,et al.  A Representation and Economic Interpretation of a Two-Level Programming Problem , 1981 .

[53]  E. Aiyoshi,et al.  A solution method for the static constrained Stackelberg problem via penalty method , 1984 .

[54]  Kalyanmoy Deb,et al.  Solving Bilevel Multicriterion Optimization Problems With Lower Level Decision Uncertainty , 2016, IEEE Transactions on Evolutionary Computation.

[55]  Guoshan Liu,et al.  A trust region algorithm for bilevel programing problems , 1998 .

[56]  William R. Smith,et al.  Chemical Reaction Equilibrium Analysis: Theory and Algorithms , 1982 .

[57]  Stephan Dempe,et al.  Foundations of Bilevel Programming , 2002 .

[58]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[59]  G. Anandalingam,et al.  Genetic algorithm based approach to bi-level linear programming , 1994 .

[60]  Arthur W. Westerberg,et al.  Bilevel programming for steady-state chemical process design—I. Fundamentals and algorithms , 1990 .

[61]  Ue-Pyng Wen,et al.  Linear Bi-level Programming Problems — A Review , 1991 .

[62]  Yuping Wang,et al.  An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint-handling scheme , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[63]  Patrice Marcotte,et al.  A Trust-Region Method for Nonlinear Bilevel Programming: Algorithm and Computational Experience , 2005, Comput. Optim. Appl..