Evolutionary Bilevel Optimization: An Introduction and Recent Advances

Bilevel optimization involves two levels of optimization where one optimization level acts as a constraint to another optimization level. There are enormous applications that are bilevel in nature; however, given the difficulties associated with solving this difficult class of problem, the area still lacks efficient solution methods capable of handling complex application problems. Most of the available solution methods can either be applied to highly restrictive class of problems, or are computationally very expensive such that they do not scale for large scale bilevel problems. The difficulties in bilevel programming arise primarily from the nested structure of the problem. Evolutionary algorithms have been able to demonstrate its potential in solving single-level optimization problems. In this chapter, we provide an introduction to the progress made by the evolutionary computation community towards handling bilevel problems. The chapter highlights past research and future research directions both on single as well as multiobjective bilevel programming. Some of the immediate application areas of bilevel programming have also been highlighted.

[1]  Kalyanmoy Deb,et al.  Finding optimal strategies in a multi-period multi-leader-follower Stackelberg game using an evolutionary algorithm , 2013, Comput. Oper. Res..

[2]  Helio J. C. Barbosa,et al.  Differential evolution for bilevel programming , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  Kalyanmoy Deb,et al.  Towards Understanding Bilevel Multi-objective Optimization with Deterministic Lower Level Decisions , 2015, EMO.

[4]  Jane J. Ye,et al.  New Necessary Optimality Conditions for Bilevel Programs by Combining the MPEC and Value Function Approaches , 2010, SIAM J. Optim..

[5]  Heinrich von Stackelberg theory of the market economy , 1952 .

[6]  Guoshan Liu,et al.  A trust region algorithm for bilevel programing problems , 1998 .

[7]  Gabriele Eichfelder,et al.  Multiobjective bilevel optimization , 2010, Math. Program..

[8]  Jonathan F. Bard,et al.  An explicit solution to the multi-level programming problem , 1982, Comput. Oper. Res..

[9]  Bo An,et al.  A Deployed Quantal Response-Based Patrol Planning System for the U.S. Coast Guard , 2013, Interfaces.

[10]  M. Patriksson,et al.  Stochastic bilevel programming in structural optimization , 2001 .

[11]  Kalyanmoy Deb,et al.  Finding Reliable Solutions in Bilevel Optimization Problems Under Uncertainties , 2016, GECCO.

[12]  Liang-Hsuan Chen,et al.  Considering decision decentralizations to solve bi-level multi-objective decision-making problems: A fuzzy approach , 2013 .

[13]  Jonathan F. Bard,et al.  A Branch and Bound Algorithm for the Bilevel Programming Problem , 1990, SIAM J. Sci. Comput..

[14]  Sanaz Mostaghim,et al.  Bilevel Optimization of Multi-Component Chemical Systems Using Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[15]  Hecheng Li,et al.  A genetic algorithm using a finite search space for solving nonlinear/linear fractional bilevel programming problems , 2015, Ann. Oper. Res..

[16]  Jean-Paul Laumond,et al.  From human to humanoid locomotion—an inverse optimal control approach , 2010, Auton. Robots.

[17]  Martine Labbé,et al.  A Bilevel Model for Toll Optimization on a Multicommodity Transportation Network , 2000, Transp. Sci..

[18]  Michael Florian,et al.  Optimizing frequencies in a transit network: a nonlinear bi-level programming approach , 1995 .

[19]  Kalyanmoy Deb,et al.  Approximated set-valued mapping approach for handling multiobjective bilevel problems , 2017, Comput. Oper. Res..

[20]  Kalyanmoy Deb,et al.  An Efficient and Accurate Solution Methodology for Bilevel Multi-Objective Programming Problems Using a Hybrid Evolutionary-Local-Search Algorithm , 2010, Evolutionary Computation.

[21]  Kalyanmoy Deb,et al.  Solving optimistic bilevel programs by iteratively approximating lower level optimal value function , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[22]  Yuping Wang,et al.  An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint-handling scheme , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Pierre Hansen,et al.  New Branch-and-Bound Rules for Linear Bilevel Programming , 1989, SIAM J. Sci. Comput..

[24]  Gerald G. Brown,et al.  A Two-Sided Optimization for Theater Ballistic Missile Defense , 2005, Oper. Res..

[25]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[26]  Zhongping Wan,et al.  A hybrid intelligent algorithm by combining particle swarm optimization with chaos searching technique for solving nonlinear bilevel programming problems , 2013, Swarm Evol. Comput..

[27]  G. Anandalingam,et al.  Genetic algorithm based approach to bi-level linear programming , 1994 .

[28]  Helio J. C. Barbosa,et al.  A study on the use of heuristics to solve a bilevel programming problem , 2015, Int. Trans. Oper. Res..

[29]  Arthur W. Westerberg,et al.  Bilevel programming for steady-state chemical process design—I. Fundamentals and algorithms , 1990 .

[30]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[31]  Jonathan F. Bard,et al.  Algorithms for nonlinear bilevel mathematical programs , 1991, IEEE Trans. Syst. Man Cybern..

[32]  Miles G. Nicholls,et al.  Aluminum Production Modeling - A Nonlinear Bilevel Programming Approach , 1995, Oper. Res..

[33]  Yuping Wang,et al.  A New Evolutionary Algorithm for a Class of Nonlinear Bilevel Programming Problems and Its Global Convergence , 2011, INFORMS J. Comput..

[34]  Wayne F. Bialas,et al.  Two-Level Linear Programming , 1984 .

[35]  Yafeng Yin,et al.  Genetic-Algorithms-Based Approach for Bilevel Programming Models , 2000 .

[36]  Xianjia Wang,et al.  A Hybrid Differential Evolution Algorithm for Solving Nonlinear Bilevel Programming with Linear Constraints , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[37]  José Fortuny-Amat,et al.  A Representation and Economic Interpretation of a Two-Level Programming Problem , 1981 .

[38]  Ichiro Nishizaki,et al.  Interactive fuzzy programming for decentralized two-level linear programming problems , 2002, Fuzzy Sets Syst..

[39]  Kalyanmoy Deb,et al.  Solving Bilevel Multicriterion Optimization Problems With Lower Level Decision Uncertainty , 2016, IEEE Transactions on Evolutionary Computation.

[40]  Gao Zi-You,et al.  A bi-level programming model and solution algorithm for the location of logistics distribution centers , 2008 .

[41]  Yew-Soon Ong,et al.  An evolutionary algorithm with adaptive scalarization for multiobjective bilevel programs , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[42]  Kalyanmoy Deb,et al.  Multi-objective Stackelberg game between a regulating authority and a mining company: A case study in environmental economics , 2013, 2013 IEEE Congress on Evolutionary Computation.

[43]  Young-Jou Lai,et al.  Hierarchical optimization: A satisfactory solution , 1996, Fuzzy Sets Syst..

[44]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[45]  Takeshi Uno,et al.  An evolutionary multi-agent based search method for stackelberg solutions of bilevel facility location problems , 2008 .

[46]  Jerome Bracken,et al.  Mathematical Programs with Optimization Problems in the Constraints , 1973, Oper. Res..

[47]  Jonathan F. Bard,et al.  Coordination of a multidivisional organization through two levels of management , 1983 .

[48]  Shi Feng Bi-level Simulated Annealing Algorithm for Facility Location , 2007 .

[49]  Xinping Shi,et al.  Model and interactive algorithm of bi-level multi-objective decision-making with multiple interconnected decision makers , 2001 .

[50]  Xiangyong Li,et al.  A Hierarchical Particle Swarm Optimization for Solving Bilevel Programming Problems , 2006, ICAISC.

[51]  M. Florian,et al.  ON THE GEOMETRIC STRUCTURE OF LINEAR BILEVEL PROGRAMS: A DUAL APPROACH , 1992 .

[52]  Yuping Wang,et al.  A Hybrid Genetic Algorithm for Solving Nonlinear Bilevel Programming Problems Based on the Simplex Method , 2007, Third International Conference on Natural Computation (ICNC 2007).

[53]  Kalyanmoy Deb,et al.  An improved bilevel evolutionary algorithm based on Quadratic Approximations , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[54]  Mohammad Mehdi Sepehri,et al.  Linear bilevel programming solution by genetic algorithm , 2002, Comput. Oper. Res..

[55]  Yan Jiang,et al.  Application of particle swarm optimization based on CHKS smoothing function for solving nonlinear bilevel programming problem , 2013, Appl. Math. Comput..

[56]  L. N. Vicente,et al.  Descent approaches for quadratic bilevel programming , 1994 .

[57]  P. Marcotte,et al.  A bilevel model of taxation and its application to optimal highway pricing , 1996 .

[58]  Kalyanmoy Deb,et al.  Transportation policy formulation as a multi-objective bilevel optimization problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[59]  Omar Ben-Ayed,et al.  Bilevel linear programming , 1993, Comput. Oper. Res..

[60]  P. K. Kannan,et al.  Retail Channel Structure Impact on Strategic Engineering Product Design , 2011, Manag. Sci..

[61]  Michael Ulbrich,et al.  Imitating human reaching motions using physically inspired optimization principles , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[62]  Kalyanmoy Deb,et al.  Handling decision variable uncertainty in bilevel optimization problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[63]  Kalyanmoy Deb,et al.  Constructing test problems for bilevel evolutionary multi-objective optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[64]  Lawrence M. Wein,et al.  OR Forum - Homeland Security: From Mathematical Models to Policy Implementation: The 2008 Philip McCord Morse Lecture , 2009, Oper. Res..

[65]  Peter Värbrand,et al.  A global optimization approach for the linear two-level program , 1993, J. Glob. Optim..

[66]  Ankur Sinha,et al.  Bilevel Multi-objective Optimization Problem Solving Using Progressively Interactive EMO , 2011, EMO.

[67]  Daniel Ralph,et al.  Using EPECs to Model Bilevel Games in Restructured Electricity Markets with Locational Prices , 2007, Oper. Res..

[68]  Panos M. Pardalos,et al.  Global optimization of concave functions subject to quadratic constraints: An application in nonlinear bilevel programming , 1992, Ann. Oper. Res..