An improved bilevel evolutionary algorithm based on Quadratic Approximations

In this paper, we provide an improved evolutionary algorithm for bilevel optimization. It is an extension of a recently proposed Bilevel Evolutionary Algorithm based on Quadratic Approximations (BLEAQ). Bilevel optimization problems are known to be difficult and computationally demanding. The recently proposed BLEAQ approach has been able to bring down the computational expense significantly as compared to the contemporary approaches. The strategy proposed in this paper further improves the algorithm by incorporating archiving and local search. Archiving is used to store the feasible members produced during the course of the algorithm that provide a larger pool of members for better quadratic approximations of optimal lower level solutions. Frequent local searches at upper level supported by the quadratic approximations help in faster convergence of the algorithm. The improved results have been demonstrated on two different sets of test problems, and comparison results against the contemporary approaches are also provided.

[1]  Bo An,et al.  A Deployed Quantal Response-Based Patrol Planning System for the U.S. Coast Guard , 2013, Interfaces.

[2]  Jane J. Ye,et al.  Optimality conditions for bilevel programming problems , 1995 .

[3]  Yuping Wang,et al.  A New Evolutionary Algorithm for a Class of Nonlinear Bilevel Programming Problems and Its Global Convergence , 2011, INFORMS J. Comput..

[4]  Helio J. C. Barbosa,et al.  Differential evolution for bilevel programming , 2013, 2013 IEEE Congress on Evolutionary Computation.

[5]  Jonathan F. Bard,et al.  An explicit solution to the multi-level programming problem , 1982, Comput. Oper. Res..

[6]  Hecheng Li,et al.  An Evolutionary Algorithm with Local Search for Convex Quadratic Bilevel Programming Problems , 2011 .

[7]  Lucio Bianco,et al.  A Bilevel flow model for HazMat transportation network design , 2008 .

[8]  Yuping Wang,et al.  A Genetic Algorithm for Solving a Special Class of Nonlinear Bilevel Programming Problems , 2007, International Conference on Conceptual Structures.

[9]  Kalyanmoy Deb,et al.  Finding optimal strategies in a multi-period multi-leader-follower Stackelberg game using an evolutionary algorithm , 2013, Comput. Oper. Res..

[10]  J. Herskovits,et al.  Contact shape optimization: a bilevel programming approach , 2000 .

[11]  Heinrich von Stackelberg,et al.  Stackelberg (Heinrich von) - The Theory of the Market Economy, translated from the German and with an introduction by Alan T. PEACOCK. , 1953 .

[12]  M. Patriksson,et al.  Stochastic bilevel programming in structural optimization , 2001 .

[13]  Jerome Bracken,et al.  Mathematical Programs with Optimization Problems in the Constraints , 1973, Oper. Res..

[14]  E. Polak,et al.  An Outer Approximations Approach to Reliability-Based Optimal Design of Structures , 1998 .

[15]  Lawrence M. Wein,et al.  OR Forum - Homeland Security: From Mathematical Models to Policy Implementation: The 2008 Philip McCord Morse Lecture , 2009, Oper. Res..

[16]  Kalyanmoy Deb,et al.  Towards Understanding Evolutionary Bilevel Multi-Objective Optimization Algorithm , 2009 .

[17]  Gerald G. Brown,et al.  Interdicting a Nuclear-Weapons Project , 2009, Oper. Res..

[18]  S. Dempe.  Annotated Bibliography on Bilevel Programming and Mathematical Programs with Equilibrium Constraints , 2003 .

[19]  M. Dufwenberg.  Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[20]  Arnaud Liefooghe,et al.  CoBRA: A cooperative coevolutionary algorithm for bi-level optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[21]  Mahyar A. Amouzegar.  A global optimization method for nonlinear bilevel programming problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Eitaro Aiyoshi,et al.  HIERARCHICAL DECENTRALIZED SYSTEM AND ITS NEW SOLUTION BY A BARRIER METHOD. , 1980 .

[23]  George B.Richardson.  The Theory of the Market Economy , 1995 .

[24]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[25]  Patrice Marcotte,et al.  An overview of bilevel optimization , 2007, Ann. Oper. Res..

[26]  Jonathan F. Bard,et al.  Coordination of a multidivisional organization through two levels of management , 1983 .

[27]  Baoding Liu,et al.  Stackelberg-Nash equilibrium for multilevel programming with multiple followers using genetic algorithms , 1998 .

[28]  Kalyanmoy Deb,et al.  Test Problem Construction for Single-Objective Bilevel Optimization , 2014, Evolutionary Computation.

[29]  Yuping Wang,et al.  An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint-handling scheme , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[30]  E. Aiyoshi,et al.  A solution method for the static constrained Stackelberg problem via penalty method , 1984 .

[31]  Tiesong Hu,et al.  An Improved Particle Swarm Optimization for Solving Bilevel Multiobjective Programming Problem , 2012, J. Appl. Math..

[32]  James K. Lowe,et al.  Homeland Security: Operations Research Initiatives and Applications , 2006, Interfaces.

[33]  William R. Smith,et al.  Chemical Reaction Equilibrium Analysis: Theory and Algorithms , 1982 .

[34]  Yuping Wang,et al.  A Hybrid Genetic Algorithm for Solving Nonlinear Bilevel Programming Problems Based on the Simplex Method , 2007, Third International Conference on Natural Computation (ICNC 2007).

[35]  Michael Florian,et al.  Optimizing frequencies in a transit network: a nonlinear bi-level programming approach , 1995 .

[36]  Gao Zi-You,et al.  A bi-level programming model and solution algorithm for the location of logistics distribution centers , 2008 .

[37]  Rajkumar Roy,et al.  Bi-level optimisation using genetic algorithm , 2002, Proceedings 2002 IEEE International Conference on Artificial Intelligence Systems (ICAIS 2002).

[38]  Paul H. Calamai,et al.  Bilevel and multilevel programming: A bibliography review , 1994, J. Glob. Optim..

[39]  Kalyanmoy Deb,et al.  Multi-objective Stackelberg game between a regulating authority and a mining company: A case study in environmental economics , 2013, 2013 IEEE Congress on Evolutionary Computation.

[40]  Kaisa Miettinen,et al.  Constructing evolutionary algorithms for bilevel multiobjective optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[41]  B Liu.  STACKELBERG-NASH EQUILBRIUM FOR MULTI-LEVEL PROGRAMMING WITH MULTI-FOLLOWS USING GENETIC ALGORITHMS , 1998 .

[42]  Martine Labbé,et al.  A Bilevel Model for Toll Optimization on a Multicommodity Transportation Network , 2000, Transp. Sci..

[43]  Xinping Shi,et al.  Model and interactive algorithm of bi-level multi-objective decision-making with multiple interconnected decision makers , 2001 .

[44]  Sanaz Mostaghim,et al.  Bilevel Optimization of Multi-Component Chemical Systems Using Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[45]  Yafeng Yin,et al.  Genetic-Algorithms-Based Approach for Bilevel Programming Models , 2000 .

[46]  Jonathan F. Bard,et al.  Practical Bilevel Optimization , 1998 .

[47]  Kalyanmoy Deb,et al.  Unconstrained scalable test problems for single-objective bilevel optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[48]  Stephan Dempe,et al.  Foundations of Bilevel Programming , 2002 .

[49]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[50]  Kalyanmoy Deb,et al.  An Efficient and Accurate Solution Methodology for Bilevel Multi-Objective Programming Problems Using a Hybrid Evolutionary-Local-Search Algorithm , 2010, Evolutionary Computation.

[51]  Jirí Vladimír Outrata,et al.  On the numerical solution of a class of Stackelberg problems , 1990, ZOR Methods Model. Oper. Res..

[52]  Jonathan F. Bard,et al.  Practical Bilevel Optimization: Algorithms and Applications , 1998 .

[53]  J. Periaux,et al.  Multi-point optimization using GAs and Nash/Stackelberg games for high lift multi-airfoil design in aerodynamics , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[54]  K. Deb,et al.  An Evolutionary Approach for Bilevel Multi-objective Problems , 2009 .

[55]  Gerald G. Brown,et al.  A Two-Sided Optimization for Theater Ballistic Missile Defense , 2005, Oper. Res..

[56]  E. Aiyoshi,et al.  A new computational method for Stackelberg and min-max problems by use of a penalty method , 1981 .

[57]  Martin P. Bendsøe,et al.  Optimization of Structural Topology, Shape, And Material , 1995 .

[58]  G. Anandalingam,et al.  Genetic algorithm based approach to bi-level linear programming , 1994 .

[59]  Zhongping Wan,et al.  Genetic algorithm based on simplex method for solving linear-quadratic bilevel programming problem , 2008, Comput. Math. Appl..