An Enhanced Memetic Algorithm for Single-Objective Bilevel Optimization Problems

Bilevel optimization, as the name reflects, deals with optimization at two interconnected hierarchical levels. The aim is to identify the optimum of an upper-level leader problem, subject to the optimality of a lower-level follower problem. Several problems from the domain of engineering, logistics, economics, and transportation have an inherent nested structure which requires them to be modeled as bilevel optimization problems. Increasing size and complexity of such problems has prompted active theoretical and practical interest in the design of efficient algorithms for bilevel optimization. Given the nested nature of bilevel problems, the computational effort (number of function evaluations) required to solve them is often quite high. In this article, we explore the use of a Memetic Algorithm (MA) to solve bilevel optimization problems. While MAs have been quite successful in solving single-level optimization problems, there have been relatively few studies exploring their potential for solving bilevel optimization problems. MAs essentially attempt to combine advantages of global and local search strategies to identify optimum solutions with low computational cost (function evaluations). The approach introduced in this article is a nested Bilevel Memetic Algorithm (BLMA). At both upper and lower levels, either a global or a local search method is used during different phases of the search. The performance of BLMA is presented on twenty-five standard test problems and two real-life applications. The results are compared with other established algorithms to demonstrate the efficacy of the proposed approach.

[1]  Tapabrata Ray,et al.  Performance of Infeasibility Empowered Memetic Algorithm (IEMA) on Engineering Design Problems , 2010, Australasian Conference on Artificial Intelligence.

[2]  Tetsuyuki Takahama,et al.  Constrained Optimization by the ε Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[3]  Y. Smeers,et al.  Bi-Level Game Approaches for Coordination of Generation and Transmission Expansion Planning Within a Market Environment , 2013, IEEE Transactions on Power Systems.

[4]  Kalyanmoy Deb,et al.  Test Problem Construction for Single-Objective Bilevel Optimization , 2014, Evolutionary Computation.

[5]  A. Koh A Metaheuristic Framework for Bi-level Programming Problems with Multi-disciplinary Applications , 2013 .

[6]  Xianjia Wang,et al.  An adaptive genetic algorithm for solving bilevel linear programming problem , 2007 .

[7]  Michel Gendreau,et al.  A hybrid Tabu-ascent algorithm for the linear Bilevel Programming Problem , 1996, J. Glob. Optim..

[8]  E. Aiyoshi,et al.  A solution method for the static constrained Stackelberg problem via penalty method , 1984 .

[9]  Kalyanmoy Deb,et al.  Solving Bilevel Multicriterion Optimization Problems With Lower Level Decision Uncertainty , 2016, IEEE Transactions on Evolutionary Computation.

[10]  Gao Zi-You,et al.  A bi-level programming model and solution algorithm for the location of logistics distribution centers , 2008 .

[11]  Hayri Önal,et al.  A modified simplex approach for solving bilevel linear programming problems , 1993 .

[12]  S. Dempe A simple algorithm for the-linear bilevel programming problem , 1987 .

[13]  Yew-Soon Ong,et al.  An evolutionary algorithm with adaptive scalarization for multiobjective bilevel programs , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[14]  Rajkumar Roy,et al.  Bi-level optimisation using genetic algorithm , 2002, Proceedings 2002 IEEE International Conference on Artificial Intelligence Systems (ICAIS 2002).

[15]  Kalyanmoy Deb,et al.  Multi-objective Stackelberg game between a regulating authority and a mining company: A case study in environmental economics , 2013, 2013 IEEE Congress on Evolutionary Computation.

[16]  Jane J. Ye Constraint Qualifications and KKT Conditions for Bilevel Programming Problems , 2006, Math. Oper. Res..

[17]  R. J. Kuo,et al.  Application of particle swarm optimization algorithm for solving bi-level linear programming problem , 2009, Comput. Math. Appl..

[18]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[19]  Patrice Marcotte,et al.  Exact and inexact penalty methods for the generalized bilevel programming problem , 1996, Math. Program..

[20]  J. Herskovits,et al.  Contact shape optimization: a bilevel programming approach , 2000 .

[21]  Danping Wang A Self Adaptive Penalty Function Based Genetic Algorithm for value-Bilevel Programming Problem , 2014 .

[22]  Jonathan F. BARD,et al.  Convex two-level optimization , 1988, Math. Program..

[23]  Xianjia Wang,et al.  A Hybrid Differential Evolution Algorithm for Solving Nonlinear Bilevel Programming with Linear Constraints , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[24]  Yuping Wang,et al.  An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint-handling scheme , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Kapil Gupta,et al.  A Tabu Search Based Approach for Solving a Class of Bilevel Programming Problems in Chemical Engineering , 2003, J. Heuristics.

[26]  Jorge Nocedal,et al.  A trust region method based on interior point techniques for nonlinear programming , 2000, Math. Program..

[27]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Jorge Nocedal,et al.  An Interior Point Algorithm for Large-Scale Nonlinear Programming , 1999, SIAM J. Optim..

[29]  Arnaud Liefooghe,et al.  CoBRA: A cooperative coevolutionary algorithm for bi-level optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[30]  L. N. Vicente,et al.  Descent approaches for quadratic bilevel programming , 1994 .

[31]  A. Ciric,et al.  A dual temperature simulated annealing approach for solving bilevel programming problems , 1998 .

[32]  Tapabrata Ray,et al.  A memetic algorithm for solving single objective bilevel optimization problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[33]  Manuel Laguna,et al.  Tabu Search , 1997 .

[34]  Patrice Marcotte,et al.  A Trust-Region Method for Nonlinear Bilevel Programming: Algorithm and Computational Experience , 2005, Comput. Optim. Appl..

[35]  Athanasios Migdalas,et al.  Bilevel programming in traffic planning: Models, methods and challenge , 1995, J. Glob. Optim..

[36]  E. Polak,et al.  An Outer Approximations Approach to Reliability-Based Optimal Design of Structures , 1998 .

[37]  Jiming Liu,et al.  On bilevel programming, Part I: General nonlinear cases , 1995, Math. Program..

[38]  Sanaz Mostaghim,et al.  Bilevel Optimization of Multi-Component Chemical Systems Using Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[39]  Kalyanmoy Deb,et al.  An improved bilevel evolutionary algorithm based on Quadratic Approximations , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[40]  Mohammad Mehdi Sepehri,et al.  Linear bilevel programming solution by genetic algorithm , 2002, Comput. Oper. Res..

[41]  Marianthi G. Ierapetritou,et al.  Resolution method for mixed integer bi-level linear problems based on decomposition technique , 2009, J. Glob. Optim..

[42]  D. White,et al.  A solution method for the linear static Stackelberg problem using penalty functions , 1990 .

[43]  Helio J. C. Barbosa,et al.  Differential evolution for bilevel programming , 2013, 2013 IEEE Congress on Evolutionary Computation.

[44]  André da Motta Salles Barreto,et al.  Using performance profiles to analyze the results of the 2006 CEC constrained optimization competition , 2010, IEEE Congress on Evolutionary Computation.

[45]  A. Conejo,et al.  A Bilevel Stochastic Programming Approach for Retailer Futures Market Trading , 2009, IEEE Transactions on Power Systems.

[46]  Jonathan F. Bard,et al.  An explicit solution to the multi-level programming problem , 1982, Comput. Oper. Res..

[47]  万仲平,et al.  An adaptive genetic algorithm for solving bilevel linear programming problem , 2007 .

[48]  L. Lasdon,et al.  Derivative evaluation and computational experience with large bilevel mathematical programs , 1990 .

[49]  Jonathan F. Bard,et al.  An Efficient Point Algorithm for a Linear Two-Stage Optimization Problem , 1983, Oper. Res..

[50]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[51]  Gilles Savard,et al.  The steepest descent direction for the nonlinear bilevel programming problem , 1990, Oper. Res. Lett..

[52]  Pierre Hansen,et al.  New Branch-and-Bound Rules for Linear Bilevel Programming , 1989, SIAM J. Sci. Comput..

[53]  G. Anandalingam,et al.  Genetic algorithm based approach to bi-level linear programming , 1994 .

[54]  Wilfred Candler,et al.  A linear two-level programming problem, , 1982, Comput. Oper. Res..

[55]  G. Anandalingam,et al.  A penalty function approach for solving bi-level linear programs , 1993, J. Glob. Optim..

[56]  Pablo Moscato,et al.  3 Memetic Algorithms , 2004 .

[57]  Kalyanmoy Deb,et al.  Efficient Evolutionary Algorithm for Single-Objective Bilevel Optimization , 2013, ArXiv.

[58]  Tiesong Hu,et al.  A penalty function method based on Kuhn-Tucker condition for solving linear bilevel programming , 2007, Appl. Math. Comput..

[59]  Jane J. Ye,et al.  New Necessary Optimality Conditions for Bilevel Programs by Combining the MPEC and Value Function Approaches , 2010, SIAM J. Optim..

[60]  Stephan Dempe,et al.  New Optimality Conditions for the Semivectorial Bilevel Optimization Problem , 2012, Journal of Optimization Theory and Applications.