Controlling Crossover in a Selection Hyper-heuristic Framework

In evolutionary algorithms, crossover is used to recombine two candidate solutions to yield a new solution which hopefully inherits good material from both. Hyper-heuristics are high-level search methodologies which operate on a search space of heuristics. Hyper-heuristics can be broadly split into two categories; heuristic selection and generation methodologies. Here we will investigate hyper-heuristics from the former category. Selection hyper-heuristics select a heuristic to apply from an existing set of low-level heuristics at a given point in the search. Crossover is increasingly being included in general purpose hyper-heuristic frameworks such as HyFlex and Hyperion however little work has been done to assess how best to utilise it. Since a single-point search hyper-heuristic operates on a single candidate solution and two candidate solutions are needed for crossover, a mechanism is required to control the choice of the other solution. We propose a framework which maintains a list of potential solutions for use in crossover. We investigate the control of such lists at two levels. Firstly, crossover is controlled at the hyper-heuristic level where no problem speci c information is required. Secondly, it is controlled at the problem domain level where problem speci c information is used to produce good quality solutions to use for crossover. A number of selection hyper-heuristics are tested over three well-known benchmark libraries for an NP-hard optimisation problem; the multidimensional 0-1 knapsack problem (MKP). Exact solvers such as CPLEX also use heuristics and have improved signi cantly since the last published application to some of the benchmark data. New results are presented using CPLEX 12.2 over the benchmark instances. *Corresponding author

[1]  Graham Kendall,et al.  A Classification of Hyper-heuristic Approaches , 2010 .

[2]  Graham Kendall,et al.  Hyper-Heuristics: An Emerging Direction in Modern Search Technology , 2003, Handbook of Metaheuristics.

[3]  Günther R. Raidl,et al.  Empirical Analysis of Locality, Heritability and Heuristic Bias in Evolutionary Algorithms: A Case Study for the Multidimensional Knapsack Problem , 2005, Evolutionary Computation.

[4]  Ender Özcan,et al.  A comprehensive analysis of hyper-heuristics , 2008, Intell. Data Anal..

[5]  Edmund K. Burke,et al.  A Reinforcement Learning - Great-Deluge Hyper-Heuristic for Examination Timetabling , 2010, Int. J. Appl. Metaheuristic Comput..

[6]  Carlos Cotta,et al.  A Hybrid Genetic Algorithm for the 0-1 Multiple Knapsack Problem , 1997, ICANNGA.

[7]  L. J. Savage,et al.  Three Problems in Rationing Capital , 1955 .

[8]  Graham Kendall,et al.  A Hyperheuristic Approach to Scheduling a Sales Summit , 2000, PATAT.

[9]  Thomas Bäck,et al.  The zero/one multiple knapsack problem and genetic algorithms , 1994, SAC '94.

[10]  Peter I. Cowling,et al.  Choosing the Fittest Subset of Low Level Heuristics in a Hyperheuristic Framework , 2005, EvoCOP.

[11]  Matthew R. Hyde A genetic programming hyper-heuristic approach to automated packing , 2010 .

[12]  Ender Özcan,et al.  An Experimental Study on Hyper-heuristics and Exam Timetabling , 2006, PATAT.

[13]  Matthias Fuchs,et al.  High Performance ATP Systems by Combining Several AI Methods , 1997, IJCAI.

[14]  Michael O'Neill,et al.  An Attribute Grammar Decoder for the 01 MultiConstrained Knapsack Problem , 2005, EvoCOP.

[15]  Clifford C. Petersen,et al.  Computational Experience with Variants of the Balas Algorithm Applied to the Selection of R&D Projects , 1967 .

[16]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[17]  Qian,et al.  Simulated Annealing for the 0/1 Multidimensional Knapsack Problem , 2007 .

[18]  Arnaud Fréville,et al.  An Efficient Preprocessing Procedure for the Multidimensional 0- 1 Knapsack Problem , 1994, Discret. Appl. Math..

[19]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[20]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[21]  Vittorio Maniezzo,et al.  Matheuristics: Hybridizing Metaheuristics and Mathematical Programming , 2009 .

[22]  Edmund K. Burke,et al.  Examination timetabling using late acceptance hyper-heuristics , 2009, 2009 IEEE Congress on Evolutionary Computation.

[23]  Ender Özcan,et al.  Hill Climbers and Mutational Heuristics in Hyperheuristics , 2006, PPSN.

[24]  Hasan Pirkul,et al.  A heuristic solution procedure for the multiconstraint zero‐one knapsack problem , 1987 .

[25]  E. Burke,et al.  A Late Acceptance Strategy in Hill-Climbing for Exam Timetabling Problems , 2008 .

[26]  John E. Beasley,et al.  A Genetic Algorithm for the Multidimensional Knapsack Problem , 1998, J. Heuristics.

[27]  Peter I. Cowling,et al.  Hyperheuristics: Recent Developments , 2008, Adaptive and Multilevel Metaheuristics.

[28]  H. Martin Weingartner,et al.  Methods for the Solution of the Multidimensional 0/1 Knapsack Problem , 1967, Operational Research.

[29]  Ender Özcan,et al.  A case study of memetic algorithms for constraint optimization , 2009, Soft Comput..

[30]  Graham Kendall,et al.  Hyperion - A Recursive Hyper-Heuristic Framework , 2011, LION.

[31]  Graham Kendall,et al.  Exploring Hyper-heuristic Methodologies with Genetic Programming , 2009 .

[32]  Michel Vasquez,et al.  Improved results on the 0-1 multidimensional knapsack problem , 2005, Eur. J. Oper. Res..

[33]  Andreas Drexl,et al.  A simulated annealing approach to the multiconstraint zero-one knapsack problem , 1988, Computing.

[34]  Heitor Silvério Lopes,et al.  Particle Swarm Optimization for the Multidimensional Knapsack Problem , 2007, ICANNGA.

[35]  P. Cowling,et al.  A Parameter-Free Hyperheuristic for Scheduling a Sales Summit , 2002 .

[36]  Günther R. Raidl,et al.  The Core Concept for the Multidimensional Knapsack Problem , 2006, EvoCOP.

[37]  KorkmazEmin Erkan,et al.  A comprehensive analysis of hyper-heuristics , 2008 .

[38]  Osman Oguz,et al.  A heuristic algorithm for the multidimensional zero-one knapsack problem , 1984 .

[39]  Günther R. Raidl,et al.  The Multidimensional Knapsack Problem: Structure and Algorithms , 2010, INFORMS J. Comput..

[40]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[41]  Egon Balas,et al.  An Algorithm for Large Zero-One Knapsack Problems , 1980, Oper. Res..

[42]  Carsten Peterson,et al.  Neural Networks for Optimization Problems with Inequality Constraints: The Knapsack Problem , 1993, Neural Computation.

[43]  Günther R. Raidl,et al.  Combining (Integer) Linear Programming Techniques and Metaheuristics for Combinatorial Optimization , 2008, Hybrid Metaheuristics.

[44]  Robert Hinterding,et al.  Mapping, order-independent genes and the knapsack problem , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[45]  Lakhmi C. Jain,et al.  Computational Intelligence: Collaboration, Fusion and Emergence , 2009 .

[46]  Alexander Nareyek,et al.  Choosing search heuristics by non-stationary reinforcement learning , 2004 .

[47]  Terry Jones,et al.  Crossover, Macromutationand, and Population-Based Search , 1995, ICGA.

[48]  Sanja Petrovic,et al.  A graph-based hyper-heuristic for educational timetabling problems , 2007, Eur. J. Oper. Res..

[49]  Jin-Kao Hao,et al.  A hybrid approach for the 0-1 multidimensional knapsack problem , 2001, IJCAI 2001.

[50]  G. Raidl,et al.  An improved genetic algorithm for the multiconstrained 0-1 knapsack problem , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[51]  Carlos Castro,et al.  Stable solving of CVRPs using hyperheuristics , 2009, GECCO '09.

[52]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[53]  Ernesto Costa,et al.  Multidimensional Knapsack Problem: A Fitness Landscape Analysis , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).