Performance evaluation of artificial bee colony optimization and new selection schemes

The artificial bee colony optimization (ABC) is a population-based algorithm for function optimization that is inspired by the foraging behavior of bees. The population consists of two types of artificial bees: employed bees (EBs) which scout for new, good solutions and onlooker bees (OBs) that search in the neighborhood of solutions found by the EBs. In this paper we study in detail the influence of ABC’s parameters on its optimization behavior. It is also investigated whether the use of OBs is always advantageous. Moreover, we propose two new variants of ABC which use new methods for the position update of the artificial bees. Extensive empirical tests were performed to compare the new variants with the standard ABC and several other metaheuristics on a set of benchmark functions. Our findings show that the ideal parameter values depend on the hardness of the optimization goal and that the standard values suggested in the literature should be applied with care. Moreover, it is shown that in some situations it is advantageous to use OBs but in others it is not. In addition, a potential problem of the ABC is identified, namely that it performs worse on many functions when the optimum is not located at the center of the search space. Finally it is shown that the new ABC variants improve the algorithm’s performance and achieve very good performance in comparison to other metaheuristics under standard as well as hard optimization goals.

[1]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[2]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[3]  Nancy Forbes,et al.  Imitation of Life: How Biology Is Inspiring Computing , 2004 .

[4]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Thomas D Seeley,et al.  Genetic Diversity in Honey Bee Colonies Enhances Productivity and Fitness , 2007, Science.

[6]  Hussein A. Abbass,et al.  MBO: marriage in honey bees optimization-a Haplometrosis polygynous swarming approach , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[7]  Dervis Karaboga,et al.  A survey: algorithms simulating bee swarm intelligence , 2009, Artificial Intelligence Review.

[8]  M. Beekman,et al.  Honeybee Optimisation – An Overview and a New Bee Inspired Optimisation Scheme , 2011 .

[9]  P. Lucic,et al.  Bee Colony Optimization: Principles and Applications , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.

[10]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Daniel Kudenko,et al.  Adaptive Agents and Multi-Agent Systems II: Adaptation and Multi-Agent Learning , 2003, Adaptive Agents and Multi-Agent Systems.

[12]  Max E. Valentinuzzi Handbook of bioinspired algorithms and applications , 2006, BioMedical Engineering OnLine.

[13]  Magdalene Marinaki,et al.  A Bumble Bees Mating Optimization Algorithm for Global Unconstrained Optimization Problems , 2010, NICSO.

[14]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[15]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[16]  E. M. Wright,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[17]  Christian Blum,et al.  Swarm Intelligence: Introduction and Applications , 2008, Swarm Intelligence.

[18]  Ali Karci Imitation of Bee Reproduction as a Crossover Operator in Genetic Algorithms , 2004, PRICAI.

[19]  Nurhan Karaboga,et al.  A new design method based on artificial bee colony algorithm for digital IIR filters , 2009, J. Frankl. Inst..

[20]  H A Abbass,et al.  MARRIAGE IN HONEY-BEE OPTIMIZATION (MBO): A HAPLOMETROSIS POLYGYNOUS SWARMING APPROACH , 2001 .

[21]  T. Huang,et al.  A hybrid boundary condition for robust particle swarm optimization , 2005, IEEE Antennas and Wireless Propagation Letters.

[22]  F. Ratnieks Honeybee Democracy Thomas D. Seeley Honeybee Democracy , 2011, Animal Behaviour.

[23]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[24]  A. Dornhaus,et al.  Benefits of recruitment in honey bees: effects of ecology and colony size in an individual-based model , 2006 .

[25]  D. Karaboga,et al.  Artificial Bee Colony (ABC) Algorithm on Training Artificial Neural Networks , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[26]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[27]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[28]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[29]  Dervis Karaboga,et al.  Parameter Tuning for the Artificial Bee Colony Algorithm , 2009, ICCCI.

[30]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[31]  Masafumi Hagiwara,et al.  Bee System: finding solution by a concentrated search , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[32]  Oliver Kramer,et al.  Iterated local search with Powell’s method: a memetic algorithm for continuous global optimization , 2010, Memetic Comput..

[33]  Manoj Kumar Tiwari,et al.  Swarm Intelligence, Focus on Ant and Particle Swarm Optimization , 2007 .

[34]  M. Powell The BOBYQA algorithm for bound constrained optimization without derivatives , 2009 .

[35]  Thomas Schmickl,et al.  Trophallaxis within a robotic swarm: bio-inspired communication among robots in a swarm , 2008, Auton. Robots.

[36]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Training Feed-Forward Neural Networks , 2007, MDAI.

[37]  Ann Nowé,et al.  Bee Behaviour in Multi-agent Systems , 2007, Adaptive Agents and Multi-Agents Systems.

[38]  Rosni Abdullah,et al.  Protein Tertiary Structure Prediction Using Artificial Bee Colony Algorithm , 2009, 2009 Third Asia International Conference on Modelling & Simulation.

[39]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems , 2007, IFSA.

[40]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[41]  J. Biesmeijer,et al.  Exploration and exploitation of food sources by social insect colonies: a revision of the scout-recruit concept , 2001, Behavioral Ecology and Sociobiology.

[42]  Gary B. Fogel,et al.  Noisy optimization problems - a particular challenge for differential evolution? , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[43]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[44]  Martin Middendorf,et al.  Bee Nest Site Selection as an Optimization Process , 2010, ALIFE.

[45]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[46]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[47]  Lale Özbakır,et al.  Artificial Bee Colony Algorithm and Its Application to Generalized Assignment Problem , 2007 .