A Novel Diversity-Based Replacement Strategy for Evolutionary Algorithms

Premature convergence is one of the best-known drawbacks that affects the performance of evolutionary algorithms. An alternative for dealing with this problem is to explicitly try to maintain proper diversity. In this paper, a new replacement strategy that preserves useful diversity is presented. The novelty of our method is that it combines the idea of transforming a single-objective problem into a multiobjective one, by considering diversity as an explicit objective, with the idea of adapting the balance induced between exploration and exploitation to the various optimization stages. Specifically, in the initial phases, larger amounts of diversity are accepted. The diversity measure considered in this paper is based on calculating distances to the closest surviving individual. Analyses with a multimodal function better justify the design decisions and provide greater insight into the working operation of the proposal. Computational results with a packing problem that was proposed in a popular contest illustrate the usefulness of the proposal. The new method significantly improves on the best results known to date for this problem and compares favorably against a large number of state-of-the-art schemes.

[1]  Riccardo Poli,et al.  Product Geometric Crossover , 2006, PPSN.

[2]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[3]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[4]  Ankit Chaudhary,et al.  A comparative review of approaches to prevent premature convergence in GA , 2014, Appl. Soft Comput..

[5]  Thomas Stützle,et al.  Automatically Improving the Anytime Behaviour of Multiobjective Evolutionary Algorithms , 2013, EMO.

[6]  Shiu Yin Yuen,et al.  A Genetic Algorithm That Adaptively Mutates and Never Revisits , 2009, IEEE Trans. Evol. Comput..

[7]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[8]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[9]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Pedro J. Ballester,et al.  An Effective Real-Parameter Genetic Algorithm with Parent Centric Normal Crossover for Multimodal Optimisation , 2004, GECCO.

[11]  Jean-Baptiste Mouret Novelty-Based Multiobjectivization , 2011 .

[12]  Carlos A. Coello Coello,et al.  A Study of Multiobjective Metaheuristics When Solving Parameter Scalable Problems , 2010, IEEE Transactions on Evolutionary Computation.

[13]  Sanyang Liu,et al.  A Cluster-Based Differential Evolution With Self-Adaptive Strategy for Multimodal Optimization , 2014, IEEE Transactions on Cybernetics.

[14]  Carlos A. Coello Coello,et al.  An analysis of the automatic adaptation of the crossover rate in differential evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[15]  Seng,et al.  Theory and Principled Methods for the Design of Metaheuristics , 2013 .

[16]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[17]  Hisao Ishibuchi,et al.  Diversity Improvement by Non-Geometric Binary Crossover in Evolutionary Multiobjective Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[18]  Eduardo Segredo,et al.  Fuzzy logic-controlled diversity-based multi-objective memetic algorithm applied to a frequency assignment problem , 2014, Eng. Appl. Artif. Intell..

[19]  Gara Miranda,et al.  A memetic algorithm and a parallel hyperheuristic island-based model for a 2D packing problem , 2009, GECCO.

[20]  Gara Miranda,et al.  Metco: a Parallel Plugin-Based Framework for Multi-Objective Optimization , 2009, Int. J. Artif. Intell. Tools.

[21]  V. K. Koumousis,et al.  A saw-tooth genetic algorithm combining the effects of variable population size and reinitialization to enhance performance , 2006, IEEE Transactions on Evolutionary Computation.

[22]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[23]  Samir W. Mahfoud Crowding and Preselection Revisited , 1992, PPSN.

[24]  Cláudio F. Lima,et al.  Adaptive Population Sizing Schemes in Genetic Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[25]  Byung Ro Moon,et al.  A hybrid genetic algorithm for a variant of two-dimensional packing problem , 2009, GECCO '09.

[26]  Kay Chen Tan,et al.  Adaptive Memetic Computing for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[27]  A. E. Eiben,et al.  On Evolutionary Exploration and Exploitation , 1998, Fundam. Informaticae.

[28]  Gara Miranda,et al.  Using multi-objective evolutionary algorithms for single-objective constrained and unconstrained optimization , 2016, Ann. Oper. Res..

[29]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[30]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[31]  Gara Miranda,et al.  Improving the diversity preservation of multi-objective approaches used for single-objective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[32]  Eduardo Segredo,et al.  Parallel island-based multiobjectivised memetic algorithms for a 2D packing problem , 2011, GECCO '11.

[33]  Francisco Herrera,et al.  Replacement strategies to preserve useful diversity in steady-state genetic algorithms , 2008, Inf. Sci..

[34]  Tzung-Pei Hong,et al.  Two-dimentional Encoding Schema and Genetic Operators , 2006, JCIS.

[35]  Michel Gendreau,et al.  A hybrid genetic algorithm with adaptive diversity management for a large class of vehicle routing problems with time-windows , 2013, Comput. Oper. Res..

[36]  Thomas Jansen,et al.  On the Analysis of Dynamic Restart Strategies for Evolutionary Algorithms , 2002, PPSN.

[37]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[38]  Yangmin Li,et al.  A Memetic Algorithm for Global Optimization of Multimodal Nonseparable Problems , 2016, IEEE Transactions on Cybernetics.

[39]  Hisao Ishibuchi,et al.  How to Choose Solutions for Local Search in Multiobjective Combinatorial Memetic Algorithms , 2010, PPSN.

[40]  Gara Miranda,et al.  Using multi-objective evolutionary algorithms for single-objective optimization , 2013, 4OR.

[41]  Maolin Tang,et al.  A Memetic Algorithm for the Location-Based Continuously Operating Reference Stations Placement Problem in Network Real-Time Kinematic , 2015, IEEE Transactions on Cybernetics.

[42]  Jun Chen,et al.  The Shifting Balance Genetic Algorithm as More than Just Another Island Model GA , 2004, GECCO.

[43]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[44]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[45]  Lothar Thiele,et al.  A Comparison of Selection Schemes Used in Evolutionary Algorithms , 1996, Evolutionary Computation.

[46]  Hussein A. Abbass,et al.  Multiobjective optimization for dynamic environments , 2005, 2005 IEEE Congress on Evolutionary Computation.

[47]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[48]  James P. Cohoon,et al.  C6.3 Island (migration) models: evolutionary algorithms based on punctuated equilibria , 1997 .

[49]  U Aickelin,et al.  Handbook of metaheuristics (International series in operations research and management science) , 2005 .

[50]  Ole J. Mengshoel,et al.  A Novel Mating Approach for Genetic Algorithms , 2013, Evolutionary Computation.

[51]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[52]  D. J. Cavicchio,et al.  Adaptive search using simulated evolution , 1970 .

[53]  Eduardo Segredo,et al.  Memetic algorithms and hyperheuristics applied to a multiobjectivised two-dimensional packing problem , 2014, J. Glob. Optim..

[54]  Francisco Herrera,et al.  Fuzzy adaptive genetic algorithms: design, taxonomy, and future directions , 2003, Soft Comput..

[55]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[56]  Yong Wang,et al.  MOMMOP: Multiobjective Optimization for Locating Multiple Optimal Solutions of Multimodal Optimization Problems , 2015, IEEE Transactions on Cybernetics.

[57]  Ole J. Mengshoel,et al.  Adaptive generalized crowding for genetic algorithms , 2014, Inf. Sci..

[58]  Zbigniew Michalewicz,et al.  Benchmarking Optimization Algorithms: An Open Source Framework for the Traveling Salesman Problem , 2014, IEEE Computational Intelligence Magazine.

[59]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[60]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[61]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .