A switched parameter differential evolution with optional blending crossover for scalable numerical optimization

Abstract Differential Evolution (DE) is currently one of the most competitive Evolutionary Algorithms (EAs) for optimization problems involving continuous parameters. This article presents three very simple modifications to the basic DE scheme such that its performance can be improved and made scalable for optimizing functions having a real-valued moderate-to-high number of variables (dimensions) while focusing on preservation of the simplicity offered by its algorithmic framework. Contrary to the common policies of coupling a complicated scheme for adaptation of the control parameters or introducing additional local search algorithms, we present here a (population member and generation specific) control parameter choosing strategy which uniformly and randomly switches the values of the mutational scale factor and crossover rate between two extremities of their feasible ranges. Furthermore, each population member is mutated either by using the DE/rand/1 scheme or a proposed version of the DE/current-to-best scheme. The mutation scheme for a population member is chosen based on its performance in the current generation. Hence if a mutation strategy successfully replaces a target vector by the corresponding trial vector, then it is reused by the population member of the same index in the following generation, else a switch of mutation method is executed. In the crossover phase, each member undergoes either the common binomial crossover or the BLX-α-β crossover modified for applying in DE, with equal probabilities. Our experiments using the benchmark optimization functions proposed for the IEEE Congress on Evolutionary Computation (CEC) 2013 competition on real parameter optimization and CEC 2010 competition on large-scale global optimization demonstrate that the basic DE optimizer when coupled with these elementary alterations and/or schemes can indeed provide a very competitive result against some of the most prominent state-of-the-art algorithms.

[1]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Zhijian Wu,et al.  Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems , 2011, Soft Comput..

[3]  Wenyin Gong,et al.  Adaptive Parameter Selection for Strategy Adaptation in Differential Evolution for Continuous Optimization , 2012, J. Comput..

[4]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[5]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[6]  Jurij Silc,et al.  The Differential Ant-Stigmergy Algorithm for Large Scale Real-Parameter Optimization , 2008, ANTS Conference.

[7]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[8]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[10]  Gülay Tezel,et al.  Artificial algae algorithm with multi-light source for numerical optimization and applications , 2015, Biosyst..

[11]  Tapabrata Ray,et al.  Differential Evolution With Dynamic Parameters Selection for Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[12]  Jing Hu,et al.  A Diversity-Guided Particle Swarm Optimizer for Dynamic Environments , 2007, LSMS.

[13]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[14]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[15]  Rammohan Mallipeddi Harmony Search Based Parameter Ensemble Adaptation for Differential Evolution , 2013, J. Appl. Math..

[16]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[17]  Amer Draa,et al.  A sinusoidal differential evolution algorithm for numerical optimisation , 2015, Appl. Soft Comput..

[18]  Michèle Sebag,et al.  Alternative Restart Strategies for CMA-ES , 2012, PPSN.

[19]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[20]  Raymond Ros,et al.  A Simple Modification in CMA-ES Achieving Linear Time and Space Complexity , 2008, PPSN.

[21]  Ville Tirronen,et al.  Shuffle or update parallel differential evolution for large-scale optimization , 2011, Soft Comput..

[22]  Yaochu Jin,et al.  Optimization of micro heat exchanger: CFD, analytical approach and multi-objective evolutionary algorithms , 2006 .

[23]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[24]  Konstantinos E. Parsopoulos,et al.  Cooperative micro-differential evolution for high-dimensional problems , 2009, GECCO.

[25]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[26]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[27]  Nikolaus Hansen,et al.  Benchmarking a BI-population CMA-ES on the BBOB-2009 function testbed , 2009, GECCO '09.

[28]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[29]  Jingming Yang,et al.  A differential evolution algorithm with self-adaptive strategy and control parameters based on symmetric Latin hypercube design for unconstrained optimization problems , 2016, Eur. J. Oper. Res..

[30]  Janez Brest,et al.  Large scale global optimization using self-adaptive differential evolution algorithm , 2010, IEEE Congress on Evolutionary Computation.

[31]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[32]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[33]  G. Jeyakumar,et al.  Control parameter adaptation strategies for mutation and crossover rates of differential evolution algorithm - An insight , 2015, 2015 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC).

[34]  Nikolaus Hansen,et al.  On the Adaptation of Arbitrary Normal Mutation Distributions in Evolution Strategies: The Generating Set Adaptation , 1995, ICGA.

[35]  Janez Brest,et al.  Self-adaptive differential evolution algorithm using population size reduction and three strategies , 2011, Soft Comput..

[36]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[37]  Domagoj Jakobovic,et al.  From fitness landscape to crossover operator choice , 2014, GECCO.

[38]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[39]  Tapabrata Ray,et al.  Differential evolution with automatic parameter configuration for solving the CEC2013 competition on Real-Parameter Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[40]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[41]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[42]  Shahryar Rahnamayan,et al.  Metaheuristics in large-scale global continues optimization: A survey , 2015, Inf. Sci..

[43]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[44]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[45]  Chao Wang,et al.  High-Dimensional Waveform Inversion With Cooperative Coevolutionary Differential Evolution Algorithm , 2012, IEEE Geoscience and Remote Sensing Letters.

[46]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[47]  Raymond Ros,et al.  Benchmarking a weighted negative covariance matrix update on the BBOB-2010 noiseless testbed , 2010, GECCO '10.

[48]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[49]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[50]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[51]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[52]  William M. Spears,et al.  Adapting Crossover in Evolutionary Algorithms , 1995, Evolutionary Programming.

[53]  Bin Li,et al.  Two-stage based ensemble optimization for large-scale global optimization , 2010, IEEE Congress on Evolutionary Computation.

[54]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[55]  Bernhard Sendhoff,et al.  Advanced High Turning Compressor Airfoils for Low Reynolds Number Condition: Part 1 — Design and Optimization , 2003 .

[56]  Zhijian Wu,et al.  Sequential DE enhanced by neighborhood search for Large Scale Global Optimization , 2010, IEEE Congress on Evolutionary Computation.

[57]  Sankha Subhra Mullick,et al.  A Switched Parameter Differential Evolution for Large Scale Global Optimization - Simpler May Be Better , 2015, MENDEL.

[58]  Marin Golub,et al.  On the recombination operator in the real-coded genetic algorithms , 2013, 2013 IEEE Congress on Evolutionary Computation.

[59]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[60]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[61]  Ruhul A. Sarker,et al.  Differential evolution with multiple strategies for solving CEC2011 real-world numerical optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[62]  Adam Kiczko,et al.  Differential Evolution algorithm with Separated Groups for multi-dimensional optimization problems , 2012, Eur. J. Oper. Res..

[63]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.