Generalized Differential Evolution for Numerical and Evolutionary Optimization

This chapter is about Generalized Differential Evolution (GDE), which is a general purpose optimizer for global nonlinear optimization. It is based on Differential Evolution (DE), which has been gaining popularity because of its simplicity and good observed performance. GDE extends DE for problems with several objectives and constraints. The chapter concentrates on describing different development phases and performance of GDE but it also contains a brief listing of other multi-objective DE approaches. Ability to solve multi-objective problems is mainly discussed, but constraint handling and the effect of control parameters are also covered. It is found that the latest GDE version is effective and efficient for solving constrained multi-objective problems having different types of decision variables.

[1]  Carlos Segura,et al.  Gradient subspace approximation: a direct search method for memetic computing , 2017, Soft Comput..

[2]  Arthur C. Sanderson,et al.  Pareto-based multi-objective differential evolution , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[3]  R. Salomon.  Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[4]  C. S. Chang,et al.  Differential evolution based tuning of fuzzy automatic train operation for mass rapid transit system , 2000 .

[5]  Millie Pant,et al.  An efficient Differential Evolution based algorithm for solving multi-objective optimization problems , 2011, Eur. J. Oper. Res..

[6]  Feng-Sheng Wang,et al.  Hybrid differential evolution with multiplier updating method for nonlinear constrained optimization problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[7]  Gade Pandu Rangaiah,et al.  An improved multi-objective differential evolution with a termination criterion for optimizing chemical processes , 2013, Comput. Chem. Eng..

[8]  Jouni Lampinen,et al.  Constrained Real-Parameter Optimization with Generalized Differential Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Carlos A. Coello Coello,et al.  Multi-objective Optimization Using Differential Evolution: A Survey of the State-of-the-Art , 2008 .

[10]  H. B. Quek,et al.  Pareto-optimal set based multiobjective tuning of fuzzy automatic train operation for mass transit system , 1999 .

[11]  Kalyanmoy Deb,et al.  Improved Pruning of Non-Dominated Solutions Based on Crowding Distance for Bi-Objective Optimization Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[12]  Jouni Lampinen,et al.  COMPARISON OF GENERALIZED DIFFERENTIAL EVOLUTION TO OTHER MULTI-OBJECTIVE EVOLUTIONARY ALGORITHMS , 2004 .

[13]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[14]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[15]  Carlos A. Coello Coello,et al.  A new proposal for multi-objective optimization using differential evolution and rough sets theory , 2006, GECCO '06.

[16]  Xin Yao,et al.  How well do multi-objective evolutionary algorithms scale to large problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[17]  Kiyoharu Tagawa,et al.  Multi-objective optimum design of balanced SAW filters using generalized differential evolution , 2009 .

[18]  D. Fogel.  Evolutionary algorithms in theory and practice , 1997, Complex..

[19]  Jouni Lampinen,et al.  A Comparison of Differential Evolution and Generalized Generation Gap Model , 2005, J. Adv. Comput. Intell. Intell. Informatics.

[20]  Carlos A. Coello Coello,et al.  An Algorithm Based on Differential Evolution for Multi-Objective Problems , 2005 .

[21]  Oriane M. Neto,et al.  Using differential evolution for combinatorial optimization: A general approach , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[22]  Jouni Lampinen,et al.  DE’s Selection Rule for Multiobjective Optimization , 2001 .

[23]  Jouni Lampinen,et al.  An Empirical Study of Control Parameters for The Third Version of Generalized Differential Evolution (GDE3) , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[24]  Nicola Beume,et al.  An EMO Algorithm Using the Hypervolume Measure as Selection Criterion , 2005, EMO.

[25]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[26]  José M. Chaves-González,et al.  DNA strand generation for DNA computing by using a multi-objective differential evolution algorithm , 2014, Biosyst..

[27]  Saúl Zapotecas Martínez,et al.  Geometric Differential Evolution in MOEA/D: A Preliminary Study , 2015, MICAI.

[28]  Mark D. Johnston,et al.  Multi-Objective Scheduling for Space Science Missions , 2011, J. Adv. Comput. Intell. Intell. Informatics.

[29]  Kiyoshi Tanaka,et al.  Comparison of Parameter Control Mechanisms in Multi-objective Differential Evolution , 2015, LION.

[30]  Rainer Laur,et al.  Variants of Differential Evolution for Multi-Objective Optimization , 2007, 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making.

[31]  John N. Sahalos,et al.  Pareto Optimal Yagi-Uda Antenna Design Using Multi-Objective Differential Evolution , 2010 .

[32]  Jouni Lampinen,et al.  Mechanical Component Design for Multiple Objectives Using Generalized Differential Evolution , 2004 .

[33]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[34]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[35]  Nirupam Chakraborti,et al.  Solving the Molecular Sequence Alignment Problem with Generalized Differential Evolution 3 (GDE3) , 2007, 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making.

[36]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[37]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[38]  Kay Chen Tan,et al.  An Opposition-based Self-adaptive Hybridized Differential Evolution Algorithm for Multi-objective Optimization (OSADE) , 2015 .

[39]  Mikkel T. Jensen,et al.  Reducing the run-time complexity of multiobjective EAs: The NSGA-II and other algorithms , 2003, IEEE Trans. Evol. Comput..

[40]  Carlos A. Coello Coello,et al.  Applying exponential weighting moving average control parameter adaptation technique with generalized differential evolution , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[41]  Mehmet Fatih Tasgetiren,et al.  An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem , 2010, Appl. Math. Comput..

[42]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[43]  Jing J. Liang,et al.  Problem Definitions for Performance Assessment of Multi-objective Optimization Algorithms , 2007 .

[44]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[45]  B. Babu,et al.  Differential evolution for multi-objective optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[46]  Tea Tusar,et al.  Differential Evolution versus Genetic Algorithms in Multiobjective Optimization , 2007, EMO.

[47]  Jouni Lampinen,et al.  Performance assessment of Generalized Differential Evolution 3 with a given set of constrained multi-objective test problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[48]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[49]  Ivan Zelinka,et al.  Mechanical engineering design optimization by differential evolution , 1999 .

[50]  Julian Togelius,et al.  Geometric Differential Evolution for Combinatorial and Programs Spaces , 2013, Evolutionary Computation.

[51]  J. Lampinen.  A constraint handling approach for the differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[52]  Jouni Lampinen,et al.  Ranking-Dominance and Many-Objective Optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[53]  Joshua D. Knowles.  Local-search and hybrid evolutionary algorithms for Pareto optimization , 2002 .

[54]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[55]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[56]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[57]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[58]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[59]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[60]  Jun Zhang,et al.  Adaptive multi-objective differential evolution with stochastic coding strategy , 2011, GECCO '11.

[61]  Qingfu Zhang,et al.  A Multiobjective Differential Evolution Based on Decomposition for Multiobjective Optimization with Variable Linkages , 2006, PPSN.

[62]  Hussein A. Abbass,et al.  The Pareto Differential Evolution Algorithm , 2002, Int. J. Artif. Intell. Tools.

[63]  Kiyoharu Tagawa,et al.  Optimum Design of Balanced SAW Filters Using Multi-Objective Differential Evolution , 2010, SEAL.

[64]  Wenyin Gong,et al.  A Novel Differential Evolution Algorithm Based on epsilon -Domination and Orthogonal Design Method for Multiobjective Optimization , 2007, EMO.

[65]  Yingwu Chen,et al.  Reconfiguration of satellite orbit for cooperative observation using variable-size multi-objective differential evolution , 2015, Eur. J. Oper. Res..

[66]  Kalyanmoy Deb,et al.  A Fast and Effective Method for Pruning of Non-dominated Solutions in Many-Objective Problems , 2006, PPSN.

[67]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[68]  Saku Kukkonen,et al.  Generalized Differential Evolution for Global Multi-Objective Optimization with Constraints , 2012 .

[69]  Enrique Alba,et al.  Using multi-objective metaheuristics to solve the software project scheduling problem , 2011, GECCO '11.

[70]  Paul Bergey.  An Agent Enhanced Spreadsheet Solver for Multi-Criteria Decision Making , 1999 .

[71]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[72]  Sotirios K Goudos,et al.  Pareto Optimal Microwave Filter Design Using Multiobjective Differential Evolution , 2010, IEEE Transactions on Antennas and Propagation.

[73]  H. Abbass.  The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[74]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[75]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..

[76]  Dimitris K. Tasoulis,et al.  Vector evaluated differential evolution for multiobjective optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[77]  Hong-Chan Chang,et al.  Application of differential evolution to passive shunt harmonic filter planning , 1998, 8th International Conference on Harmonics and Quality of Power. Proceedings (Cat. No.98EX227).

[78]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[79]  Bogdan Filipic,et al.  DEMO: Differential Evolution for Multiobjective Optimization , 2005, EMO.

[80]  Mark D. Johnston.  Multi-Objective Scheduling for NASA’s Future Deep Space Network Array , 2006 .

[81]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[82]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[83]  Xiaodong Li,et al.  Incorporating directional information within a differential evolution algorithm for multi-objective optimization , 2006, GECCO.

[84]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[85]  Saku Kukkonen,et al.  An Empirical Study of Control Parameters for Generalized Differential Evolution , 2022 .

[86]  Peter Dueholm Justesen,et al.  Multiobjective Distinct Candidates Optimization (MODCO): A Cluster-Forming Differential Evolution Algorithm , 2009, EMO.

[87]  Feng-Sheng Wang,et al.  Multiobjective parameter estimation problems of fermentation processes using a high ethanol tolerance yeast , 2000 .

[88]  K..  Multiobjective Optimization Using a Pareto Differential Evolution Approach , 2022 .

[89]  Carlos A. Coello Coello,et al.  MODE-LD+SS: A novel Differential Evolution algorithm incorporating local dominance and scalar selection mechanisms for multi-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[90]  Jouni Lampinen,et al.  An Extension of Generalized Differential Evolution for Multi-objective Optimization with Constraints , 2004, PPSN.

[91]  Efrén Mezura-Montes,et al.  Differential evolution in constrained numerical optimization: An empirical study , 2010, Inf. Sci..

[92]  Lei Peng,et al.  A Novel Opposition-Based Multi-objective Differential Evolution Algorithm for Multi-objective Optimization , 2008, ISICA.

[93]  Jouni Lampinen,et al.  Performance assessment of Generalized Differential Evolution 3 (GDE3) with a given set of problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[94]  Rainer Storn,et al.  System design by constraint adaptation and differential evolution , 1999, IEEE Trans. Evol. Comput..

[95]  Kalyanmoy Deb,et al.  Multi-objective test problems, linkages, and evolutionary methodologies , 2006, GECCO.