Applying exponential weighting moving average control parameter adaptation technique with generalized differential evolution

In this paper, an Exponential Weighting Moving Average (EWMA) control parameter adaptation technique is tested with Generalized Differential Evolution 3 (GDE3) using a set of multi-objective test problems and performance metrics. The results with and without EWMA control parameter adaptation are compared. EWMA has been earlier proposed with the original unconstrained single-objective Differential Evolution (DE), and EWMA adapts crossover and mutation control parameter values. From the results, it is observed that if good initial control parameter values are used, then there is not clear performance difference between the original GDE3 and GDE3 with EWMA. However, if the initial control parameter values are not good, then EWMA gives clear improvement in performance. Since GDE3 with EWMA is identical with the original DE in the case of single-objective optimization, the same control parameter adaptation technique can be used both in the case of single- and multi-objective optimization. However, different initial control parameter values should be used in different cases, and recommendations for initial values are given at the end of the paper.

[1]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[2]  R. Storn,et al.  Differential Evolution , 2004 .

[3]  Jouni Lampinen,et al.  Performance assessment of Generalized Differential Evolution 3 (GDE3) with a given set of problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[4]  Jouni Lampinen,et al.  DE’s Selection Rule for Multiobjective Optimization , 2001 .

[5]  Saku Kukkonen,et al.  Generalized Differential Evolution for Global Multi-Objective Optimization with Constraints , 2012 .

[6]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[7]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Kalyanmoy Deb,et al.  Improved Pruning of Non-Dominated Solutions Based on Crowding Distance for Bi-Objective Optimization Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[10]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[11]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[12]  Jing J. Liang,et al.  Problem Definitions for Performance Assessment of Multi-objective Optimization Algorithms , 2007 .

[13]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. II. Application example , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[14]  Jouni Lampinen,et al.  An Extension of Generalized Differential Evolution for Multi-objective Optimization with Constraints , 2004, PPSN.

[15]  Jouni Lampinen,et al.  A mutation and crossover adaptation mechanism for differential evolution algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[16]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[17]  Kalyanmoy Deb,et al.  A Fast and Effective Method for Pruning of Non-dominated Solutions in Many-Objective Problems , 2006, PPSN.