JADE: Adaptive Differential Evolution With Optional External Archive

A new differential evolution (DE) algorithm, JADE, is proposed to improve optimization performance by implementing a new mutation strategy ldquoDE/current-to-p bestrdquo with optional external archive and updating control parameters in an adaptive manner. The DE/current-to-pbest is a generalization of the classic ldquoDE/current-to-best,rdquo while the optional archive operation utilizes historical data to provide information of progress direction. Both operations diversify the population and improve the convergence performance. The parameter adaptation automatically updates the control parameters to appropriate values and avoids a user's prior knowledge of the relationship between the parameter settings and the characteristics of optimization problems. It is thus helpful to improve the robustness of the algorithm. Simulation results show that JADE is better than, or at least comparable to, other classic or adaptive DE algorithms, the canonical particle swarm optimization, and other evolutionary algorithms from the literature in terms of convergence performance for a set of 20 benchmark problems. JADE with an external archive shows promising results for relatively high dimensional problems. In addition, it clearly shows that there is no fixed control parameter setting suitable for various problems or even at different optimization stages of a single problem.

[1]  C. Coello,et al.  Years of Evolutionary Multi-Objective Optimization : What Has Been Done and What Remains To Be Done , 2006 .

[2]  Miguel Rocha,et al.  A Comparison of Algorithms for the Optimization of Fermentation Processes , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[3]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[4]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[5]  Arthur C. Sanderson,et al.  Adaptive Differential Evolution , 2009 .

[6]  Jingqiao Zhang,et al.  Evolutionary optimization of transition probability matrices for credit decision-making , 2010, Eur. J. Oper. Res..

[7]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[8]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[11]  K. Hameyer,et al.  Adaptive coupling of differential evolution and multiquadrics approximation for the tuning of the optimization process , 2000 .

[12]  H. Abbass.  The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[13]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[14]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[15]  B. V. Babu,et al.  Multiobjective differential evolution (MODE) for optimization of adiabatic styrene reactor , 2005 .

[16]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[17]  Piero P. Bonissone,et al.  Fuzzy Logic Controlled Multi-Objective Differential Evolution , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[18]  Josef Tvrdík,et al.  Evolutionary Algorithms with Competing Heuristics in Computational Statistics , 2002, COMPSTAT.

[19]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[20]  Janez Brest,et al.  Performance comparison of self-adaptive and adaptive differential evolution algorithms , 2007, Soft Comput..

[21]  Andries Petrus Engelbrecht,et al.  Differential evolution in high-dimensional search spaces , 2007, 2007 IEEE Congress on Evolutionary Computation.

[22]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[23]  Arthur C. Sanderson,et al.  Differential evolution for discrete optimization: An experimental study on Combinatorial Auction problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[24]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[25]  Yun-Wei Shang,et al.  A Note on the Extended Rosenbrock Function , 2006, Evolutionary Computation.

[26]  Xin Yao,et al.  Making a Difference to Differential Evolution , 2008, Advances in Metaheuristics for Hard Optimization.

[27]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[28]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[29]  Xin Yao,et al.  An adaptive coevolutionary Differential Evolution algorithm for large-scale optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[30]  Arthur C. Sanderson,et al.  Self-adaptive multi-objective differential evolution with direction information provided by archived inferior solutions , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[31]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[32]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[33]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[34]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[35]  Arthur C. Sanderson,et al.  An approximate gaussian model of Differential Evolution with spherical fitness functions , 2007, 2007 IEEE Congress on Evolutionary Computation.

[36]  Bogdan Filipic,et al.  DEMO: Differential Evolution for Multiobjective Optimization , 2005, EMO.

[37]  Arthur C. Sanderson,et al.  JADE: Self-adaptive differential evolution with fast and reliable convergence performance , 2007, 2007 IEEE Congress on Evolutionary Computation.

[38]  X. Yao,et al.  Fast evolutionary algorithms , 2003 .

[39]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[40]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[41]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[42]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .