Self-adaptive differential evolution based on PSO learning strategy

Differential evolution (DE) is an effective and efficient optimization algorithm that has been successfully applied to many problems. However, the DE performance significantly depends on the elaborate settings of its parameters. Designers of DE usually spend great efforts to find proper parameter settings because good parameter values usually vary with different problems. In order to enhance the efficiency and robustness of DE, this paper proposes a novel DE algorithm, PLADE, which uses the learning mechanism in particle swarm optimization (PSO), termed as PSO-Learning (PL) strategy, to adaptively control the DE parameters. PLADE encodes the DE parameters into each individual and evolve the parameters during the evolutionary process. The individuals that achieve good fitness and survive in the evolution imply good parameter settings, the poor individuals use the PL strategy to let their parameters learn from the parameters in the good individuals. With such a PL based parameter self-adaptation strategy, PLADE can evolve the parameters to better values and can adapt the parameters to match the requirements of different evolutionary states and different optimization problems. PLADE is tested by six benchmark functions with unimodal and multimodal characteristics. Experimental results show that PLADE not only outperforms conventional DE with fixed parameter settings, in terms of solution quality, convergence speed, and algorithm reliability, but also is better than or at least comparable to some other state-of-the-art adaptive DE variants.

[1]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[2]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[3]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[4]  Uday K. Chakraborty,et al.  Advances in Differential Evolution , 2010 .

[5]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[6]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[7]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[9]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[10]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[11]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[12]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[14]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[15]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[16]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[17]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[18]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[19]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[20]  Andries Petrus Engelbrecht,et al.  Empirical analysis of self-adaptive differential evolution , 2007, Eur. J. Oper. Res..