A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems

Several extensions to evolutionary algorithms (EAs) and particle swarm optimization (PSO) have been suggested during the last decades offering improved performance on selected benchmark problems. Recently, another search heuristic termed differential evolution (DE) has shown superior performance in several real-world applications. In this paper, we evaluate the performance of DE, PSO, and EAs regarding their general applicability as numerical optimization techniques. The comparison is performed on a suite of 34 widely used benchmark problems. The results from our study show that DE generally outperforms the other algorithms. However, on two noisy functions, both DE and PSO were outperformed by the EA.

[1]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  Jacques Riget,et al.  A Diversity-Guided Particle Swarm Optimizer - the ARPSO , 2002 .

[4]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[5]  Xin Yao,et al.  Fast Evolutionary Programming , 1996, Evolutionary Programming.

[6]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[7]  R. Thomsen.  Flexible ligand docking using differential evolution , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[8]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[9]  P. Vadstrup,et al.  Parameter identification of induction motors using differential evolution , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  Yoshikazu Fukuyama,et al.  A particle swarm optimization for reactive power and voltage control in electric power systems , 1999, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[12]  René Thomsen,et al.  Flexible ligand docking using evolutionary algorithms: investigating the effects of variation operators and local search hybrids. , 2003, Bio Systems.

[13]  Yahya Rahmat-Samii,et al.  Particle swarm optimization for reconfigurable phase‐differentiated array design , 2003 .