Super-fit and population size reduction in compact Differential Evolution

Although Differential Evolution is an efficient and versatile optimizer, it has a wide margin of improvement. During the latest years much effort of computer scientists studying Differential Evolution has been oriented towards the improvement of the algorithmic paradigm by adding and modifying components. In particular, two modifications lead to important improvements to the original algorithmic performance. The first is the super-fit mechanism, that is the injection at the beginning of the optimization process of a solution previously improved by another algorithm. The second is the progressive reduction of the population size during the evolution of the population. Recently, the algorithmic paradigm of compact Differential Evolution has been introduced. This class of algorithm does not process a population of solutions but its probabilistic representation. In this way, the Differential Evolution can be employed on a device characterized by a limited memory, such as microcontroller or a Graphics Processing Unit. This paper proposes the implementation of the two modifications mentioned above in the context of compact optimization. The compact versions of memetic super-fit mechanism and population size reduction have been tested in this paper and their benefits highlighted. The main finding of this paper is that although separately these modifications do not robustly lead to significant performance improvements, the combined action of the two mechanism appears to be extremely efficient in compact optimization. The resulting algorithm succeeds at handling very diverse fitness landscapes and appears to improve on a regular basis the performance of a standard compact Differential Evolution.

[1]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[2]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[3]  Reza Rastegar,et al.  A Step Forward in Studying the Compact Genetic Algorithm , 2006, Evolutionary Computation.

[4]  W. Cody,et al.  Rational Chebyshev approximations for the error function , 1969 .

[5]  F. Cupertino,et al.  Compact genetic algorithms for the optimization of induction motor cascaded control , 2007, 2007 IEEE International Electric Machines & Drives Conference.

[6]  Chang Wook Ahn,et al.  Elitism-based compact genetic algorithms , 2003, IEEE Trans. Evol. Comput..

[7]  William E. Hart,et al.  Memetic Evolutionary Algorithms , 2005 .

[8]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[9]  David Naso,et al.  Real-Valued Compact Genetic Algorithms for Embedded Microcontroller Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[10]  Günter Rudolph,et al.  Self-adaptive mutations may lead to premature convergence , 2001, IEEE Trans. Evol. Comput..

[11]  Ville Tirronen,et al.  Super-fit control adaptation in memetic differential evolution frameworks , 2009, Soft Comput..

[12]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[13]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[14]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2008, Applied Intelligence.

[15]  David Naso,et al.  Elitist Compact Genetic Algorithms for Induction Motor Self-tuning Control , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[16]  Ville Tirronen,et al.  An Enhanced Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2008, Evolutionary Computation.

[17]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[18]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[19]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[21]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[22]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[23]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[24]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[25]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[26]  Mark Sumner,et al.  A Fast Adaptive Memetic Algorithm for Online and Offline Control Design of PMSM Drives , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  David Naso,et al.  Compact Differential Evolution , 2011, IEEE Transactions on Evolutionary Computation.