A Study on Self-adaptation in the Evolutionary Strategy Algorithm

Nature-inspired algorithms attract many researchers worldwide for solving the hardest optimization problems. One of the well-known members of this extensive family is the evolutionary strategy ES algorithm. To date, many variants of this algorithm have emerged for solving continuous as well as combinatorial problems. One of the more promising variants, a self-adaptive evolutionary algorithm, has recently been proposed that enables a self-adaptation of its control parameters. In this paper, we discuss and evaluate popular common and self-adaptive evolutionary strategy (ES) algorithms. In particular, we present an empirical comparison between three self-adaptive ES variants and common ES methods. In order to assure a fair comparison, we test the methods by using a number of well-known unimodal and multimodal, separable and non-separable, benchmark optimization problems for different dimensions and population size. The results of this experiments study were promising and have encouraged us to invest more efforts into developing in this direction.

[1]  Kalyanmoy Deb,et al.  On self-adaptive features in real-parameter evolutionary algorithms , 2001, IEEE Trans. Evol. Comput..

[2]  Simon Fong,et al.  A Novel Hybrid Self-Adaptive Bat Algorithm , 2014, TheScientificWorldJournal.

[3]  D. McGranahan,et al.  Ecology, Evolution and Organismal Biology Publications Ecology, Evolution and Organismal Biology Connecting Soil Organic Carbon and Root Biomass with Land-use and Vegetation in Temperate Grassland Connecting Soil Organic Carbon and Root Biomass with Land-use and Vegetation in Temperate Grassland , 2022 .

[4]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Tutorial , 2016, ArXiv.

[5]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[6]  Iztok Fister,et al.  Graph 3-coloring with a hybrid self-adaptive evolutionary algorithm , 2013, Comput. Optim. Appl..

[7]  H. P. Schwefel,et al.  Numerische Optimierung von Computermodellen mittels der Evo-lutionsstrategie , 1977 .

[8]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[9]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[10]  H. Schwefel,et al.  Evolutionsstrategien für die numerische Optimierung , 1977 .

[11]  Hajime Kita,et al.  A Comparison Study of Self-Adaptation in Evolution Strategies and Real-Coded Genetic Algorithms , 2001, Evolutionary Computation.

[12]  Oliver Kramer,et al.  Derivative-Free Optimization , 2011, Computational Optimization, Methods and Algorithms.

[13]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[14]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[15]  Efrén Mezura-Montes,et al.  Self-adaptive and Deterministic Parameter Control in Differential Evolution for Constrained Optimization , 2009 .

[16]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[17]  Oliver Kramer,et al.  Machine Learning for Evolution Strategies , 2016 .

[18]  Xin Yao,et al.  Fast Evolution Strategies , 1997, Evolutionary Programming.

[19]  Iztok Fister.  On the Mutation Operators in Evolution Strategies , 2015 .

[20]  Oliver Kramer,et al.  Evolutionary self-adaptation: a survey of operators and strategy parameters , 2010, Evol. Intell..