Abstract This paper presents a novel evolutionary optimization strategy based on the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). This new approach is intended to reduce the number of generations required for convergence to the optimum. Reducing the number of generations, i.e., the time complexity of the algorithm, is important if a large population size is desired: (1) to reduce the effect of noise; (2) to improve global search properties; and (3) to implement the algorithm on (highly) parallel machines. Our method results in a highly parallel algorithm which scales favorably with large numbers of processors. This is accomplished by efficiently incorporating the available information from a large population, thus significantly reducing the number of generations needed to adapt the covariance matrix. The original version of the CMA-ES was designed to reliably adapt the covariance matrix in small populations but it cannot exploit large populations efficiently. Our modifications scale up the efficiency to population sizes of up to 10n, where n is the problem dimension. This method has been applied to a large number of test problems, demonstrating that in many cases the CMA-ES can be advanced from quadratic to linear time complexity.
G. Grimmett,et al.
Probability and random processes
Hans-Paul Schwefel,et al.
Evolution and Optimum Seeking: The Sixth Generation
On the Asymptotic Behavior of Multirecombinant Evolution Strategies
N. Hansen,et al.
Convergence Properties of Evolution Strategies with the Derandomized Covariance Matrix Adaptation: T
Thomas Bäck,et al.
Evolutionary computation: comments on the history and current state
IEEE Trans. Evol. Comput..
Nikolaus Hansen,et al.
Verallgemeinerte individuelle Schrittweitenregelung in der Evolutionsstrategie - eine Untersuchung zur entstochastisierten, koordinatensystemunabhängigen Adaptation der Mutationsverteilung
Hans-Georg Beyer,et al.
The Theory of Evolution Strategies
Natural Computing Series.
Nikolaus Hansen,et al.
Completely Derandomized Self-Adaptation in Evolution Strategies
Roberto Irizarry,et al.
LARES: An Artificial Chemical Process Approach for Optimization
M. N. Vrahatis,et al.
Computing Nash equilibria through computational intelligence methods
Ali Esmaili,et al.
Probability and Random Processes