Cloud Scale Distributed Evolutionary Strategies for High Dimensional Problems

We develop and evaluate a cloud scale distributed covariance matrix adaptation based evolutionary strategy for problems with dimensions as high as 400. We adopt an island based distribution model and rely on a peer-to-peer communication protocol. We identify a variety of parameters in a distributed island model that could be randomized leading to a new dynamic migration protocol that can prove advantageous when computing on the cloud. Our approach enables efficient and high quality distributed sampling while mitigating the latencies and failure risks associated with running on a cloud. We evaluate performance on a real world problem from the domain of wind energy: wind farm turbine layout optimization.

[1]  Geoffrey C. Fox,et al.  MapReduce in the Clouds for Science , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[2]  Xavier Llorà,et al.  Scaling Genetic Algorithms Using MapReduce , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[3]  Pedro Larrañaga,et al.  Towards a New Evolutionary Computation - Advances in the Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[4]  Weihang Zhu,et al.  Nonlinear optimization with a massively parallel Evolution Strategy-Pattern Search algorithm on graphics hardware , 2011, Appl. Soft Comput..

[5]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[6]  Andrew Kusiak,et al.  Design of wind farm layout for maximum wind energy capture , 2010 .

[7]  Günter Rudolph,et al.  Global Optimization by Means of Distributed Evolution Strategies , 1990, PPSN.

[8]  Christian L. Müller,et al.  pCMALib: a parallel fortran 90 library for the evolution strategy with covariance matrix adaptation , 2009, GECCO '09.

[9]  Soco Soft Computing Models in Industrial and Environmental Applications, 5th International Workshop (SOCO 2010 , 2010 .

[10]  Miguel A. Vega-Rodríguez,et al.  A Parallel Cooperative Evolutionary Strategy for Solving the Reporting Cells Problem , 2010, SOCO.

[11]  Marco Tomassini,et al.  Spatially Structured Evolutionary Algorithms: Artificial Evolution in Space and Time (Natural Computing Series) , 2005 .

[12]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[13]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[14]  Enrique Alba,et al.  Parallel Evolutionary Computations , 2006, Studies in Computational Intelligence.