Cloudde: A Heterogeneous Differential Evolution Algorithm and Its Distributed Cloud Version

Existing differential evolution (DE) algorithms often face two challenges. The first is that the optimization performance is significantly affected by the ad hoc configurations of operators and parameters for different problems. The second is the long runtime for real-world problems whose fitness evaluations are often expensive. Aiming at solving these two problems, this paper develops a novel double-layered heterogeneous DE algorithm and realizes it in cloud computing distributed environment. In the first layer, different populations with various parameters and/or operators run concurrently and adaptively migrate to deliver robust solutions by making the best use of performance differences among multiple populations. In the second layer, a set of cloud virtual machines run in parallel to evaluate fitness of corresponding populations, reducing computational costs as offered by cloud. Experimental results on a set of benchmark problems with different search requirements and a case study with expensive design evaluations have shown that the proposed algorithm offers generally improved performance and reduced computational time, compared with not only conventional and a number of state-of-the-art DE variants, but also a number of other distributed DE and high-performing evolutionary algorithms. The speedup is significant especially on expensive problems, offering high potential in a broad range of real-world applications.

[1]  Qingfu Zhang,et al.  Distributed evolutionary algorithms and their models: A survey of the state-of-the-art , 2015, Appl. Soft Comput..

[2]  G. Leguizamon,et al.  Island Based Distributed Differential Evolution: An Experimental Study on Hybrid Testbeds , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[3]  Amit Konar,et al.  Differential Evolution with Local Neighborhood , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[4]  Jun Zhang,et al.  Self-adaptive differential evolution based on PSO learning strategy , 2010, GECCO '10.

[5]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[6]  Jun Zhang,et al.  Evolutionary Computation Meets Machine Learning: A Survey , 2011, IEEE Computational Intelligence Magazine.

[7]  Kiyoharu Tagawa,et al.  Experiment study of a Structured Differential Evolution with mixed strategies , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[8]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[9]  Dongrui Fan,et al.  An Evolutionary Technique for Performance-Energy-Temperature Optimized Scheduling of Parallel Tasks on Multi-Core Processors , 2016, IEEE Transactions on Parallel and Distributed Systems.

[10]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[11]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[12]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[13]  An-Yeu Wu,et al.  Spatial-Temporal Enhancement of ACO-Based Selection Schemes for Adaptive Routing in Network-on-Chip Systems , 2014, IEEE Transactions on Parallel and Distributed Systems.

[14]  Fabrice Heitz,et al.  Parallel Differential Evolution: Application to 3-D Medical Image Registration , 2005 .

[15]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[16]  Rainer Storn,et al.  System design by constraint adaptation and differential evolution , 1999, IEEE Trans. Evol. Comput..

[17]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[18]  Meie Shen,et al.  A Differential Evolution Algorithm With Dual Populations for Solving Periodic Railway Timetable Scheduling Problem , 2013, IEEE Transactions on Evolutionary Computation.

[19]  Kay Chen Tan,et al.  A distributed Cooperative coevolutionary algorithm for multiobjective optimization , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[21]  Gang Chen,et al.  Service Provision Control in Federated Service Providing Systems , 2013, IEEE Transactions on Parallel and Distributed Systems.

[22]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[23]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Wei-jie Yu,et al.  Multi-population differential evolution with adaptive parameter control for global optimization , 2011, GECCO '11.

[25]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[26]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[27]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[28]  Anthony Skjellum,et al.  A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard , 1996, Parallel Comput..

[29]  Marios D. Dikaiakos,et al.  Cloud Computing: Distributed Internet Computing for IT and Scientific Research , 2009, IEEE Internet Computing.

[30]  Jun Zhang,et al.  Dichotomy Guided Based Parameter Adaptation for Differential Evolution , 2015, GECCO.

[31]  Sudip Misra,et al.  Cloud Computing Applications for Smart Grid: A Survey , 2015, IEEE Transactions on Parallel and Distributed Systems.

[32]  Xiaohui Liu,et al.  Evolutionary Multi-Objective Workflow Scheduling in Cloud , 2016, IEEE Transactions on Parallel and Distributed Systems.

[33]  Andries Petrus Engelbrecht,et al.  Empirical analysis of self-adaptive differential evolution , 2007, Eur. J. Oper. Res..

[34]  Massimiliano Vasile,et al.  An Inflationary Differential Evolution Algorithm for Space Trajectory Optimization , 2011, IEEE Transactions on Evolutionary Computation.

[35]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[37]  Jun Zhang,et al.  Enhance differential evolution with random walk , 2012, GECCO '12.

[38]  Zhi-hui Zhan,et al.  Energy aware virtual machine placement scheduling in cloud computing based on ant colony optimization approach , 2014, GECCO.

[39]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[40]  Saber Mohamed,et al.  An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems , 2013 .

[41]  Jun Zhang,et al.  Fast Micro-Differential Evolution for Topological Active Net Optimization , 2016, IEEE Transactions on Cybernetics.

[42]  A. F. Ioffe,et al.  NEW MIGRATION SCHEME FOR PARALLEL DIFFERENTIAL EVOLUTION , 2006 .

[43]  Ville Tirronen,et al.  A study on scale factor/crossover interaction in distributed differential evolution , 2011, Artificial Intelligence Review.

[44]  Jun Zhang,et al.  Differential Evolution with an Evolution Path: A DEEP Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[45]  Guolong Chen,et al.  A PSO-Optimized Real-Time Fault-Tolerant Task Allocation Algorithm in Wireless Sensor Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[46]  Ivanoe De Falco,et al.  Satellite Image Registration by Distributed Differential Evolution , 2007, EvoWorkshops.

[47]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[48]  Jun Zhang,et al.  Differential evolution for power electronic circuit optimization , 2015, 2015 Conference on Technologies and Applications of Artificial Intelligence (TAAI).

[49]  Zhi-hui Zhan,et al.  Topology selection for particle swarm optimization , 2016, Inf. Sci..

[50]  Anne Auger,et al.  Performance evaluation of an advanced local search evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[51]  Krzysztof Bandurski,et al.  A Parallel Differential Evolution Algorithm A Parallel Differential Evolution Algorithm , 2006, PARELEC.

[52]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[53]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[54]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[55]  Jun Zhang,et al.  Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches , 2015, ACM Comput. Surv..

[56]  Jun Zhang,et al.  Orthogonal learning particle swarm optimization for power electronic circuit optimization with free search range , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[57]  Jiannong Cao,et al.  Multiple Populations for Multiple Objectives: A Coevolutionary Technique for Solving Multiobjective Optimization Problems , 2013, IEEE Transactions on Cybernetics.

[58]  Zhi-hui Zhan,et al.  Parallel Differential Evolution Based on Distributed Cloud Computing Resources for Power Electronic Circuit Optimization , 2016, GECCO.

[59]  Santi Agatino Rizzo,et al.  A Parallel Version of the Self-Adaptive Low-High Evaluation Evolutionary-Algorithm for Electromagnetic Device Optimization , 2014, IEEE Transactions on Magnetics.

[60]  Jun Zhang,et al.  Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems , 2015, Inf. Sci..

[61]  Zhu Yong-zhi Parallel Differential Evolution Algorithm , 2011 .

[62]  Kay Chen Tan,et al.  Multimodal Optimization Using a Biobjective Differential Evolution Algorithm Enhanced With Mean Distance-Based Selection , 2013, IEEE Transactions on Evolutionary Computation.

[63]  Ajith Abraham,et al.  A Synergy of Differential Evolution and Bacterial Foraging Algorithm for Global Optimization , 2007 .

[64]  H. Iba,et al.  Inferring Gene Regulatory Networks using Differential Evolution with Local Search Heuristics , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[65]  B. V. Babu,et al.  Modified differential evolution (MDE) for optimization of non-linear chemical processes , 2006, Comput. Chem. Eng..