Distributed Cooperative Co-Evolution With Adaptive Computing Resource Allocation for Large Scale Optimization

Through introducing the divide-and-conquer strategy, cooperative co-evolution (CC) has been successfully employed by many evolutionary algorithms (EAs) to solve large-scale optimization problems. In practice, it is common that different subcomponents of a large-scale problem have imbalanced contributions to the global fitness. Thus, how to utilize such imbalance and concentrate efforts on optimizing important subcomponents becomes an important issue for improving performance of cooperative co-EA, especially in distributed computing environment. In this paper, we propose a two-layer distributed CC (dCC) architecture with adaptive computing resource allocation for large-scale optimization. The first layer is the dCC model which takes charge of calculating the importance of subcomponents and accordingly allocating resources. An effective allocating algorithm is designed which can adaptively allocate computing resources based on a periodic contribution calculating method. The second layer is the pool model which takes charge of making fully utilization of imbalanced resource allocation. Within this layer, two different conformance policies are designed to help optimizers use the assigned computing resources efficiently. Empirical studies show that the two conformance policies and the computing resource allocation algorithm are effective, and the proposed distributed architecture possesses high scalability and efficiency.

[1]  John Yearwood,et al.  Heterogeneous Cooperative Co-Evolution Memetic Differential Evolution Algorithm for Big Data Optimization Problems , 2017, IEEE Transactions on Evolutionary Computation.

[2]  Yuan Zhao,et al.  A distributed pool architecture for genetic algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[3]  Volkan Cevher,et al.  Convex Optimization for Big Data: Scalable, randomized, and parallel algorithms for big data analytics , 2014, IEEE Signal Processing Magazine.

[4]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[5]  Francisco Herrera,et al.  Hierarchical distributed genetic algorithms , 1999, Int. J. Intell. Syst..

[6]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[7]  Alexander Mendiburu,et al.  Parallel implementation of EDAs based on probabilistic graphical models , 2005, IEEE Transactions on Evolutionary Computation.

[8]  Junchi Yan,et al.  Two-stage based ensemble optimization framework for large-scale global optimization , 2013, Eur. J. Oper. Res..

[9]  Shahryar Rahnamayan,et al.  Metaheuristics in large-scale global continues optimization: A survey , 2015, Inf. Sci..

[10]  Enrique Alba,et al.  Selection intensity in cellular evolutionary algorithms for regular lattices , 2005, IEEE Transactions on Evolutionary Computation.

[11]  Xin Liu,et al.  A Distributed Parallel Cooperative Coevolutionary Multiobjective Evolutionary Algorithm for Large-Scale Optimization , 2017, IEEE Transactions on Industrial Informatics.

[12]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[14]  Bu-Sung Lee,et al.  Efficient Hierarchical Parallel Genetic Algorithms using Grid computing , 2007, Future Gener. Comput. Syst..

[15]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[16]  Xiaodong Li,et al.  Efficient Resource Allocation in Cooperative Co-Evolution for Large-Scale Global Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[17]  Peter Tiño,et al.  Scaling Up Estimation of Distribution Algorithms for Continuous Optimization , 2011, IEEE Transactions on Evolutionary Computation.

[18]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[19]  Arthur C. Sanderson,et al.  Modeling and convergence analysis of distributed coevolutionary algorithms , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Ruhul A. Sarker,et al.  Dependency Identification technique for large scale optimization problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[21]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[22]  Franciszek Seredynski,et al.  Competitive Coevolutionary Multi-Agent Systems: The Application to Mapping and Scheduling Problems , 1997, J. Parallel Distributed Comput..

[23]  Enrique Alba,et al.  The exploration/exploitation tradeoff in dynamic cellular genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[24]  Xiaodong Li,et al.  Effective decomposition of large-scale separable continuous functions for cooperative co-evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[25]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[26]  Zhijian Wu,et al.  Parallel differential evolution with self-adapting control parameters and generalized opposition-based learning for solving high-dimensional optimization problems , 2013, J. Parallel Distributed Comput..

[27]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[28]  Yan Wu,et al.  An efficient algorithm for high-dimensional function optimization , 2013, Soft Comput..

[29]  Mohammed El-Abd.  A cooperative approach to The Artificial Bee Colony algorithm , 2010, IEEE Congress on Evolutionary Computation.

[30]  Xiaodong Li,et al.  Tackling high dimensional nonseparable optimization problems by cooperatively coevolving particle swarms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[31]  Luigi Fortuna,et al.  Evolutionary Optimization Algorithms , 2001 .

[32]  Chunmei Zhang,et al.  Distributed memetic differential evolution with the synergy of Lamarckian and Baldwinian learning , 2013, Appl. Soft Comput..

[33]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[34]  Xiaodong Li,et al.  A sensitivity analysis of contribution-based cooperative co-evolutionary algorithms , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[35]  Xiaodong Li,et al.  CBCC3 — A contribution-based cooperative co-evolutionary algorithm with improved exploration/exploitation balance , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[36]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[37]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[38]  Antonio LaTorre,et al.  A comprehensive comparison of large scale global optimizers , 2015, Inf. Sci..

[39]  Tetsuyuki Takahama,et al.  Large scale optimization by differential evolution with landscape modality detection and a diversity archive , 2012, 2012 IEEE Congress on Evolutionary Computation.

[40]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[41]  Qingfu Zhang,et al.  Distributed evolutionary algorithms and their models: A survey of the state-of-the-art , 2015, Appl. Soft Comput..

[42]  Mike Davis,et al.  VLSI circuit synthesis using a parallel genetic algorithm , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[43]  Lam Thu Bui,et al.  A Parallel Cooperative Coevolution Evolutionary Algorithm , 2011, 2011 Third International Conference on Knowledge and Systems Engineering.

[44]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[45]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[46]  Marc Parizeau,et al.  Analysis of a master-slave architecture for distributed evolutionary computations , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).