An Efficient Recursive Differential Grouping for Large-Scale Continuous Problems

Cooperative co-evolution (CC) is an efficient and practical evolutionary framework for solving large-scale optimization problems. The performance of CC is affected by the variable decomposition. An accurate variable decomposition can help to improve the performance of CC on solving an optimization problem. The variable grouping methods usually spend many computational resources obtaining an accurate variable decomposition. To reduce the computational cost on the decomposition, we propose an efficient recursive differential grouping (ERDG) method in this article. By exploiting the historical information on examining the interrelationship between the variables of an optimization problem, ERDG is able to avoid examining some interrelationship and spend much less computation than other recursive differential grouping methods. Our experimental results and analysis suggest that ERDG is a competitive method for decomposing large-scale continuous problems and improves the performance of CC for solving the large-scale optimization problems.

[1]  Francisco Herrera,et al.  SHADE with Iterative Local Search for Large-Scale Global Optimization , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[2]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[3]  G. Gary Wang,et al.  Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions , 2010 .

[4]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[5]  Wei-neng Chen,et al.  Cooperation coevolution with fast interdependency identification for large scale optimization , 2017, Inf. Sci..

[6]  Xiaodong Li,et al.  Efficient Resource Allocation in Cooperative Co-Evolution for Large-Scale Global Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[7]  Ke Tang,et al.  Impact of problem decomposition on Cooperative Coevolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[8]  Xin Yao,et al.  A Parallel Divide-and-Conquer-Based Evolutionary Algorithm for Large-Scale Optimization , 2018, IEEE Access.

[9]  Saman K. Halgamuge,et al.  A Recursive Decomposition Method for Large Scale Continuous Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[10]  Xiaodong Li,et al.  DG2: A Faster and More Accurate Differential Grouping for Large-Scale Black-Box Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[11]  Xin Yao,et al.  Scaling Up Dynamic Optimization Problems: A Divide-and-Conquer Approach , 2020, IEEE Transactions on Evolutionary Computation.

[12]  Xiaodong Li,et al.  Adaptive threshold parameter estimation with recursive differential grouping for problem decomposition , 2018, GECCO.

[13]  Jfirgen Schmidhuber,et al.  A GENERAL METHOD FOR MULTI-AGENT REINFORCEMENT LEARNING IN UNRESTRICTED ENVIRONMENTS , 1996 .

[14]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[15]  Xingguang Peng,et al.  Identifying Variables Interaction for Black-box Continuous Optimization with Mutual Information of Multiple Local Optima , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[16]  Handing Wang,et al.  Multimodal Optimization Enhanced Cooperative Coevolution for Large-Scale Optimization , 2019, IEEE Transactions on Cybernetics.

[17]  Xingguang Peng,et al.  Large-scale cooperative co-evolution using niching-based multi-modal optimization and adaptive fast clustering , 2017, Swarm Evol. Comput..

[18]  P. Benner,et al.  Solving large-scale control problems , 2004, IEEE Control Systems.

[19]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[20]  Yaochu Jin,et al.  A dynamic optimization approach to the design of cooperative co-evolutionary algorithms , 2016, Knowl. Based Syst..

[21]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[22]  Xiaodong Li,et al.  Designing benchmark problems for large-scale continuous optimization , 2015, Inf. Sci..

[23]  Raymond Chiong,et al.  Evolutionary Optimization: Pitfalls and Booby Traps , 2012, Journal of Computer Science and Technology.

[24]  Timoteo Carletti,et al.  A Surrogate-Assisted Cooperative Co-evolutionary Algorithm Using Recursive Differential Grouping as Decomposition Strategy , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[25]  Haiyan Liu,et al.  Empirical study of effect of grouping strategies for large scale optimization , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[26]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Tutorial , 2016, ArXiv.

[27]  Antonio LaTorre,et al.  Large scale global optimization: Experimental results with MOS-based hybrid algorithms , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  Ming Yang,et al.  CCFR2: A more efficient cooperative co-evolutionary framework for large-scale global optimization , 2020, Inf. Sci..

[29]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[30]  Andreas T. Ernst,et al.  Decomposition for Large-scale Optimization Problems with Overlapping Components , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[31]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[32]  Antonio LaTorre,et al.  A comprehensive comparison of large scale global optimizers , 2015, Inf. Sci..