Decomposition-based multiobjective optimization with bicriteria assisted adaptive operator selection

Abstract This paper proposes a novel bicriteria assisted adaptive operator selection (B-AOS) strategy for decomposition-based multiobjective evolutionary algorithms (MOEA/Ds). In this approach, two operator pools are employed to focus on exploitation and exploration, each of which includes two DE operators with distinct search patterns. Then, two criteria, one (called the Pareto criterion) emphasizing convergence and the other (called the crowding criterion) focusing on diversity, are collaboratively used to assist the selection of a suitable DE operator for the current solution, which aims to obtain a good balance between exploitation and exploration during the evolutionary search of each solution. Specifically, the Pareto criterion is used to decide whether exploration or exploitation is preferred for the current solution, which will help to select an operator pool. After that, from the selected operator pool, the crowding criterion is used to further assist the selection of the DE operator based on a binary tournament strategy. The experimental results show that our proposed B-AOS performs better than other existing state-of-the-art adaptive operator selection methods, and several MOEA/Ds embedded with B-AOS can significantly improve their performance on most of the benchmark problems adopted.

[1]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[2]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[3]  Xianpeng Wang,et al.  Adaptive Multiobjective Differential Evolution With Reference Axis Vicinity Mechanism , 2019, IEEE Transactions on Cybernetics.

[4]  Xin Yao,et al.  A Scalable Indicator-Based Evolutionary Algorithm for Large-Scale Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[5]  Ruhul A. Sarker,et al.  Use of statistical outlier detection method in adaptive evolutionary algorithms , 2006, GECCO.

[6]  Yan-Jie Song,et al.  Learning-guided nondominated sorting genetic algorithm II for multi-objective satellite range scheduling problem , 2019, Swarm Evol. Comput..

[7]  Fang Liu,et al.  MOEA/D with uniform decomposition measurement for many-objective problems , 2014, Soft Comput..

[8]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[9]  Sandra M. Venske,et al.  ADEMO/D: Multiobjective optimization by an adaptive differential evolution algorithm , 2014, Neurocomputing.

[10]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Kay Chen Tan,et al.  Evolutionary Many-Objective Algorithm Using Decomposition-Based Dominance Relationship , 2019, IEEE Transactions on Cybernetics.

[12]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[13]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[14]  Xiaoyan Sun,et al.  Enhanced NSGA-II with evolving directions prediction for interval multi-objective optimization , 2019, Swarm Evol. Comput..

[15]  David E. Goldberg,et al.  Probability matching, the magnitude of reinforcement, and classifier system bidding , 2004, Machine Learning.

[16]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[17]  Weili Wang,et al.  A performance-driven multi-algorithm selection strategy for energy consumption optimization of sea-rail intermodal transportation , 2019, Swarm Evol. Comput..

[18]  Jie Li,et al.  A novel improved fruit fly optimization algorithm for aerodynamic shape design optimization , 2019, Knowl. Based Syst..

[19]  Xiao-Liang Shen,et al.  An adaptive weight vector guided evolutionary algorithm for preference-based multi-objective optimization , 2019, Swarm Evol. Comput..

[20]  Qingfu Zhang,et al.  Constrained Subproblems in a Decomposition-Based Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[21]  Qingfu Zhang,et al.  On Tchebycheff Decomposition Approaches for Multiobjective Evolutionary Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[22]  Yang Yu,et al.  An analysis on recombination in multi-objective evolutionary optimization , 2013, Artif. Intell..

[23]  Witold Pedrycz,et al.  An Adaptive Resource Allocation Strategy for Objective Space Partition-Based Multiobjective Optimization , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Hong Li,et al.  MOEA/D + uniform design: A new version of MOEA/D for optimization problems with many objectives , 2013, Comput. Oper. Res..

[25]  Álvaro Fialho,et al.  Adaptive strategy selection in differential evolution , 2010, GECCO '10.

[26]  Qingfu Zhang,et al.  Adaptive Operator Selection With Bandits for a Multiobjective Evolutionary Algorithm Based on Decomposition , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[28]  Qingfu Zhang,et al.  Comparison between MOEA/D and NSGA-III on a set of novel many and multi-objective benchmark problems with challenging difficulties , 2019, Swarm Evol. Comput..

[29]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[30]  Michèle Sebag,et al.  Toward comparison-based adaptive operator selection , 2010, GECCO '10.

[31]  Jun Zhang,et al.  Cooperative Differential Evolution Framework for Constrained Multiobjective Optimization , 2019, IEEE Transactions on Cybernetics.

[32]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[33]  Qingfu Zhang,et al.  Interrelationship-Based Selection for Decomposition Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[34]  Shengxiang Yang,et al.  A Strength Pareto Evolutionary Algorithm Based on Reference Direction for Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[35]  Dirk Thierens,et al.  The balance between proximity and diversity in multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[36]  Xiangxiang Zeng,et al.  MOEA/HD: A Multiobjective Evolutionary Algorithm Based on Hierarchical Decomposition , 2019, IEEE Transactions on Cybernetics.

[37]  Witold Pedrycz,et al.  Hyperplane Assisted Evolutionary Algorithm for Many-Objective Optimization Problems , 2020, IEEE Transactions on Cybernetics.

[38]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[39]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[40]  Frédéric Saubion,et al.  Autonomous operator management for evolutionary algorithms , 2010, J. Heuristics.

[41]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[42]  Dong Han,et al.  An adaptive decomposition-based evolutionary algorithm for many-objective optimization , 2019, Inf. Sci..

[43]  Qiuzhen Lin,et al.  Adaptive composite operator selection and parameter control for multiobjective evolutionary algorithm , 2016, Inf. Sci..

[44]  Qingfu Zhang,et al.  Are All the Subproblems Equally Important? Resource Allocation in Decomposition-Based Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[45]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[46]  Dirk Thierens,et al.  An Adaptive Pursuit Strategy for Allocating Operator Probabilities , 2005, BNAIC.

[47]  Qingfu Zhang,et al.  Decomposition-Based Multiobjective Evolutionary Algorithm With an Ensemble of Neighborhood Sizes , 2012, IEEE Transactions on Evolutionary Computation.

[48]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[49]  Zexuan Zhu,et al.  A novel adaptive hybrid crossover operator for multiobjective evolutionary algorithm , 2016, Inf. Sci..

[50]  Xinye Cai,et al.  A decomposition-based coevolutionary multiobjective local search for combinatorial multiobjective optimization , 2019, Swarm Evol. Comput..

[51]  Qingfu Zhang,et al.  Matching-Based Selection With Incomplete Lists for Decomposition Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[52]  Ka-Chun Wong,et al.  A novel multi-objective evolutionary algorithm with dynamic decomposition strategy , 2019, Swarm Evol. Comput..

[53]  Qingfu Zhang,et al.  Adaptive Replacement Strategies for MOEA/D , 2016, IEEE Transactions on Cybernetics.

[54]  Qingfu Zhang,et al.  Evolutionary Many-Objective Optimization Based on Adversarial Decomposition , 2017, IEEE Transactions on Cybernetics.

[55]  Ponnuthurai Nagaratnam Suganthan,et al.  $I_{\rm SDE}$ +—An Indicator for Multi and Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[56]  Jun Zhang,et al.  A Diversity-Enhanced Resource Allocation Strategy for Decomposition-Based Multiobjective Evolutionary Algorithm , 2018, IEEE Transactions on Cybernetics.

[57]  Zexuan Zhu,et al.  Evolutionary Search with Multiple Utopian Reference Points in Decomposition-Based Multiobjective Optimization , 2019, Complex..

[58]  Qingfu Zhang,et al.  Balancing exploration and exploitation in multiobjective evolutionary optimization , 2019, Inf. Sci..