An Adaptive Resource Allocation Strategy for Objective Space Partition-Based Multiobjective Optimization

In evolutionary computation, balancing the diversity and convergence of the population for multiobjective evolutionary algorithms (MOEAs) is one of the most challenging topics. Decomposition-based MOEAs are efficient for population diversity, especially when the branch partitions the objective space of multiobjective optimization problem (MOP) into a series of subspaces, and each subspace retains a set of solutions. However, a persisting challenge is how to strengthen the population convergence while maintaining diversity for decomposition-based MOEAs. To address this issue, we first define a novel metric to measure the contributions of subspaces to the population convergence. Then, we develop an adaptive strategy that allocates computational resources to each subspace according to their contributions to the population. Based on the above two strategies, we design an objective space partition-based adaptive MOEA, called OPE-MOEA, to improve population convergence, while maintaining population diversity. Finally, 41 widely used MOP benchmarks are used to compare the performance of the proposed OPE-MOEA with other five representative algorithms. For the 41 MOP benchmarks, the OPE-MOEA significantly outperforms the five algorithms on 28 MOP benchmarks in terms of the metric hypervolume.

[1]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[2]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[3]  Chiu-Hung Chen,et al.  Multiobjective Optimization of Airline Crew Roster Recovery Problems Under Disruption Conditions , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Xifan Yao,et al.  An adaptive multi-population differential artificial bee colony algorithm for many-objective service composition in cloud manufacturing , 2018, Inf. Sci..

[5]  Bernhard Sendhoff,et al.  A Multiobjective Evolutionary Algorithm Using Gaussian Process-Based Inverse Modeling , 2015, IEEE Transactions on Evolutionary Computation.

[6]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[7]  Fang Liu,et al.  A Memetic Optimization Strategy Based on Dimension Reduction in Decision Space , 2015, Evolutionary Computation.

[8]  Xiaomin Zhu,et al.  Towards energy-efficient scheduling for real-time tasks under uncertain cloud computing environment , 2015, J. Syst. Softw..

[9]  Shengxiang Yang,et al.  Bi-goal evolution for many-objective optimization problems , 2015, Artif. Intell..

[10]  Xiaomin Zhu,et al.  Scheduling for Workflows with Security-Sensitive Intermediate Data by Selective Tasks Duplication in Clouds , 2017, IEEE Transactions on Parallel and Distributed Systems.

[11]  Hisao Ishibuchi,et al.  On Scalable Multiobjective Test Problems With Hardly Dominated Boundaries , 2019, IEEE Transactions on Evolutionary Computation.

[12]  Jun Zhang,et al.  A Diversity-Enhanced Resource Allocation Strategy for Decomposition-Based Multiobjective Evolutionary Algorithm , 2018, IEEE Transactions on Cybernetics.

[13]  Tao Zhang,et al.  Multi-Objective Optimization of Hybrid Renewable Energy System Using an Enhanced Multi-Objective Evolutionary Algorithm , 2017 .

[14]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[15]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[16]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[17]  Xiaomin Zhu,et al.  Uncertainty-Aware Real-Time Workflow Scheduling in the Cloud , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[18]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[19]  Nicola Beume,et al.  An EMO Algorithm Using the Hypervolume Measure as Selection Criterion , 2005, EMO.

[20]  Qingfu Zhang,et al.  Constrained Subproblems in a Decomposition-Based Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[21]  Xiaomin Zhu,et al.  Fault-Tolerant Scheduling for Real-Time Scientific Workflows with Elastic Resource Provisioning in Virtualized Clouds , 2016, IEEE Transactions on Parallel and Distributed Systems.

[22]  Vivek K. Patel,et al.  A multi-objective improved teaching-learning based optimization algorithm (MO-ITLBO) , 2016, Inf. Sci..

[23]  Xin Yao,et al.  Stochastic Ranking Algorithm for Many-Objective Optimization Based on Multiple Indicators , 2016, IEEE Transactions on Evolutionary Computation.

[24]  MengChu Zhou,et al.  Pareto-Optimization for Scheduling of Crude Oil Operations in Refinery via Genetic Algorithm , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[26]  Jun Zhang,et al.  Particle Swarm Optimization With a Balanceable Fitness Estimation for Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[27]  Y. Ramu Naidu,et al.  Solving Multiobjective Optimization Problems Using Hybrid Cooperative Invasive Weed Optimization With Multiple Populations , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[29]  Tatiana Morosuk,et al.  Multi-objective optimization of coal-fired power plants using differential evolution , 2014 .

[30]  Guohua Wu,et al.  Ensemble strategies for population-based optimization algorithms - A survey , 2019, Swarm Evol. Comput..

[31]  Qingfu Zhang,et al.  Adaptive Replacement Strategies for MOEA/D , 2016, IEEE Transactions on Cybernetics.

[32]  Qingfu Zhang,et al.  Adaptively Allocating Search Effort in Challenging Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[33]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[34]  Xiao-Long Zheng,et al.  A Collaborative Multiobjective Fruit Fly Optimization Algorithm for the Resource Constrained Unrelated Parallel Machine Green Scheduling Problem , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Xin Yao,et al.  A clustering-ranking method for many-objective optimization , 2015, Appl. Soft Comput..

[36]  Hisao Ishibuchi,et al.  A Framework for Large-Scale Multiobjective Optimization Based on Problem Transformation , 2018, IEEE Transactions on Evolutionary Computation.

[37]  Kalyanmoy Deb,et al.  A combined genetic adaptive search (GeneAS) for engineering design , 1996 .

[38]  Handing Wang,et al.  Efficient nonlinear correlation detection for decomposed search in evolutionary multi-objective optimization , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[39]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[40]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[41]  Qingfu Zhang,et al.  Are All the Subproblems Equally Important? Resource Allocation in Decomposition-Based Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[42]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[43]  Kay Chen Tan,et al.  A hybrid evolutionary multiobjective optimization algorithm with adaptive multi-fitness assignment , 2015, Soft Comput..

[44]  Eckart Zitzler,et al.  Improving hypervolume-based multiobjective evolutionary algorithms by using objective reduction methods , 2007, 2007 IEEE Congress on Evolutionary Computation.

[45]  Qingfu Zhang,et al.  An External Archive Guided Multiobjective Evolutionary Algorithm Based on Decomposition for Combinatorial Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[46]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[47]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[48]  Qingfu Zhang,et al.  Decomposition-Based Multiobjective Evolutionary Algorithm With an Ensemble of Neighborhood Sizes , 2012, IEEE Transactions on Evolutionary Computation.

[49]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[50]  Xiaomin Zhu,et al.  Agent-Based Dynamic Scheduling for Earth-Observing Tasks on Multiple Airships in Emergency , 2016, IEEE Systems Journal.

[51]  Lothar Thiele,et al.  A Preference-Based Evolutionary Algorithm for Multi-Objective Optimization , 2009, Evolutionary Computation.

[52]  Qingfu Zhang,et al.  A Generator for Multiobjective Test Problems With Difficult-to-Approximate Pareto Front Boundaries , 2019, IEEE Transactions on Evolutionary Computation.

[53]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[54]  Witold Pedrycz,et al.  Uncertainty-Aware Online Scheduling for Real-Time Workflows in Cloud Service Environment , 2021, IEEE Transactions on Services Computing.

[55]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[56]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[57]  Haifeng Li,et al.  Ensemble of differential evolution variants , 2018, Inf. Sci..

[58]  Qiuzhen Lin,et al.  A novel hybrid multi-objective immune algorithm with adaptive differential evolution , 2015, Comput. Oper. Res..

[59]  Handing Wang,et al.  Data-Driven Surrogate-Assisted Multiobjective Evolutionary Optimization of a Trauma System , 2016, IEEE Transactions on Evolutionary Computation.

[60]  John A. W. McCall,et al.  D2MOPSO: MOPSO Based on Decomposition and Dominance with Archiving Using Crowding Distance in Objective and Solution Spaces , 2014, Evolutionary Computation.

[61]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[62]  MengChu Zhou,et al.  A Collaborative Resource Allocation Strategy for Decomposition-Based Multiobjective Evolutionary Algorithms , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[63]  LiHui,et al.  Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II , 2009 .

[64]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[65]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[66]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[67]  Haifeng Li,et al.  Solving large-scale many-objective optimization problems by covariance matrix adaptation evolution strategy with scalable small subpopulations , 2020, Inf. Sci..

[68]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[69]  Qingfu Zhang,et al.  Decomposition-Based-Sorting and Angle-Based-Selection for Evolutionary Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Cybernetics.

[70]  Slim Bechikh,et al.  A New Decomposition-Based NSGA-II for Many-Objective Optimization , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[71]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[72]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[73]  Lu Zhen A Bi-Objective Model on Multiperiod Green Supply Chain Network Design , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[74]  Adriana Menchaca-Mendez,et al.  GD-MOEA: A New Multi-Objective Evolutionary Algorithm Based on the Generational Distance Indicator , 2015, EMO.

[75]  Xianpeng Wang,et al.  An adaptive multi-population differential evolution algorithm for continuous multi-objective optimization , 2016, Inf. Sci..

[76]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.