Explicit and Implicit Parallelisms in Decomposition Based Evolutionary Many-Objective Optimization Algorithms

Over the past two decades, evolutionary multiobjective optimization (EMO) algorithms have demonstrated their ability to find and maintain multiple trade-off solutions in two and three-objective problems. This is because their operators are able to establish an implicit parallel search within an evolving population around multiple optimal regions of the search space simultaneously. For many-objective optimization problems involving a large-dimensional objective space, the extent of parallelism present in early EMO methods was found to be too generic. Decompositionbased EMO algorithms which divide the overall computing task into a number of sub-tasks of focusing within a region of the search space have found to be successful in solving many-objective problems. In this paper, we term this external control of an algorithm’s parallelism as ‘explicit parallelism’ set by the algorithm developer. Although such a decomposition concept compromises on the implicit parallelism aspect of an EMO algorithm, an externally defined coordination among different subtasks is able to bring back the requisite parallelism needed to solve them. In this paper, we consider three decomposition-based EMO algorithms – MOEA/D, M2M, and NSGA-III – to investigate the effect of user-controlled explicit parallelism mechanism on their search operators. For this purpose, we first consider a number of M2M variants with differing levels of explicit parallelism and identify the most-balanced algorithm between explicit and implicit parallelisms by applying them on a number of standard many-objective unscaled and scaled ∗L. Chen and H.-L. Liu are with Guangdong University of Technology, Guangzhou, China, e-mail: chenaction@126.com, hlliu@gdut.edu.cn. †K. Deb is with Department of Electrical and Computer Engineering and BEACON Center for the Study of Evolution in Action (NSF DBI-0939454), Michigan State University, 428 S. Shaw Lane, 2120 EB, East Lansing, MI 48824, USA, e-mail: kdeb@egr.msu.edu ‡The visit of the first author to Michigan State University was supported by China Scholarship Council. This material is based in part upon work supported by the National Science Foundation under Cooperative Agreement No. DBI-0939454. test problems (DTLZ and WFG problems). Results from our extensive study indicate that by relaxing the decomposition effect, thereby re-establishing an appropriate parallel search within M2M operators, the performance of the resulting M2M variants can be improved. Motivated by the M2M-variant study, we repeat the procedure on NSGA-III and MOEA/D operators and observe interesting but unique balancing acts between explicit and implicit parallelisms that each of the algorithms requires. We also investigate the effect of normalization of objectives in improving the performance of MOEA/D and M2M methods and report much improved performances than the original methods. The overall approach helps to develop more efficient algorithms than the original methods. The principles of this study can be used to improve the performance other EMO methods.

[1]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[2]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[3]  Yiu-ming Cheung,et al.  Objective Extraction for Many-Objective Optimization Problems: Algorithm and Test Problems , 2016, IEEE Transactions on Evolutionary Computation.

[4]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[5]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[6]  Jie Zhang,et al.  A Simple and Fast Hypervolume Indicator-Based Multiobjective Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[7]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[8]  Mark Hoogendoorn,et al.  Parameter Control in Evolutionary Algorithms: Trends and Challenges , 2015, IEEE Transactions on Evolutionary Computation.

[9]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[10]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Luís M. S. Russo,et al.  Quick Hypervolume , 2012, IEEE Transactions on Evolutionary Computation.

[12]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[14]  Carlos A. Coello Coello,et al.  MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator , 2013, 2013 IEEE Congress on Evolutionary Computation.

[15]  Shengxiang Yang,et al.  A Comparative Study on Evolutionary Algorithms for Many-Objective Optimization , 2013, EMO.

[16]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[17]  Kiyoshi Tanaka,et al.  Adaptive Objective Space Partitioning Using Conflict Information for Many-Objective Optimization , 2011, EMO.

[18]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[19]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[20]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[21]  Carlos A. Coello Coello,et al.  Objective reduction using a feature selection technique , 2008, GECCO '08.

[22]  Carlos A. Coello Coello,et al.  Pareto-adaptive -dominance , 2007, Evolutionary Computation.

[23]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[24]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[25]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[26]  Soon-Thiam Khu,et al.  An Investigation on Preference Order Ranking Scheme for Multiobjective Evolutionary Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[27]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[28]  Mario Köppen,et al.  Substitute Distance Assignments in NSGA-II for Handling Many-objective Optimization Problems , 2007, EMO.

[29]  Kalyanmoy Deb,et al.  Multi-objective test problems, linkages, and evolutionary methodologies , 2006, GECCO.

[30]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.

[31]  R. Lyndon While,et al.  A Scalable Multi-objective Test Problem Toolkit , 2005, EMO.

[32]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[33]  Marco Farina,et al.  A fuzzy definition of "optimality" for many-criteria optimization problems , 2004, IEEE Trans. Syst. Man Cybern. Part A.

[34]  Hisao Ishibuchi,et al.  A Similarity-Based Mating Scheme for Evolutionary Multiobjective Optimization , 2003, GECCO.

[35]  Kalyanmoy Deb,et al.  Towards a Quick Computation of Well-Spread Pareto-Optimal Solutions , 2003, EMO.

[36]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[37]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[38]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[39]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[40]  Tong Heng Lee,et al.  Evolutionary algorithms with dynamic population size and local exploration for multiobjective optimization , 2001, IEEE Trans. Evol. Comput..

[41]  Martin J. Oates,et al.  PESA-II: region-based selection in evolutionary multiobjective optimization , 2001 .

[42]  H. Kita,et al.  Failure of Pareto-based MOEAs: does non-dominated really mean near to optimal? , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[43]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[44]  Hisao Ishibuchi,et al.  A multi-objective genetic local search algorithm and its application to flowshop scheduling , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[45]  Peter J. Fleming,et al.  Multiobjective genetic algorithms made easy: selection sharing and mating restriction , 1995 .

[46]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[47]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[48]  Kalyanmoy Deb,et al.  MULTI-OBJECTIVE FUNCTION OPTIMIZATION USING NON-DOMINATED SORTING GENETIC ALGORITHMS , 1994 .

[49]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[50]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[51]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .