Handling Imbalance Between Convergence and Diversity in the Decision Space in Evolutionary Multimodal Multiobjective Optimization

There may exist more than one Pareto optimal solution with the same objective vector to a multimodal multiobjective optimization problem (MMOP). The difficulties in finding such solutions can be different. Although a number of evolutionary multimodal multiobjective algorithms (EMMAs) have been proposed, they are unable to solve such an MMOP due to their convergence-first selection criteria. They quickly converge to the Pareto optimal solutions which are easy to find and therefore lose diversity in the decision space. That is, such an MMOP features an imbalance between achieving convergence and preserving diversity in the decision space. In this article, we first present a set of imbalanced distance minimization benchmark problems. Then we propose an evolutionary algorithm using a convergence-penalized density method (CPDEA). In CPDEA, the distances among solutions in the decision space are transformed based on their local convergence quality. Their density values are estimated based on the transformed distances and used as the selection criterion. We compare CPDEA with five state-of-the-art EMMAs on the proposed benchmarks. Our experimental results show that CPDEA is clearly superior in solving these problems.

[1]  Xin Yao,et al.  Evolutionary Multiobjective Optimization-Based Multimodal Optimization: Fitness Landscape Approximation and Peak Detection , 2018, IEEE Transactions on Evolutionary Computation.

[2]  Jing J. Liang,et al.  A novel scalable test problem suite for multimodal multiobjective optimization , 2019, Swarm Evol. Comput..

[3]  O Shoval,et al.  Evolutionary Trade-Offs, Pareto Optimality, and the Geometry of Phenotype Space , 2012, Science.

[4]  Günter Rudolph,et al.  Pareto Set and EMOA Behavior for Simple Multimodal Multiobjective Functions , 2006, PPSN.

[5]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[6]  Xiaodong Li,et al.  Seeking Multiple Solutions: An Updated Survey on Niching Methods and Their Applications , 2017, IEEE Transactions on Evolutionary Computation.

[7]  Jing J. Liang,et al.  Multimodal multiobjective optimization with differential evolution , 2019, Swarm Evol. Comput..

[8]  Gary G. Yen,et al.  Hybrid bi-objective portfolio optimization with pre-selection strategy , 2017, Inf. Sci..

[9]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[10]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[11]  Mario Köppen,et al.  Substitute Distance Assignments in NSGA-II for Handling Many-objective Optimization Problems , 2007, EMO.

[12]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Massimiliano Vasile,et al.  Computing the Set of Epsilon-Efficient Solutions in Multiobjective Space Mission Design , 2011, J. Aerosp. Comput. Inf. Commun..

[14]  Jinhua Zheng,et al.  Achieving balance between proximity and diversity in multi-objective evolutionary algorithm , 2012, Inf. Sci..

[15]  Hisao Ishibuchi,et al.  Many-Objective Test Problems to Visually Examine the Behavior of Multiobjective Evolution in a Decision Space , 2010, PPSN.

[16]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[17]  Kalyanmoy Deb,et al.  Investigating the Effect of Imbalance Between Convergence and Diversity in Evolutionary Multiobjective Algorithms , 2017, IEEE Transactions on Evolutionary Computation.

[18]  Qingfu Zhang,et al.  Approximating the Set of Pareto-Optimal Solutions in Both the Decision and Objective Spaces by an Estimation of Distribution Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[19]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[20]  Yaochu Jin,et al.  Evolutionary Multiobjective Blocking Lot-Streaming Flow Shop Scheduling With Machine Breakdowns , 2019, IEEE Transactions on Cybernetics.

[21]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[22]  Hisao Ishibuchi,et al.  A Decomposition-Based Evolutionary Algorithm for Multi-modal Multi-objective Optimization , 2018, PPSN.

[23]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[24]  Hisao Ishibuchi,et al.  Constrained multiobjective distance minimization problems , 2019, GECCO.

[25]  Gary G. Yen,et al.  A Multimodal Multiobjective Evolutionary Algorithm Using Two-Archive and Recombination Strategies , 2019, IEEE Transactions on Evolutionary Computation.

[26]  Günter Rudolph,et al.  Capabilities of EMOA to Detect and Preserve Equivalent Pareto Subsets , 2007, EMO.

[27]  Jing J. Liang,et al.  Multimodal multi-objective optimization: A preliminary study , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[28]  Ofer M. Shir,et al.  Enhancing Decision Space Diversity in Evolutionary Multiobjective Algorithms , 2009, EMO.

[29]  Lothar Thiele,et al.  Defining and Optimizing Indicator-Based Diversity Measures in Multiobjective Search , 2010, PPSN.

[30]  Yaochu Jin,et al.  A Many-Objective Evolutionary Algorithm Using A One-by-One Selection Strategy , 2017, IEEE Transactions on Cybernetics.

[31]  Francisco Herrera,et al.  Replacement strategies to preserve useful diversity in steady-state genetic algorithms , 2008, Inf. Sci..

[32]  Hisao Ishibuchi,et al.  A Double-Niched Evolutionary Algorithm and Its Behavior on Polygon-Based Problems , 2018, PPSN.

[33]  Tomohiro Yoshikawa,et al.  A study on analysis of design variables in Pareto solutions for conceptual design optimization problem of hybrid rocket engine , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[34]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[35]  Jing J. Liang,et al.  A Multiobjective Particle Swarm Optimizer Using Ring Topology for Solving Multimodal Multiobjective Problems , 2018, IEEE Transactions on Evolutionary Computation.

[36]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[37]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[38]  Xiaoyan Sun,et al.  Many-objective evolutionary optimization based on reference points , 2017, Appl. Soft Comput..

[39]  Kalyanmoy Deb,et al.  Omni-optimizer: A generic evolutionary algorithm for single and multi-objective optimization , 2008, Eur. J. Oper. Res..

[40]  Hisao Ishibuchi,et al.  A many-objective test problem for visually examining diversity maintenance behavior in a decision space , 2011, GECCO '11.

[41]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.