Multimodal Multiobjective Evolutionary Optimization With Dual Clustering in Decision and Objective Spaces

This article suggests a multimodal multiobjective evolutionary algorithm with dual clustering in decision and objective spaces. One clustering is run in decision space to gather nearby solutions, which will classify solutions into multiple local clusters. Nondominated solutions within each local cluster are first selected to maintain local Pareto sets, and the remaining ones with good convergence in objective space are also selected, which will form a temporary population with more than <inline-formula> <tex-math notation="LaTeX">${N}$ </tex-math></inline-formula> solutions (<inline-formula> <tex-math notation="LaTeX">${N}$ </tex-math></inline-formula> is the population size). After that, a second clustering is run in objective space for this temporary population to get <inline-formula> <tex-math notation="LaTeX">${N}$ </tex-math></inline-formula> final clusters with good diversity in objective space. Finally, a pruning process is repeatedly run on the above clusters until each cluster has only one solution, which removes the most crowded solution in decision space from the most crowded cluster in objective space each time. This way, the clustering in decision space can distinguish all Pareto sets and avoid the loss of local Pareto sets, while that in objective space can maintain diversity in objective space. When solving all the benchmark problems from the competition of multimodal multiobjective optimization in the IEEE Congress on Evolutionary Computation 2019, the experiments validate our advantages to maintain diversity in both objective and decision spaces.

[1]  Hisao Ishibuchi,et al.  Handling Imbalance Between Convergence and Diversity in the Decision Space in Evolutionary Multimodal Multiobjective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[2]  Hisao Ishibuchi,et al.  A Review of Evolutionary Multimodal Multiobjective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[3]  Jun Zhang,et al.  Automatic Niching Differential Evolution With Contour Prediction Approach for Multimodal Optimization Problems , 2020, IEEE Transactions on Evolutionary Computation.

[4]  Qingfu Zhang,et al.  Evolutionary Many-Objective Optimization Based on Adversarial Decomposition , 2017, IEEE Transactions on Cybernetics.

[5]  Hisao Ishibuchi,et al.  A Framework to Handle Multi-modal Multi-objective Optimization in Decomposition-based Evolutionary Algorithms , 2020, ArXiv.

[6]  Gary G. Yen,et al.  A Multimodal Multiobjective Evolutionary Algorithm Using Two-Archive and Recombination Strategies , 2019, IEEE Transactions on Evolutionary Computation.

[7]  Jing J. Liang,et al.  A novel scalable test problem suite for multimodal multiobjective optimization , 2019, Swarm Evol. Comput..

[8]  Kuangrong Hao,et al.  A Clustering-Based Adaptive Evolutionary Algorithm for Multiobjective Optimization With Irregular Pareto Fronts , 2019, IEEE Transactions on Cybernetics.

[9]  Hisao Ishibuchi,et al.  A Scalable Multimodal Multiobjective Test Problem , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[10]  Qingfu Zhang,et al.  Learning to Decompose: A Paradigm for Decomposition-Based Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[11]  Maoguo Gong,et al.  A Clustering-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2019, IEEE Transactions on Evolutionary Computation.

[12]  Yuren Zhou,et al.  Evolutionary Many-Objective Optimization Based on Dynamical Decomposition , 2019, IEEE Transactions on Evolutionary Computation.

[13]  Ye Tian,et al.  A Strengthened Dominance Relation Considering Convergence and Diversity for Evolutionary Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[14]  Heike Trautmann,et al.  Multimodality in Multi-objective Optimization - More Boon than Bane? , 2019, EMO.

[15]  Xiangxiang Zeng,et al.  MOEA/HD: A Multiobjective Evolutionary Algorithm Based on Hierarchical Decomposition , 2019, IEEE Transactions on Cybernetics.

[16]  Yaochu Jin,et al.  Evolutionary Multiobjective Blocking Lot-Streaming Flow Shop Scheduling With Machine Breakdowns , 2019, IEEE Transactions on Cybernetics.

[17]  Yi Hu,et al.  A self-organizing multimodal multi-objective pigeon-inspired optimization algorithm , 2019, Science China Information Sciences.

[18]  Jing J. Liang,et al.  A Multiobjective Particle Swarm Optimizer Using Ring Topology for Solving Multimodal Multiobjective Problems , 2018, IEEE Transactions on Evolutionary Computation.

[19]  Hisao Ishibuchi,et al.  A Double-Niched Evolutionary Algorithm and Its Behavior on Polygon-Based Problems , 2018, PPSN.

[20]  Hisao Ishibuchi,et al.  A Decomposition-Based Evolutionary Algorithm for Multi-modal Multi-objective Optimization , 2018, PPSN.

[21]  Jun Zhang,et al.  A Diversity-Enhanced Resource Allocation Strategy for Decomposition-Based Multiobjective Evolutionary Algorithm , 2018, IEEE Transactions on Cybernetics.

[22]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[23]  Hisao Ishibuchi,et al.  Incorporation of a decision space diversity maintenance mechanism into MOEA/D for multi-modal multi-objective optimization , 2018, GECCO.

[24]  Dirk Thierens,et al.  Real-valued evolutionary multi-modal optimization driven by hill-valley clustering , 2018, GECCO.

[25]  Jing J. Liang,et al.  A Self-organizing Multi-objective Particle Swarm Optimization Algorithm for Multimodal Multi-objective Problems , 2018, ICSI.

[26]  Yong Wang,et al.  Scalarizing Functions in Decomposition-Based Multiobjective Evolutionary Algorithms , 2018, IEEE Transactions on Evolutionary Computation.

[27]  Qingfu Zhang,et al.  On Tchebycheff Decomposition Approaches for Multiobjective Evolutionary Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[28]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[29]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[30]  Jing J. Liang,et al.  Multimodal multi-objective optimization: A preliminary study , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[31]  Carlos A. Coello Coello,et al.  The directed search method for multi-objective memetic algorithms , 2015, Computational Optimization and Applications.

[32]  Sébastien Vérel,et al.  Global vs Local Search on Multi-objective NK-Landscapes: Contrasting the Impact of Problem Features , 2015, GECCO.

[33]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[34]  Hong Li,et al.  A modification to MOEA/D-DE for multiobjective optimization problems with complicated Pareto sets , 2012, Inf. Sci..

[35]  Tomohiro Yoshikawa,et al.  A study on analysis of design variables in Pareto solutions for conceptual design optimization problem of hybrid rocket engine , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[36]  Massimiliano Vasile,et al.  Computing the Set of Epsilon-Efficient Solutions in Multiobjective Space Mission Design , 2011, J. Aerosp. Comput. Inf. Commun..

[37]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[38]  Oliver Kramer,et al.  DBSCAN-based multi-objective niching to approximate equivalent pareto-subsets , 2010, GECCO '10.

[39]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[40]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[41]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[42]  Carlos A. Coello Coello,et al.  A new memetic strategy for the numerical treatment of multi-objective optimization problems , 2008, GECCO '08.

[43]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[44]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[45]  P. N. Suganthan,et al.  Multiobjective Differential Evolution with External Archive and Harmonic Distance-Based Diversity Measure , 2007 .

[46]  Kalyanmoy Deb,et al.  Omni-optimizer: A Procedure for Single and Multi-objective Optimization , 2005, EMO.

[47]  Tomoyuki Hiroyasu,et al.  SPEA2+: Improving the Performance of the Strength Pareto Evolutionary Algorithm 2 , 2004, PPSN.

[48]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[49]  Dirk Thierens,et al.  The balance between proximity and diversity in multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[50]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[51]  H. Kita,et al.  A crossover operator using independent component analysis for real-coded genetic algorithms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[52]  Qguhm -DVNLHZLF On the performance of multiple objective genetic local search on the 0 / 1 knapsack problem . A comparative experiment , 2000 .

[53]  R. K. Ursem Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[54]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[55]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[56]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[57]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[58]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .