Diversity Assessment in Many-Objective Optimization

Maintaining diversity is one important aim of multiobjective optimization. However, diversity for many-objective optimization problems is less straightforward to define than for multiobjective optimization problems. Inspired by measures for biodiversity, we propose a new diversity metric for many-objective optimization, which is an accumulation of the dissimilarity in the population, where an <inline-formula> <tex-math notation="LaTeX">$ L_{ p}$ </tex-math></inline-formula>-norm-based (<inline-formula> <tex-math notation="LaTeX">$\,{ p}{ <}{ 1}$ </tex-math></inline-formula>) distance is adopted to measure the dissimilarity of solutions. Empirical results demonstrate our proposed metric can more accurately assess the diversity of solutions in various situations. We compare the diversity of the solutions obtained by four popular many-objective evolutionary algorithms using the proposed diversity metric on a large number of benchmark problems with two to ten objectives. The behaviors of different diversity maintenance methodologies in those algorithms are discussed in depth based on the experimental results. Finally, we show that the proposed diversity measure can also be employed for enhancing diversity maintenance or reference set generation in many-objective optimization.

[1]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[2]  Huan Liu,et al.  Subspace clustering for high dimensional data: a review , 2004, SKDD.

[3]  Fang Liu,et al.  A Memetic Optimization Strategy Based on Dimension Reduction in Decision Space , 2015, Evolutionary Computation.

[4]  Markus Wagner,et al.  A fast approximation-guided evolutionary multi-objective algorithm , 2013, GECCO '13.

[5]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[6]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[7]  Peter J. Fleming,et al.  Generalized decomposition and cross entropy methods for many-objective optimization , 2014, Inf. Sci..

[8]  Ye Tian,et al.  An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[9]  A. Solow,et al.  On the measurement of biological diversity , 1993 .

[10]  Eun-Soo Kim,et al.  Preference-Based Solution Selection Algorithm for Evolutionary Multiobjective Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[11]  Günter Rudolph,et al.  Evenly spaced Pareto fronts of quad-objective problems using PSA partitioning technique , 2013, 2013 IEEE Congress on Evolutionary Computation.

[12]  K. Deb,et al.  On Finding Pareto-Optimal Solutions Through Dimensionality Reduction for Certain Large-Dimensional Multi-Objective Optimization Problems , 2022 .

[13]  Günter Rudolph,et al.  Evenly Spaced Pareto Front Approximations for Tricriteria Problems Based on Triangulation , 2013, EMO.

[14]  Shapour Azarm,et al.  Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set , 2001 .

[15]  Kiyoshi Tanaka,et al.  Controlling Dominance Area of Solutions and Its Impact on the Performance of MOEAs , 2007, EMO.

[16]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[17]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[18]  Kalyanmoy Deb,et al.  A dual-population paradigm for evolutionary multiobjective optimization , 2015, Inf. Sci..

[19]  Hisao Ishibuchi,et al.  Effects of the Existence of Highly Correlated Objectives on the Behavior of MOEA/D , 2011, EMO.

[20]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[21]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[22]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Lucas Bradstreet,et al.  A Fast Way of Calculating Exact Hypervolumes , 2012, IEEE Transactions on Evolutionary Computation.

[24]  Eckart Zitzler,et al.  A Hypervolume-Based Optimizer for High-Dimensional Objective Spaces , 2010 .

[25]  Carlos A. Coello Coello,et al.  A new multi-objective evolutionary algorithm based on a performance assessment indicator , 2012, GECCO.

[26]  Kalyanmoy Deb,et al.  Omni-optimizer: A Procedure for Single and Multi-objective Optimization , 2005, EMO.

[27]  Carlos A. Coello Coello,et al.  MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  Heike Trautmann,et al.  Optimal averaged Hausdorff archives for bi-objective problems: theoretical and numerical results , 2016, Comput. Optim. Appl..

[29]  D.A. Van Veldhuizen,et al.  On measuring multiobjective evolutionary algorithm performance , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[30]  Carlos A. Coello Coello,et al.  A ranking method based on the R2 indicator for many-objective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[31]  Ian C. Parmee,et al.  Preferences and their application in evolutionary multiobjective optimization , 2002, IEEE Trans. Evol. Comput..

[32]  Peter J. Fleming,et al.  Many-Objective Optimization: An Engineering Design Perspective , 2005, EMO.

[33]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[34]  Jouni Lampinen,et al.  Ranking-Dominance and Many-Objective Optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[35]  Tong Heng Lee,et al.  Evolutionary Algorithms for Multi-Objective Optimization: Performance Assessments and Comparisons , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[36]  Kalyanmoy Deb,et al.  Running performance metrics for evolutionary multi-objective optimizations , 2002 .

[37]  Emiliano Carreño Jara Multi-Objective Optimization by Using Evolutionary Algorithms: The $p$-Optimality Criteria , 2014, IEEE Trans. Evol. Comput..

[38]  Handing Wang,et al.  Optimizing trauma system design: The GEOS (Geospatial Evaluation of Systems of Trauma Care) approach , 2014, The journal of trauma and acute care surgery.

[39]  Lucas Bradstreet,et al.  A fast many-objective hypervolume algorithm using iterated incremental calculations , 2010, IEEE Congress on Evolutionary Computation.

[40]  Maoguo Gong,et al.  Multiobjective Immune Algorithm with Nondominated Neighbor-Based Selection , 2008, Evolutionary Computation.

[41]  Beurling Function SOME PROPERTIES OF THE , 2000 .

[42]  Shengxiang Yang,et al.  Pareto or Non-Pareto: Bi-Criterion Evolution in Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[43]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[44]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[45]  Kent McClymont,et al.  Deductive Sort and Climbing Sort: New Methods for Non-Dominated Sorting , 2012, Evolutionary Computation.

[46]  Charu C. Aggarwal,et al.  On the Surprising Behavior of Distance Metrics in High Dimensional Spaces , 2001, ICDT.

[47]  Jürgen Teich,et al.  A New Approach on Many Objective Diversity Measurement , 2005, Practical Approaches to Multi-Objective Optimization.

[48]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[49]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[50]  Xin Yao,et al.  Objective reduction based on nonlinear correlation information entropy , 2016, Soft Comput..

[51]  Shengxiang Yang,et al.  Diversity Comparison of Pareto Front Approximations in Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[52]  Carlos A. Coello Coello,et al.  Using the Averaged Hausdorff Distance as a Performance Measure in Evolutionary Multiobjective Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[53]  Tong Heng Lee,et al.  Evolutionary Algorithms for Multi-Objective Optimization: Performance Assessments and Comparisons , 2004, Artificial Intelligence Review.

[54]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[55]  Heike Trautmann,et al.  On the properties of the R2 indicator , 2012, GECCO '12.

[56]  Gary G. Yen,et al.  Performance Metric Ensemble for Multiobjective Evolutionary Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[57]  Jing Liu,et al.  Learning of Fuzzy Cognitive Maps With Varying Densities Using A Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Fuzzy Systems.

[58]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[59]  Eckart Zitzler,et al.  Are All Objectives Necessary? On Dimensionality Reduction in Evolutionary Multiobjective Optimization , 2006, PPSN.

[60]  Eckart Zitzler,et al.  Objective Reduction in Evolutionary Multiobjective Optimization: Theory and Applications , 2009, Evolutionary Computation.

[61]  Sanghamitra Bandyopadhyay,et al.  Multiobjective GAs, quantitative indices, and pattern classification , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[62]  Lothar Thiele,et al.  A Preference-Based Evolutionary Algorithm for Multi-Objective Optimization , 2009, Evolutionary Computation.

[63]  Xin Yao,et al.  How well do multi-objective evolutionary algorithms scale to large problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[64]  Marcus Gallagher,et al.  Sampling Techniques and Distance Metrics in High Dimensional Continuous Landscape Analysis: Limitations and Improvements , 2014, IEEE Transactions on Evolutionary Computation.

[65]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[66]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[67]  A. Farhang-Mehr,et al.  Diversity assessment of Pareto optimal solution sets: an entropy approach , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[68]  Karl Bringmann,et al.  Bringing Order to Special Cases of Klee's Measure Problem , 2013, MFCS.

[69]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[70]  Carlos A. Coello Coello,et al.  Objective reduction using a feature selection technique , 2008, GECCO '08.

[71]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[72]  Markus Wagner,et al.  Approximation-Guided Evolutionary Multi-Objective Optimization , 2011, IJCAI.

[73]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[74]  Mario Köppen,et al.  Fuzzy-Pareto-Dominance and its Application in Evolutionary Multi-objective Optimization , 2005, EMO.

[75]  Kaisa Miettinen,et al.  A Preference Based Interactive Evolutionary Algorithm for Multi-objective Optimization: PIE , 2011, EMO.

[76]  Yaonan Wang,et al.  Multi-objective self-adaptive differential evolution with elitist archive and crowding entropy-based diversity measure , 2010, Soft Comput..

[77]  Patrick M. Reed,et al.  Diagnostic Assessment of Search Controls and Failure Modes in Many-Objective Evolutionary Optimization , 2012, Evolutionary Computation.

[78]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[79]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[80]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[81]  Wei Li,et al.  Resource allocation model and double-sphere crowding distance for evolutionary multi-objective optimization , 2014, Eur. J. Oper. Res..

[82]  Kalyanmoy Deb,et al.  Non-linear Dimensionality Reduction Procedures for Certain Large-Dimensional Multi-objective Optimization Problems: Employing Correntropy and a Novel Maximum Variance Unfolding , 2007, EMO.

[83]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[84]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..