Indicator-based Multi-objective Evolutionary Algorithms

For over 25 years, most multi-objective evolutionary algorithms (MOEAs) have adopted selection criteria based on Pareto dominance. However, the performance of Pareto-based MOEAs quickly degrades when solving multi-objective optimization problems (MOPs) having four or more objective functions (the so-called many-objective optimization problems), mainly because of the loss of selection pressure. Consequently, in recent years, MOEAs have been coupled with indicator-based selection mechanisms in furtherance of increasing the selection pressure so that they can properly solve many-objective optimization problems. Several research efforts have been conducted since 2003 regarding the design of the so-called indicator-based (IB) MOEAs. In this article, we present a comprehensive survey of IB-MOEAs for continuous search spaces since their origins up to the current state-of-the-art approaches. We propose a taxonomy that classifies IB-mechanisms into two main categories: (1) IB-Selection (which is divided into IB-Environmental Selection, IB-Density Estimation, and IB-Archiving) and (2) IB-Mating Selection. Each of these classes is discussed in detail in this article, emphasizing the advantages and drawbacks of the selection mechanisms. In the final part, we provide some possible paths for future research.

[1]  Günter Rudolph,et al.  Evenly spaced Pareto fronts of quad-objective problems using PSA partitioning technique , 2013, 2013 IEEE Congress on Evolutionary Computation.

[2]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[3]  Carlos A. Coello Coello,et al.  A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm , 2004, MICAI.

[4]  M. Farina,et al.  On the optimal solution definition for many-criteria optimization problems , 2002, 2002 Annual Meeting of the North American Fuzzy Information Processing Society Proceedings. NAFIPS-FLINT 2002 (Cat. No. 02TH8622).

[5]  Gary G. Yen,et al.  Performance Metric Ensemble for Multiobjective Evolutionary Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[6]  Carlos A. Coello Coello,et al.  Improved Metaheuristic Based on the R2 Indicator for Many-Objective Optimization , 2015, GECCO.

[7]  Hisao Ishibuchi,et al.  Reference point specification in hypervolume calculation for fair comparison and efficient search , 2017, GECCO.

[8]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[9]  M. Hansen,et al.  Evaluating the quality of approximations to the non-dominated set , 1998 .

[10]  Kiyoshi Tanaka,et al.  Controlling Dominance Area of Solutions and Its Impact on the Performance of MOEAs , 2007, EMO.

[11]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[12]  Carlos A. Coello Coello,et al.  A hyper-heuristic of scalarizing functions , 2017, GECCO.

[13]  Liang Feng,et al.  Adaptive indicator-based evolutionary algorithm for multiobjective optimization problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[14]  Stacey L. Faulkenberg,et al.  On the quality of discrete representations in multiple objective programming , 2010 .

[15]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[16]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[17]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[18]  Joshua D. Knowles,et al.  On metrics for comparing nondominated sets , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[19]  Adriana Menchaca-Mendez,et al.  Δp-MOEA: A new multi-objective evolutionary algorithm based on the Δp indicator , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[20]  Hisao Ishibuchi,et al.  Indicator-based evolutionary algorithm with hypervolume approximation by achievement scalarizing functions , 2010, GECCO '10.

[21]  Adriana Menchaca-Mendez,et al.  An alternative hypervolume-based selection mechanism for multi-objective evolutionary algorithms , 2017, Soft Comput..

[22]  Ruhul A. Sarker,et al.  Assessment Methodologies for Multiobjective Evolutionary Algorithms , 2003 .

[23]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[24]  Ye Tian,et al.  A multi-objective evolutionary algorithm based on an enhanced inverted generational distance metric , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[25]  Adriana Menchaca-Mendez,et al.  A new selection mechanism based on hypervolume and its locality property , 2013, 2013 IEEE Congress on Evolutionary Computation.

[26]  G. Rudolph,et al.  Finding evenly spaced fronts for multiobjective control via averaging Hausdorff-measure , 2011, 2011 8th International Conference on Electrical Engineering, Computing Science and Automatic Control.

[27]  Laurent Lemaitre,et al.  The Design of Hybrid Fuzzy/Evolutionary Multiobjevtive Optimization Algorithms , 1995, IEEE/Nagoya-University World Wisepersons Workshop.

[28]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[29]  Carlos A. Coello Coello,et al.  Study of preference relations in many-objective optimization , 2009, GECCO.

[30]  Joshua D. Knowles,et al.  Bounded archiving using the lebesgue measure , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[31]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[32]  Markus Wagner,et al.  A fast approximation-guided evolutionary multi-objective algorithm , 2013, GECCO '13.

[33]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[34]  Michael T. M. Emmerich,et al.  On Quality Indicators for Black-Box Level Set Approximation , 2013, EVOLVE.

[35]  Lino A. Costa,et al.  Many-objective optimization using differential evolution with variable-wise mutation restriction , 2013, GECCO '13.

[36]  Carlos A. Brizuela,et al.  A survey on multi-objective evolutionary algorithms for many-objective problems , 2014, Comput. Optim. Appl..

[37]  Lucas Bradstreet,et al.  A Fast Way of Calculating Exact Hypervolumes , 2012, IEEE Transactions on Evolutionary Computation.

[38]  Hisao Ishibuchi,et al.  Iterative approach to indicator-based multiobjective optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[39]  Hisao Ishibuchi,et al.  A new R2 indicator for better hypervolume approximation , 2018, GECCO.

[40]  Gary B. Lamont,et al.  Genetic Algorithms, Building Blocks, and Multiobjective Optimization , 1999 .

[41]  Hisao Ishibuchi,et al.  Difficulties in specifying reference points to calculate the inverted generational distance for many-objective optimization problems , 2014, 2014 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM).

[42]  Lucas Bradstreet,et al.  Maximising Hypervolume for Selection in Multi-objective Evolutionary Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[43]  Günter Rudolph,et al.  Finding Evenly Spaced Pareto Fronts for Three-Objective Optimization Problems , 2012, EVOLVE.

[44]  Rolf Drechsler,et al.  Multi-objected Optimization in Evolutionary Algorithms Using Satisfiability Classes , 1999, Fuzzy Days.

[45]  Günter Rudolph,et al.  Evenly Spaced Pareto Front Approximations for Tricriteria Problems Based on Triangulation , 2013, EMO.

[46]  Shapour Azarm,et al.  Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set , 2001 .

[47]  Michael T. M. Emmerich,et al.  Test Problems Based on Lamé Superspheres , 2007, EMO.

[48]  Carlos A. Coello Coello,et al.  A multi-objective evolutionary hyper-heuristic based on multiple indicator-based density estimators , 2018, GECCO.

[49]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[50]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[51]  Markus Wagner,et al.  A modified indicator-based evolutionary algorithm (mIBEA) , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[52]  Adriana Menchaca-Mendez,et al.  GD-MOEA: A New Multi-Objective Evolutionary Algorithm Based on the Generational Distance Indicator , 2015, EMO.

[53]  D.A. Van Veldhuizen,et al.  On measuring multiobjective evolutionary algorithm performance , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[54]  Carlos A. Coello Coello,et al.  A ranking method based on the R2 indicator for many-objective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[55]  Anne Auger,et al.  Articulating user preferences in many-objective problems by sampling the weighted hypervolume , 2009, GECCO.

[56]  Carlos A. Coello Coello,et al.  Towards a More General Many-objective Evolutionary Optimizer , 2018, PPSN.

[57]  Hisao Ishibuchi,et al.  Dynamic Specification of a Reference Point for Hypervolume Calculation in SMS-EMOA , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[58]  Junichi Suzuki,et al.  Boosting Indicator-Based Selection Operators for Evolutionary Multiobjective Optimization Algorithms , 2011, 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence.

[59]  Tobias Friedrich,et al.  Approximating the least hypervolume contributor: NP-hard in general, but fast in practice , 2008, Theor. Comput. Sci..

[60]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[61]  Adriana Menchaca-Mendez,et al.  GDE-MOEA: A new MOEA based on the generational distance indicator and ε-dominance , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[62]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[63]  Carlos A. Coello Coello,et al.  Using the Averaged Hausdorff Distance as a Performance Measure in Evolutionary Multiobjective Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[64]  Bilel Derbel,et al.  A Correlation Analysis of Set Quality Indicator Values in Multiobjective Optimization , 2016, GECCO.

[65]  Hisao Ishibuchi,et al.  Hypervolume approximation using achievement scalarizing functions for evolutionary many-objective optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[66]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[67]  Carlos A. Coello Coello,et al.  A new multi-objective evolutionary algorithm based on a performance assessment indicator , 2012, GECCO.

[68]  Carlos A. Coello Coello,et al.  MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator , 2013, 2013 IEEE Congress on Evolutionary Computation.

[69]  Lothar Thiele,et al.  The Hypervolume Indicator Revisited: On the Design of Pareto-compliant Indicators Via Weighted Integration , 2007, EMO.

[70]  Kaisa Miettinen,et al.  An Interactive Simple Indicator-Based Evolutionary Algorithm (I-SIBEA) for Multiobjective Optimization Problems , 2015, EMO.

[71]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[72]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[73]  Ernest S. Kuh,et al.  Design space exploration using the genetic algorithm , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[74]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[75]  Heike Trautmann,et al.  2 Indicator-Based Multiobjective Search , 2015, Evolutionary Computation.

[76]  Fei Li,et al.  A two-stage R2 indicator based evolutionary algorithm for many-objective optimization , 2018, Appl. Soft Comput..

[77]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017 .

[78]  Junichi Suzuki,et al.  R2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[79]  Jie Zhang,et al.  Consistencies and Contradictions of Performance Metrics in Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[80]  Peter J. Fleming,et al.  On the Performance Assessment and Comparison of Stochastic Multiobjective Optimizers , 1996, PPSN.

[81]  Mark Fleischer,et al.  The measure of pareto optima: Applications to multi-objective metaheuristics , 2003 .

[82]  Zhang Yi,et al.  IGD Indicator-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[83]  Enrique Alba,et al.  A Multi-Objective Evolutionary Algorithm based on Parallel Coordinates , 2016, GECCO.

[84]  Xin Yao,et al.  of Birmingham Quality evaluation of solution sets in multiobjective optimisation , 2019 .

[85]  Jie Zhang,et al.  A Simple and Fast Hypervolume Indicator-Based Multiobjective Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[86]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[87]  David W. Corne,et al.  Properties of an adaptive archiving algorithm for storing nondominated vectors , 2003, IEEE Trans. Evol. Comput..

[88]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[89]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[90]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[91]  Heike Trautmann,et al.  On the properties of the R2 indicator , 2012, GECCO '12.

[92]  Carlos A. Coello Coello,et al.  An Overview of Weighted and Unconstrained Scalarizing Functions , 2017, EMO.

[93]  Thomas Stützle,et al.  An Empirical Assessment of the Properties of Inverted Generational Distance on Multi- and Many-Objective Optimization , 2017, EMO.

[94]  Lothar Thiele,et al.  Indicator-Based Selection , 2015, Handbook of Computational Intelligence.

[95]  Eckart Zitzler,et al.  Integrating decision space diversity into hypervolume-based multiobjective search , 2010, GECCO '10.

[96]  Hisao Ishibuchi,et al.  Modified Distance Calculation in Generational Distance and Inverted Generational Distance , 2015, EMO.

[97]  Xin Yao,et al.  Stochastic Ranking Algorithm for Many-Objective Optimization Based on Multiple Indicators , 2016, IEEE Transactions on Evolutionary Computation.

[98]  Luigi Barone,et al.  An evolution strategy with probabilistic mutation for multi-objective optimisation , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[99]  Lothar Thiele,et al.  Quality Assessment of Pareto Set Approximations , 2008, Multiobjective Optimization.

[100]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[101]  Markus Wagner,et al.  Approximation-Guided Evolutionary Multi-Objective Optimization , 2011, IJCAI.

[102]  Carlos A. Coello Coello,et al.  IGD+-EMOA: A multi-objective evolutionary algorithm based on IGD+ , 2016, CEC.

[103]  Bilel Derbel,et al.  Experiments on Greedy and Local Search Heuristics for ddimensional Hypervolume Subset Selection , 2016, GECCO.

[104]  Carlos A. Coello Coello,et al.  An improved version of a reference-based multi-objective evolutionary algorithm based on IGD+ , 2018, GECCO.

[105]  Karl Bringmann,et al.  Two-dimensional subset selection for hypervolume and epsilon-indicator , 2014, GECCO.

[106]  Zhihua Cai,et al.  Enhance the Convergence and Diversity for epsilon-MOPSO by Uniform Design and Minimum Reduce Hypervolume , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[107]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[108]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[109]  Lothar Thiele,et al.  A Comparison of Selection Schemes used in Genetic Algorithms , 1995 .

[110]  Marco Laumanns,et al.  A Tutorial on Evolutionary Multiobjective Optimization , 2004, Metaheuristics for Multiobjective Optimisation.

[111]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[112]  Saúl Zapotecas Martínez,et al.  Using a Family of Curves to Approximate the Pareto Front of a Multi-Objective Optimization Problem , 2014, PPSN.

[113]  Tong Heng Lee,et al.  Evolutionary Algorithms for Multi-Objective Optimization: Performance Assessments and Comparisons , 2004, Artificial Intelligence Review.

[114]  Isao Hayashi,et al.  Leveraging indicator-based ensemble selection in evolutionary multiobjective optimization algorithms , 2012, GECCO '12.

[115]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..