On the Influence of the Number of Objectives on the Hardness of a Multiobjective Optimization Problem

In this paper, we study the influence of the number of objectives of a continuous multiobjective optimization problem on its hardness for evolution strategies which is of particular interest for many-objective optimization problems. To be more precise, we measure the hardness in terms of the evolution (or convergence) of the population toward the set of interest, the Pareto set. Previous related studies consider mainly the number of nondominated individuals within a population which greatly improved the understanding of the problem and has led to possible remedies. However, in certain cases this ansatz is not sophisticated enough to understand all phenomena, and can even be misleading. In this paper, we suggest alternatively to consider the probability to improve the situation of the population which can, to a certain extent, be measured by the sizes of the descent cones. As an example, we make some qualitative considerations on a general class of uni-modal test problems and conjecture that these problems get harder by adding an objective, but that this difference is practically not significant, and we support this by some empirical studies. Further, we address the scalability in the number of objectives observed in the literature. That is, we try to extract the challenges for the treatment of many-objective problems for evolution strategies based on our observations and use them to explain recent advances in this field.

[1]  Mario Köppen,et al.  Many-Objective Particle Swarm Optimization by Gradual Leader Selection , 2007, ICANNGA.

[2]  Olivier Teytaud,et al.  On the Hardness of Offline Multi-objective Optimization , 2007, Evolutionary Computation.

[3]  Peter J. Fleming,et al.  Evolutionary many-objective optimisation: an exploratory analysis , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[4]  Kiyoshi Tanaka,et al.  Controlling Dominance Area of Solutions and Its Impact on the Performance of MOEAs , 2007, EMO.

[5]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[6]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[7]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[8]  Kiyoshi Tanaka,et al.  Adaptive ∈-ranking on MNK-Landscapes , 2009, 2009 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making(MCDM).

[9]  E. Hughes.  Multiple single objective Pareto sampling , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[10]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[11]  Marco Farina,et al.  A fuzzy definition of "optimality" for many-criteria optimization problems , 2004, IEEE Trans. Syst. Man Cybern. Part A.

[12]  C. Hillermeier.  Nonlinear Multiobjective Optimization: A Generalized Homotopy Approach , 2001 .

[13]  Eckart Zitzler,et al.  Are All Objectives Necessary? On Dimensionality Reduction in Evolutionary Multiobjective Optimization , 2006, PPSN.

[14]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[15]  Marco Laumanns,et al.  Convergence of stochastic search algorithms to gap-free pareto front approximations , 2007, GECCO '07.

[16]  Sanaz Mostaghim,et al.  Distance Based Ranking in Many-Objective Particle Swarm Optimization , 2008, PPSN.

[17]  M. Koppen,et al.  A fuzzy scheme for the ranking of multivariate data and its application , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[18]  Xin Yao,et al.  How well do multi-objective evolutionary algorithms scale to large problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[19]  Mario Köppen,et al.  Substitute Distance Assignments in NSGA-II for Handling Many-objective Optimization Problems , 2007, EMO.

[20]  Mario Köppen,et al.  Fuzzy-Pareto-Dominance and its Application in Evolutionary Multi-objective Optimization , 2005, EMO.

[21]  Carlos A. Coello Coello,et al.  Online Objective Reduction to Deal with Many-Objective Problems , 2009, EMO.

[22]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[23]  Carlos A. Coello Coello,et al.  HCS: A New Local Search Strategy for Memetic Multiobjective Evolutionary Algorithms , 2010, IEEE Transactions on Evolutionary Computation.

[24]  Anne Auger,et al.  Articulating user preferences in many-objective problems by sampling the weighted hypervolume , 2009, GECCO.

[25]  Eckart Zitzler,et al.  Evolutionary algorithms for multiobjective optimization: methods and applications , 1999 .

[26]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[27]  Frank Neumann,et al.  On the Effects of Adding Objectives to Plateau Functions , 2009, IEEE Transactions on Evolutionary Computation.

[28]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[29]  Jörg Fliege,et al.  Steepest descent methods for multicriteria optimization , 2000, Math. Methods Oper. Res..

[30]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[31]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[32]  Evan J. Hughes,et al.  Evolutionary many-objective optimisation: many once or one many? , 2005, 2005 IEEE Congress on Evolutionary Computation.

[33]  E. Zitzler,et al.  Directed Multiobjective Optimization Based on the Weighted Hypervolume Indicator , 2013 .

[34]  Carlos A. Coello Coello,et al.  Computing finite size representations of the set of approximate solutions of an MOP with stochastic search algorithms , 2008, GECCO '08.

[35]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[36]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[37]  David W. Corne,et al.  Quantifying the Effects of Objective Space Dimension in Evolutionary Multiobjective Optimization , 2007, EMO.

[38]  David W. Corne,et al.  Techniques for highly multiobjective optimisation: some nondominated points are better than others , 2007, GECCO '07.

[39]  Jeffrey Horn,et al.  Multicriterion decision making , 1997 .

[40]  Peter A. N. Bosman,et al.  Exploiting gradient information in numerical multi--objective evolutionary optimization , 2005, GECCO '05.

[41]  P. Winkler.  Random orders , 1985 .

[42]  Tapabrata Ray,et al.  A Study on the Performance of Substitute Distance Based Approaches for Evolutionary Many Objective Optimization , 2008, SEAL.

[43]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[44]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[45]  Marco Laumanns,et al.  Convergence of stochastic search algorithms to finite size pareto set approximations , 2008, J. Glob. Optim..

[46]  G. Rudolph.  On a multi-objective evolutionary algorithm and its convergence to the Pareto set , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[47]  Thomas Hanne,et al.  On the convergence of multiobjective evolutionary algorithms , 1999, Eur. J. Oper. Res..

[48]  Kiyoshi Tanaka,et al.  Many-Objective Optimization by Space Partitioning and Adaptive epsilon-Ranking on MNK-Landscapes , 2009, EMO.

[49]  Marco Laumanns,et al.  Computing Gap Free Pareto Front Approximations with Stochastic Search Algorithms , 2010, Evolutionary Computation.

[50]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[51]  Kalyanmoy Deb,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005, Evolutionary Computation.

[52]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[53]  Claus Hillermeier,et al.  Nonlinear Multiobjective Optimization , 2001 .

[54]  Peter J. Fleming,et al.  Many-Objective Optimization: An Engineering Design Perspective , 2005, EMO.

[55]  H. Fawcett.  Manual of Political Economy , 1995 .