On Handling a Large Number of Objectives A Posteriori and During Optimization

Dimensionality reduction methods are used routinely in statistics, pattern recognition, data mining, and machine learning to cope with high-dimensional spaces. Also in the case of high-dimensional multiobjective optimization problems, a reduction of the objective space can be beneficial both for search and decision making. New questions arise in this context, e.g., how to select a subset of objectives while preserving most of the problem structure. In this chapter, two different approaches to the task of objective reduction are developed, one based on assessing explicit conflicts, the other based on principal component analysis (PCA). Although both methods use different principles and preserve different properties of the underlying optimization problems, they can be effectively utilized either in an a posteriori scenario or during search. Here, we demonstrate the usability of the conflict-based approach in a decision-making scenario after the search and show how the principal-component-based approach can be integrated into an evolutionary multicriterion optimization (EMO) procedure.

[1]  E. Oja,et al.  Independent Component Analysis , 2013 .

[2]  Eckart Zitzler,et al.  Dimensionality Reduction in Multiobjective Optimization: The Minimum Objective Subset Problem , 2006, OR.

[3]  Nicola Beume,et al.  An EMO Algorithm Using the Hypervolume Measure as Selection Criterion , 2005, EMO.

[4]  Kevin Tucker,et al.  Response surface approximation of pareto optimal front in multi-objective optimization , 2004 .

[5]  R. Lyndon While,et al.  A New Analysis of the LebMeasure Algorithm for Calculating Hypervolume , 2005, EMO.

[6]  Thomas Hanne,et al.  Consequences of dropping nonessential objectives for the application of MCDM methods , 1999, Eur. J. Oper. Res..

[7]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[8]  Tong Heng Lee,et al.  Multiobjective Evolutionary Algorithms and Applications , 2005, Advanced Information and Knowledge Processing.

[9]  Ben Paechter,et al.  Timetabling the Classes of an Entire University with an Evolutionary Algorithm , 1998, PPSN.

[10]  Eckart Zitzler,et al.  Are All Objectives Necessary? On Dimensionality Reduction in Evolutionary Multiobjective Optimization , 2006, PPSN.

[11]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection , 1998 .

[12]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[13]  Lucas Bradstreet,et al.  Heuristics for optimizing the calculation of hypervolume for multi-objective optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  Evan J. Hughes,et al.  Radar Waveform Optimisation as a Many-Objective Application Benchmark , 2007, EMO.

[15]  Per Joakim Agrell,et al.  On redundancy in multi criteria decision making , 1997 .

[16]  P. Langley Selection of Relevant Features in Machine Learning , 1994 .

[17]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[18]  I. Jolliffe Principal Component Analysis , 2002 .

[19]  E. Zitzler,et al.  Offline and Online Objective Reduction in Evolutionary Multiobjective Optimization Based on Objective Conflicts , 2007 .

[20]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[21]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection: A Data Mining Perspective , 1998 .

[22]  Carlos M. Fonseca,et al.  An Improved Dimension-Sweep Algorithm for the Hypervolume Indicator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[23]  Carlos A. Coello Coello,et al.  Design of combinational logic circuits through an evolutionary multiobjective optimization approach , 2002, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[24]  Venkatesan Guruswami,et al.  Combinatorial feature selection problems , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[25]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[26]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[27]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[28]  Peter J. Fleming,et al.  Conflict, Harmony, and Independence: Relationships in Evolutionary Multi-criterion Optimisation , 2003, EMO.

[29]  Matthias Ehrgott,et al.  On the number of criteria needed to decide Pareto optimality , 2002, Math. Methods Oper. Res..

[30]  Tomas Gal,et al.  Redundant objective functions in linear vector maximum problems and their determination , 1977 .

[31]  Kalyanmoy Deb,et al.  Non-linear Dimensionality Reduction Procedures for Certain Large-Dimensional Multi-objective Optimization Problems: Employing Correntropy and a Novel Maximum Variance Unfolding , 2007, EMO.

[32]  Nicola Beume,et al.  S-Metric Calculation by Considering Dominated Hypervolume as Klee's Measure Problem , 2009, Evolutionary Computation.

[33]  Kenneth DeJong,et al.  Robust feature selection algorithms , 1993, Proceedings of 1993 IEEE Conference on Tools with Al (TAI-93).

[34]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[35]  David M. Rocke,et al.  Dimension Reduction for Classification with Gene Expression Microarray Data , 2006, Statistical applications in genetics and molecular biology.