Objective reduction based on nonlinear correlation information entropy

It is hard to obtain the entire solution set of a many-objective optimization problem (MaOP) by multi-objective evolutionary algorithms (MOEAs) because of the difficulties brought by the large number of objectives. However, the redundancy of objectives exists in some problems with correlated objectives (linearly or nonlinearly). Objective reduction can be used to decrease the difficulties of some MaOPs. In this paper, we propose a novel objective reduction approach based on nonlinear correlation information entropy (NCIE). It uses the NCIE matrix to measure the linear and nonlinear correlation between objectives and a simple method to select the most conflicting objectives during the execution of MOEAs. We embed our approach into both Pareto-based and indicator-based MOEAs to analyze the impact of our reduction method on the performance of these algorithms. The results show that our approach significantly improves the performance of Pareto-based MOEAs on both reducible and irreducible MaOPs, but does not much help the performance of indicator-based MOEAs.

[1]  Murat Köksalan,et al.  A Territory Defining Multiobjective Evolutionary Algorithms and Preference Incorporation , 2010, IEEE Transactions on Evolutionary Computation.

[2]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[3]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization by NSGA-II and MOEA/D with large populations , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[4]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[5]  Hisao Ishibuchi,et al.  Effects of the Existence of Highly Correlated Objectives on the Behavior of MOEA/D , 2011, EMO.

[6]  Hisao Ishibuchi,et al.  Behavior of EMO algorithms on many-objective optimization problems with correlated objectives , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[7]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[8]  Thomas Hanne,et al.  Consequences of dropping nonessential objectives for the application of MCDM methods , 1999, Eur. J. Oper. Res..

[9]  Ian C. Parmee,et al.  Preferences and their application in evolutionary multiobjective optimization , 2002, IEEE Trans. Evol. Comput..

[10]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[11]  Kiyoshi Tanaka,et al.  Controlling Dominance Area of Solutions and Its Impact on the Performance of MOEAs , 2007, EMO.

[12]  Evan J. Hughes,et al.  Evolutionary many-objective optimisation: many once or one many? , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[14]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[15]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[16]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[17]  Fang Liu,et al.  MOEA/D with uniform decomposition measurement for many-objective problems , 2014, Soft Comput..

[18]  Xiaoyan Sun,et al.  A set-based genetic algorithm for solving the many-objective optimization problem , 2015, Soft Comput..

[19]  Kiyoshi Tanaka,et al.  Objective space partitioning using conflict information for solving many-objective problems , 2014, Inf. Sci..

[20]  Xin Yao,et al.  How well do multi-objective evolutionary algorithms scale to large problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[21]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[22]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[23]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[24]  Eckart Zitzler,et al.  Are All Objectives Necessary? On Dimensionality Reduction in Evolutionary Multiobjective Optimization , 2006, PPSN.

[25]  Eckart Zitzler,et al.  Objective Reduction in Evolutionary Multiobjective Optimization: Theory and Applications , 2009, Evolutionary Computation.

[26]  K. Deb,et al.  On Finding Pareto-Optimal Solutions Through Dimensionality Reduction for Certain Large-Dimensional Multi-Objective Optimization Problems , 2022 .

[27]  Kalyanmoy Deb,et al.  Non-linear Dimensionality Reduction Procedures for Certain Large-Dimensional Multi-objective Optimization Problems: Employing Correntropy and a Novel Maximum Variance Unfolding , 2007, EMO.

[28]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[29]  Rodrigo Quian Quiroga,et al.  Nonlinear multivariate analysis of neurophysiological signals , 2005, Progress in Neurobiology.

[30]  S. Saigal,et al.  Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[32]  Khaled Ghédira,et al.  The r-Dominance: A New Dominance Relation for Interactive Evolutionary Multicriteria Decision Making , 2010, IEEE Transactions on Evolutionary Computation.

[33]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[34]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[35]  Q. Wang,et al.  A nonlinear correlation measure for multivariable data set , 2005 .

[36]  Eun-Soo Kim,et al.  Preference-Based Solution Selection Algorithm for Evolutionary Multiobjective Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[37]  M. Farina,et al.  On the optimal solution definition for many-criteria optimization problems , 2002, 2002 Annual Meeting of the North American Fuzzy Information Processing Society Proceedings. NAFIPS-FLINT 2002 (Cat. No. 02TH8622).

[38]  Peter J. Fleming,et al.  Many-Objective Optimization: An Engineering Design Perspective , 2005, EMO.

[39]  Jouni Lampinen,et al.  Ranking-Dominance and Many-Objective Optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[40]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithm using adaptively generated goal vectors , 2013, 2013 IEEE Congress on Evolutionary Computation.

[41]  Mario Köppen,et al.  Fuzzy-Pareto-Dominance and its Application in Evolutionary Multi-objective Optimization , 2005, EMO.

[42]  Kaisa Miettinen,et al.  A Preference Based Interactive Evolutionary Algorithm for Multi-objective Optimization: PIE , 2011, EMO.

[43]  Patrick M. Reed,et al.  Diagnostic Assessment of Search Controls and Failure Modes in Many-Objective Evolutionary Optimization , 2012, Evolutionary Computation.

[44]  Lakhmi C. Jain,et al.  Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[45]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[46]  Frederico G. Guimarães,et al.  A Non-parametric Harmony-Based Objective Reduction Method for Many-Objective Optimization , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[47]  Kalyanmoy Deb,et al.  Omni-optimizer: A Procedure for Single and Multi-objective Optimization , 2005, EMO.

[48]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[49]  Peter J. Fleming,et al.  Pareto Front Estimation for Decision Making , 2014, Evolutionary Computation.

[50]  Murat Köksalan,et al.  An Interactive Territory Defining Evolutionary Algorithm: iTDEA , 2010, IEEE Transactions on Evolutionary Computation.

[51]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[52]  Kent McClymont,et al.  Deductive Sort and Climbing Sort: New Methods for Non-Dominated Sorting , 2012, Evolutionary Computation.

[53]  Carlos A. Coello Coello,et al.  Recent Trends in Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[54]  Yuping Wang,et al.  An improved $${\alpha }$$α-dominance strategy for many-objective optimization problems , 2016, Soft Comput..

[55]  Khaled Ghédira,et al.  Searching for knee regions of the Pareto front using mobile reference points , 2011, Soft Comput..

[56]  Singiresu S. Rao,et al.  Optimization Theory and Applications , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[57]  Peter J. Fleming,et al.  Evolutionary many-objective optimisation: an exploratory analysis , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[58]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[59]  Evan J. Hughes,et al.  Radar Waveform Optimisation as a Many-Objective Application Benchmark , 2007, EMO.

[60]  Carlos A. Coello Coello,et al.  Objective reduction using a feature selection technique , 2008, GECCO '08.