Multimodal Multiobjective Optimization in Feature Selection

In feature selection, the number of selected features and the classification accuracy are two common objectives to be optimized. However, few studies pay attention to which features are selected. In many feature selection problems, different feature subsets with the same number of selected features can achieve similar classification accuracy. These are multimodal multiobjective optimization (MMO) problems in feature selection. In this paper, the MMO problems in feature selection are described in detail. Then, the great significance and importance to find these different feature subsets are discussed. Two modified MMO algorithms are used to solve the MMO feature selection problems. Simulation results show that these MMO algorithms can find more feature subsets than unimodal optimization algorithms.

[1]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[2]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[3]  Jing J. Liang,et al.  Multimodal multiobjective optimization with differential evolution , 2019, Swarm Evol. Comput..

[4]  Kalyanmoy Deb,et al.  Omni-optimizer: A Procedure for Single and Multi-objective Optimization , 2005, EMO.

[5]  Thomas Marill,et al.  On the effectiveness of receptors in recognition systems , 1963, IEEE Trans. Inf. Theory.

[6]  Hisao Ishibuchi,et al.  A many-objective test problem for visually examining diversity maintenance behavior in a decision space , 2011, GECCO '11.

[7]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[8]  Hisao Ishibuchi,et al.  Visual examination of the behavior of EMO algorithms for many-objective optimization with many decision variables , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[9]  Lei Ma,et al.  A Novel Wrapper Approach for Feature Selection in Object-Based Image Classification Using Polygon-Based Cross-Validation , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Kazuyuki Murase,et al.  A new hybrid ant colony optimization algorithm for feature selection , 2012, Expert Syst. Appl..

[11]  Hisao Ishibuchi,et al.  A Decomposition-Based Evolutionary Algorithm for Multi-modal Multi-objective Optimization , 2018, PPSN.

[12]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[13]  Latika Singh,et al.  A hybrid feature selection approach based on improved PSO and filter approaches for image steganalysis , 2016, Int. J. Mach. Learn. Cybern..

[14]  Gary G. Yen,et al.  A Multimodal Multiobjective Evolutionary Algorithm Using Two-Archive and Recombination Strategies , 2019, IEEE Transactions on Evolutionary Computation.

[15]  Rami N. Khushaba,et al.  Feature subset selection using differential evolution and a wheel based search strategy , 2013, Swarm Evol. Comput..

[16]  Antonio Martínez-Álvarez,et al.  Feature selection by multi-objective optimisation: Application to network anomaly detection by hierarchical self-organising maps , 2014, Knowl. Based Syst..

[17]  Kalyanmoy Deb,et al.  Multi-objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems , 1999, Evolutionary Computation.

[18]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[19]  Jing J. Liang,et al.  A Self-organizing Multi-objective Particle Swarm Optimization Algorithm for Multimodal Multi-objective Problems , 2018, ICSI.

[20]  Silvia Casado Yusta,et al.  Different metaheuristic strategies to solve the feature selection problem , 2009, Pattern Recognit. Lett..

[21]  Xu Chen,et al.  A performance-guided JAYA algorithm for parameters identification of photovoltaic cell and module , 2019, Applied Energy.

[22]  Jing J. Liang,et al.  A Multiobjective Particle Swarm Optimizer Using Ring Topology for Solving Multimodal Multiobjective Problems , 2018, IEEE Transactions on Evolutionary Computation.

[23]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[24]  Huan Liu,et al.  A Probabilistic Approach to Feature Selection - A Filter Solution , 1996, ICML.

[25]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[26]  Günter Rudolph,et al.  Capabilities of EMOA to Detect and Preserve Equivalent Pareto Subsets , 2007, EMO.

[27]  Mahdi Eftekhari,et al.  Feature selection using multimodal optimization techniques , 2016, Neurocomputing.

[28]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[29]  Jing J. Liang,et al.  A novel scalable test problem suite for multimodal multiobjective optimization , 2019, Swarm Evol. Comput..

[30]  Jing J. Liang,et al.  Multimodal multi-objective optimization: A preliminary study , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[31]  Zhiwei Ye,et al.  A feature selection method based on modified binary coded ant colony optimization algorithm , 2016, Appl. Soft Comput..