Feature Subset Selection Using a Self-adaptive Strategy Based Differential Evolution Method

Feature selection is a key step in classification task to prune out redundant or irrelevant information and improve the pattern recognition performance, but it is a challenging and complex combinatorial problem, especially in high dimensional feature selection. This paper proposes a self-adaptive strategy based differential evolution feature selection, abbreviated as SADEFS, in which the self-adaptive elimination and reproduction strategies are used to introduce superior features by considering their contributions in classification under historical records and to replace the poor performance features. The processes of the elimination and reproduction are self-adapted by leaning from their experiences to reduce search space and improve classification accuracy rate. Twelve high dimensional cancer micro-array benchmark datasets are introduced to verify the efficiency of SADEFS algorithm. The experiments indicate that SADEFS can achieve higher classification performance in comparison to the original DEFS algorithm.

[1]  Adel Al-Jumaily,et al.  A Combined Ant Colony and Differential Evolution Feature Selection Algorithm , 2008, ANTS Conference.

[2]  Rami N. Khushaba,et al.  Feature subset selection using differential evolution and a wheel based search strategy , 2013, Swarm Evol. Comput..

[3]  Adel Al-Jumaily,et al.  Adaptive Differential Evolution Based Feature Selection and Parameter Optimization for Advised SVM Classifier , 2015, ICONIP.

[4]  Mengjie Zhang,et al.  Feature Selection to Improve Generalization of Genetic Programming for High-Dimensional Symbolic Regression , 2017, IEEE Transactions on Evolutionary Computation.

[5]  P. Subashini DIFFERENTIAL EVOLUTION AND GENETIC ALGORITHM BASED FEATURE SUBSET SELECTION FOR RECOGNITION OF RIVER ICE TYPES , 2014 .

[6]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[7]  Adel Al-Jumaily,et al.  Feature subset selection using differential evolution and a statistical repair mechanism , 2011, Expert Syst. Appl..

[8]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[9]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[10]  Yuhui Shi,et al.  Brain Storm Optimization Algorithm , 2011, ICSI.

[11]  Behzad Nazari,et al.  Effective pixel classification of Mars images based on ant colony optimization feature selection and extreme learning machine , 2017, Neurocomputing.

[12]  Zakaria Elberrichi,et al.  Feature selection for text classification using genetic algorithms , 2016, 2016 8th International Conference on Modelling, Identification and Control (ICMIC).

[13]  Ben Niu,et al.  A novel bacterial algorithm with randomness control for feature selection in classification , 2017, Neurocomputing.

[14]  F. Agakov,et al.  Application of high-dimensional feature selection: evaluation for genomic prediction in man , 2015, Scientific Reports.

[15]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.