A kernel-ensemble bagging support vector machine

This paper proposes a kernel-ensemble bagging SVM classifier for binary class classification. The classifier is advantageous over bagging SVM classifiers because it has a two-phase grid search module, a proposed parameter randomization module and a proposed ranking module. The novel modules enhance the diversity thus improve the performance of the proposed SVM classifier. Six UCI datasets are used to evaluate the proposed kernel-ensemble bagging SVM. The result show that the proposed SVM classifier outperforms the single kernel bagging SVM classifiers.

[1]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Kin Keung Lai,et al.  Investigation of Diversity Strategies in SVM Ensemble Learning , 2008, 2008 Fourth International Conference on Natural Computation.

[4]  Xiaoming Zhang,et al.  On Constructing and Pruning SVM Ensembles , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[5]  Giorgio Valentini,et al.  Cancer recognition with bagged ensembles of support vector machines , 2004, Neurocomputing.

[6]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[7]  Johan A. K. Suykens,et al.  Support vector machines and kernel methods: new approaches in unsupervised learning , 2010 .

[8]  Thomas G. Dietterich.  Machine-Learning Research , 1997, AI Mag..

[9]  Giorgio Valentini,et al.  Low Bias Bagged Support Vector Machines , 2003, ICML.

[10]  Thomas G. Dietterich.  Machine-Learning Research Four Current Directions , 1997 .

[11]  Faisal Zaman,et al.  Double SVMBagging: A New Double Bagging with Support Vector Machine , 2009, Eng. Lett..

[12]  Zhizhong Mao,et al.  Bagging ensemble of SVM based on negative correlation learning , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[13]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[14]  Vasudha Bhatnagar,et al.  An efficient classifier ensemble using SVM , 2009, 2009 Proceeding of International Conference on Methods and Models in Computer Science (ICM2CS).

[15]  Wang Wen-jian.  Approach for kernel selection from SVM ensemble , 2009 .

[16]  A Classifier Research Based on RS Reducts and SVM Ensemble , 2010, 2010 International Symposium on Computational Intelligence and Design.

[17]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[18]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[19]  Xuesong Wang,et al.  An ensemble SVM using entropy-based attribute selection , 2010, 2010 Chinese Control and Decision Conference.