论文信息 - An improved conjugate gradient scheme to the solution of least squares SVM

An improved conjugate gradient scheme to the solution of least squares SVM

The least square support vector machines (LS-SVM) formulation corresponds to the solution of a linear system of equations. Several approaches to its numerical solutions have been proposed in the literature. In this letter, we propose an improved method to the numerical solution of LS-SVM and show that the problem can be solved using one reduced system of linear equations. Compared with the existing algorithm for LS-SVM, the approach used in this letter is about twice as efficient. Numerical results using the proposed method are provided for comparisons with other existing algorithms.

Wei Chu | S. Sathiya Keerthi | Chong Jin Ong

[1] Johan A. K. Suykens,et al. Least Squares Support Vector Machines , 2002 .

[2] John C. Platt,et al. Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[3] Vladimir N. Vapnik,et al. The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[4] R. Fletcher. Practical Methods of Optimization , 1988 .

[5] Johan A. K. Suykens,et al. Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[6] S. Keerthi,et al. SMO Algorithm for Least-Squares SVM Formulations , 2003, Neural Computation.

[7] S. Sathiya Keerthi,et al. Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[8] Thomas J. Hebert,et al. Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm , 1998, IEEE Trans. Image Process..

[9] Johan A. K. Suykens,et al. Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant Analysis , 2002, Neural Computation.

[11] Johan A. K. Suykens,et al. Least squares support vector machine classifiers: a large scale algorithm , 1999 .