Generalized LDA using relevance weighting and evolution strategy

In pattern classification area, linear discriminant analysis (LDA) is one of the most traditional methods to find a linear solution to the feature extraction problem, which maximise the ratio between between-class scatter and the within class scatter (Fisher's criterion). We propose a variant of LDA which incorporates the class conjunctions thereby making LDA more robust for the problems in which the within class scatter is quite different from one class to another, while retaining all the merits of conventional LDA. We also integrate an evolutionary search procedure in our algorithm to make it more unbiased to the training samples and to improve the robustness.

[1]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[2]  Andreas G. Andreou,et al.  Heteroscedastic discriminant analysis and reduced rank HMMs for improved speech recognition , 1998, Speech Commun..

[3]  Robert P. W. Duin,et al.  Multiclass Linear Dimension Reduction by Weighted Pairwise Fisher Criteria , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Ravi Kothari,et al.  Fractional-Step Dimensionality Reduction , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Manabu Kotani,et al.  Feature extraction using evolutionary computation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[6]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[7]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..

[8]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.