Discriminative Dimensionality Reduction Based on Generalized LVQ

In this paper, a method for the dimensionality reduction, based on generalized learning vector quantization (GLVQ), is applied to handwritten digit recognition. GLVQ is a general framework for classifier design based on the minimum classification error criterion, and it is easy to apply it to dimensionality reduction in feature extraction. Experimental results reveal that the training of both a feature transformation matrix and reference vectors by GLVQ is superior to that by principal component analysis in terms of dimensionality reduction.

[1]  Dennis J. Clague,et al.  New Classes of Synchronous Codes , 1967, IEEE Trans. Electron. Comput..

[2]  Shun-ichi Amari,et al.  A Theory of Adaptive Pattern Classifiers , 1967, IEEE Trans. Electron. Comput..

[3]  A. Sato,et al.  An Analysis of Convergence in Generalized LVQ , 1998 .

[4]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[5]  Ali Mansour,et al.  Blind Separation of Sources , 1999 .

[6]  Atsushi Sato.  An analysis of initial state dependence in generalized LVQ , 1999 .

[7]  Tetsushi Wakabayashi,et al.  Improvement of handwritten Japanese character recognition using weighted direction code histogram , 1997, Pattern Recognit..

[8]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[9]  Cheng-Lin Liu,et al.  Prototype learning algorithms for nearest neighbor classifier with application to handwritten character recognition , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[10]  Alain Biem,et al.  Pattern recognition using discriminative feature extraction , 1997, IEEE Trans. Signal Process..

[11]  Biing-Hwang Juang,et al.  Discriminative learning for minimum error classification [pattern recognition] , 1992, IEEE Trans. Signal Process..

[12]  Mu-King Tsay,et al.  Feature Transformation with Generalized Learning Vector Quantization for Hand-Written Chinese Character Recognition , 1999 .

[13]  Atsushi Sato,et al.  Generalized Learning Vector Quantization , 1995, NIPS.

[14]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[15]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[16]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .