Feature extraction based on the Bhattacharyya distance

In this paper, we present a feature extraction method by utilizing an error estimation equation based on the Bhattacharyya distance. We propose to use classification errors in the transformed feature space, which are estimated using the error estimation equation, as a criterion for feature extraction. The construction of linear transformation for feature extraction is conducted using an iterative gradient descent algorithm, so that the estimated classification error is minimized. Due to the ability to predict error, it is possible to determine the minimum number of features required for classification. Experimental results show that the proposed feature extraction method compares favorably with conventional methods.

[1]  Chulhee Lee,et al.  Bayes error evaluation of the Gaussian ML classifier , 2000, IEEE Trans. Geosci. Remote. Sens..

[2]  Kohji Fukunaga,et al.  Introduction to Statistical Pattern Recognition-Second Edition , 1990 .

[3]  Ljubomir J. Buturovic Toward Bayes-Optimal Linear Dimension Reduction , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  David A. Landgrebe,et al.  Feature Extraction Based on Decision Boundaries , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Chulhee Lee,et al.  Feature extraction based on the Bhattacharyya distance , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[6]  Keinosuke Fukunaga,et al.  Application of the Karhunen-Loève Expansion to Feature Selection and Ordering , 1970, IEEE Trans. Computers.

[7]  Chulhee Lee,et al.  Optimizing feature extraction for multiclass problems , 2001, IEEE Trans. Geosci. Remote. Sens..

[8]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .

[9]  Robert P. W. Duin,et al.  Multiclass Linear Dimension Reduction by Weighted Pairwise Fisher Criteria , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  John W. Sammon,et al.  An Optimal Set of Discriminant Vectors , 1975, IEEE Transactions on Computers.

[11]  Alain Biem,et al.  Pattern recognition using discriminative feature extraction , 1997, IEEE Trans. Signal Process..

[12]  L. Biehl,et al.  A crops and soils data base for scene radiation research , 1982 .