Hyperspectral Image Classification With Independent Component Discriminant Analysis

In this paper, the use of Independent Component (IC) Discriminant Analysis (ICDA) for remote sensing classification is proposed. ICDA is a nonparametric method for discriminant analysis based on the application of a Bayesian classification rule on a signal composed by ICs. The method uses IC Analysis (ICA) to choose a transform matrix so that the transformed components are as independent as possible. When the data are projected in an independent space, the estimates of their multivariate density function can be computed in a much easier way as the product of univariate densities. A nonparametric kernel density estimator is used to compute the density functions of each IC. Finally, the Bayes rule is applied for the classification assignment. In this paper, we investigate the possibility of using ICDA for the classification of hyperspectral images. We study the influence of the algorithm used to enforce independence and of the number of IC retained for the classification, proposing an effective method to estimate the most suitable number. The proposed method is applied to several hyperspectral images, in order to test different data set conditions (urban/agricultural area, size of the training set, and type of sensor). Obtained results are compared with one of the most commonly used classifier of hyperspectral images (support vector machines) and show the comparative effectiveness of the proposed method in terms of accuracy.

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  Johannes R. Sveinsson,et al.  Classification and feature extraction of AVIRIS data , 1995, IEEE Trans. Geosci. Remote. Sens..

[3]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[4]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[5]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[6]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[7]  Mihai Datcu,et al.  Multiscale and Dimensionality Behavior of ICA Components for Satellite Image Indexing , 2010, IEEE Geoscience and Remote Sensing Letters.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[10]  M. Rosenblatt.  Stationary sequences and random fields , 1985 .

[11]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2003, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Julian Besag,et al.  Towards Bayesian image analysis , 1993 .

[13]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[14]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[15]  David A. Landgrebe,et al.  Hyperspectral data analysis and supervised feature reduction via projection pursuit , 1999, IEEE Trans. Geosci. Remote. Sens..

[16]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[17]  Jon Atli Benediktsson,et al.  On the use of ICA for hyperspectral image analysis , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[18]  Jon Atli Benediktsson,et al.  Fusion of Support Vector Machines for Classification of Multisensor Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Philip H. Swain,et al.  Remote Sensing: The Quantitative Approach , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  David A. Landgrebe,et al.  HYPERSPECTRAL DATA ANALYSIS AND FEATURE REDUCTION VIA PROJECTION PURSUIT , 1999 .

[21]  G. Foody.  Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[22]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[23]  Gunnar Rätsch,et al.  Invariant Feature Extraction and Classification in Kernel Spaces , 1999, NIPS.

[24]  Julian Besag,et al.  Digital Image Processing: Towards Bayesian image analysis , 1989 .

[25]  J. L. Hodges,et al.  Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties , 1989 .

[26]  Terrence J. Sejnowski,et al.  A Non-linear Information Maximisation Algorithm that Performs Blind Separation , 1994, NIPS.

[27]  Jon Atli Benediktsson,et al.  On the decomposition of Mars hyperspectral data by ICA and Bayesian positive source separation , 2008, Neurocomputing.

[28]  S. Klinke,et al.  Exploratory Projection Pursuit , 1995 .

[29]  Daniel M. Tartakovsky,et al.  Subsurface characterization with support vector machines , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[31]  C. L. Nikias,et al.  Higher-order spectra analysis : a nonlinear signal processing framework , 1993 .

[32]  Luis Alonso,et al.  Robust support vector method for hyperspectral data classification and knowledge discovery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[33]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[34]  Gunnar Rätsch,et al.  Robust Ensemble Learning , 2000 .

[35]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[36]  Bor-Chen Kuo,et al.  A robust classification procedure based on mixture classifiers and nonparametric weighted feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[37]  Farid Melgani,et al.  Gaussian Process Approach to Remote Sensing Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Farid Melgani,et al.  A Multiobjective Genetic SVM Approach for Classification Problems With Limited Training Samples , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[39]  John R. Jensen,et al.  Effect of Continuum Removal on Hyperspectral Coastal Vegetation Classification Using a Fuzzy Learning Vector Quantizer , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[40]  David W. Scott,et al.  Multivariate Density Estimation: Theory, Practice, and Visualization , 1992, Wiley Series in Probability and Statistics.

[41]  David A. Landgrebe,et al.  Covariance estimation with limited training samples , 1999, IEEE Trans. Geosci. Remote. Sens..

[42]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[43]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[45]  Sebastiano B. Serpico,et al.  Introduction to the special issue on analysis of hyperspectral image data , 2001, IEEE Trans. Geosci. Remote. Sens..

[46]  Anthony M. Filippi,et al.  Support Vector Machine-Based Endmember Extraction , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Liangpei Zhang,et al.  A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[49]  A. J. Bell,et al.  A Unifying Information-Theoretic Framework for Independent Component Analysis , 2000 .

[50]  Farid Melgani,et al.  Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[51]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[52]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[54]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Bradley Efron,et al.  Families of Minimax Estimators of the Mean of a Multivariate Normal Distribution , 1976 .

[56]  David A. Landgrebe,et al.  Feature Extraction Based on Decision Boundaries , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[59]  Mark A. Girolami,et al.  Self-Organising Neural Networks: Independent Component Analysis and Blind Source Separation , 1999 .

[60]  Qiong Jackson,et al.  An adaptive classifier design for high-dimensional data analysis with a limited training data set , 2001, IEEE Trans. Geosci. Remote. Sens..

[61]  I. Miller.  Probability, Random Variables, and Stochastic Processes , 1966 .