Sparse Matrix Transform for Hyperspectral Image Processing

A variety of problems in remote sensing require that a covariance matrix be accurately estimated, often from a limited number of data samples. We investigate the utility of several variants of a recently introduced covariance estimator-the sparse matrix transform (SMT), a shrinkage-enhanced SMT, and a graph-constrained SMT-in the context of several of these problems. In addition to two more generic measures of quality based on likelihood and the Frobenius norm, we specifically consider weak signal detection, dimension reduction, anomaly detection, and anomalous change detection. The estimators are applied to several hyperspectral data sets, including some randomly rotated data, to elucidate the kinds of problems and the kinds of data for which SMT is well or poorly suited. The SMT is based on the product of K pairwise coordinate (Givens) rotations, and we also introduce and compare two novel approaches for estimating the most effective choice for K .

[1]  S. Macenka,et al.  Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1988 .

[2]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[3]  R. Kass,et al.  Shrinkage Estimators for Covariance Matrices , 2001, Biometrics.

[4]  James Theiler,et al.  Improved matched-filter detection techniques , 1999, Optics & Photonics.

[5]  Charles A. Bouman,et al.  Covariance Estimation for High Dimensional Data Vectors Using the Sparse Matrix Transform , 2008, NIPS.

[6]  K. Strimmer,et al.  Statistical Applications in Genetics and Molecular Biology A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics , 2011 .

[7]  Wallace M. Porter,et al.  The airborne visible/infrared imaging spectrometer (AVIRIS) , 1993 .

[8]  David A. Landgrebe,et al.  Analyzing high-dimensional multispectral data , 1993, IEEE Trans. Geosci. Remote. Sens..

[9]  John P. Kerekes,et al.  Development of a Web-Based Application to Evaluate Target Finding Algorithms , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[10]  Charles A. Bouman,et al.  Sparse matrix transform for fast projection to reduced dimension , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[12]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[13]  James Theiler,et al.  Quantitative comparison of quadratic covariance-based anomalous change detectors. , 2008, Applied optics.

[14]  Alan P. Schaum,et al.  Hyperspectral change detection and supervised matched filtering based on covariance equalization , 2004, SPIE Defense + Commercial Sensing.

[15]  J. Wishart THE GENERALISED PRODUCT MOMENT DISTRIBUTION IN SAMPLES FROM A NORMAL MULTIVARIATE POPULATION , 1928 .

[16]  P. Bickel,et al.  Regularized estimation of large covariance matrices , 2008, 0803.1909.

[17]  Don R. Hush,et al.  Statistics for characterizing data on the periphery , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[18]  Charles A. Bouman,et al.  Fast signal analysis and decomposition on graphs using the Sparse Matrix Transform , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Charles A. Bouman,et al.  Weak signal detection in hyperspectral imagery using sparse matrix transform (smt) covariance estimation , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[20]  James Theiler,et al.  Proposed Framework for Anomalous Change Detection , 2006 .

[21]  Nasser M. Nasrabadi,et al.  Regularization for spectral matched filter and RX anomaly detector , 2008, SPIE Defense + Commercial Sensing.

[22]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[24]  J. Friedman Regularized Discriminant Analysis , 1989 .