Weak signal detection in hyperspectral imagery using sparse matrix transform (smt) covariance estimation

Many detection algorithms in hyperspectral image analysis, from well-characterized gaseous and solid targets to deliberately uncharacterized anomalies and anomalous changes, depend on accurately estimating the covariance matrix of the background. In practice, the background covariance is estimated from samples in the image, and imprecision in this estimate can lead to a loss of detection power. In this paper, we describe the sparse matrix transform (SMT) and investigate its utility for estimating the covariance matrix from a limited number of samples. The SMT is formed by a product of pairwise coordinate (Givens) rotations. Experiments on hyperspectral data show that the estimate accurately reproduces even small eigenvalues and eigenvectors. In particular, we find that using the SMT to estimate the covariance matrix used in the adaptive matched filter leads to consistently higher signal-to-clutter ratios.

[1]  A. Fraser,et al.  Characterizing non-Gaussian clutter and detecting weak gaseous plumes in hyperspectral imagery , 2005 .

[2]  Antonio De Maio Fast converging adaptive matched filter and adaptive cosine/coherence estimator , 2002, Signal Process..

[3]  Nasser M. Nasrabadi,et al.  Regularization for spectral matched filter and RX anomaly detector , 2008, SPIE Defense + Commercial Sensing.

[4]  R. Kass,et al.  Shrinkage Estimators for Covariance Matrices , 2001, Biometrics.

[5]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  I. Reed,et al.  Rapid Convergence Rate in Adaptive Arrays , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[7]  John P. Kerekes,et al.  Statistics of hyperspectral imaging data , 2001, SPIE Defense + Commercial Sensing.

[8]  Charles A. Bouman,et al.  Covariance Estimation for High Dimensional Data Vectors Using the Sparse Matrix Transform , 2008, NIPS.

[9]  P. Bickel,et al.  Regularized estimation of large covariance matrices , 2008, 0803.1909.

[10]  Olivier Ledoit,et al.  Improved estimation of the covariance matrix of stock returns with an application to portfolio selection , 2003 .

[11]  James Theiler,et al.  Clustering to improve matched filter detection of weak gas plumes in hyperspectral thermal imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[12]  James Theiler,et al.  Quantitative comparison of quadratic covariance-based anomalous change detectors. , 2008, Applied optics.

[13]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[14]  James Theiler,et al.  Improved matched-filter detection techniques , 1999, Optics & Photonics.