Clustering to improve matched filter detection of weak gas plumes in hyperspectral thermal imagery

The use of matched filters on hyperspectral data has made it possible to detect faint signatures. This study uses a modified k-means clustering to improve matched filter performance. Several simple bivariate cases are examined in detail, and the interaction of filtering and partitioning is discussed. The authors show that clustering can reduce within-class variance and group pixels with similar correlation structures. Both of these features improve filter performance. The traditional k-means algorithm is modified to work with a sample of the image at each iteration and is tested against two hyperspectral datasets. A new "extreme" centroid initialization technique is introduced and shown to speed convergence. Several matched filtering formulations (the simple matched filter, the clutter matched filter, and the saturated matched filter) are compared for a variety of number of classes and synthetic hyperspectral images. The performance of the various clutter matched filter formulations is similar, all are about an order of magnitude better than the simple matched filter. Clustering is found to improve the performance of all matched filter formulations by a factor of two to five. Clustering in conjunction with clutter matched filtering can improve fifty-fold over the simple case, enabling very weak signals to be detected in hyperspectral images.

[1]  Chein-I Chang,et al.  A posteriori least squares orthogonal subspace projection approach to desired signature extraction and detection , 1997, IEEE Trans. Geosci. Remote. Sens..

[2]  Alan P. Schaum,et al.  Application of stochastic mixing models to hyperspectral detection problems , 1997, Defense, Security, and Sensing.

[3]  E. Forgy Cluster analysis of multivariate data : efficiency versus interpretability of classifications , 1965 .

[4]  J. Lovelock,et al.  Biological modulation of the Earth's atmosphere , 1974 .

[5]  Douglas B. Williams,et al.  Counting the degrees of freedom when using AIC and MDL to detect signals , 1994, IEEE Trans. Signal Process..

[6]  J. Boardman,et al.  Mapping target signatures via partial unmixing of AVIRIS data: in Summaries , 1995 .

[7]  John W. Salisbury,et al.  Thermal infrared remote sensing of crude oil slicks , 1993 .

[8]  Christoph C. Borel,et al.  Temperature estimation and compositional mapping using spectral mixture analysis of thermal imaging spectrometry data , 1999, Optics & Photonics.

[9]  A. Hayden,et al.  Determination of trace-gas amounts in plumes by the use of orthogonal digital filtering of thermal-emission spectra. , 1996, Applied optics.

[10]  IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, VOL. 34. NO. 4, JULY 1996 Universal Multifractal Scaling of Synthetic , 1996 .

[11]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[12]  Margaret E. Gardner,et al.  Mapping Chaparral in the Santa Monica Mountains Using Multiple Endmember Spectral Mixture Models , 1998 .

[13]  Rainer Haus,et al.  Remote sensing and analysis of trace gases from hot aircraft engine plumes using FTIR-emission-spectroscopy , 1994 .

[14]  A. Berk MODTRAN : A moderate resolution model for LOWTRAN7 , 1989 .

[15]  William B. Clodius,et al.  Synthetic hyperspectral data cubes for complex thermal scenes , 1998, Optics & Photonics.

[16]  Xiaoli Yu,et al.  Multidimensional signal processing for electro-optical target detection , 1990 .

[17]  James Theiler,et al.  Contiguity-enhanced k-means clustering algorithm for unsupervised multispectral image segmentation , 1997, Optics & Photonics.

[18]  Shuichi Rokugawa,et al.  A temperature and emissivity separation algorithm for Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) images , 1998, IEEE Trans. Geosci. Remote. Sens..

[19]  Alan D. Stocker,et al.  Multi-dimensional signal processing for electro-optical target detection , 1990, Defense + Commercial Sensing.

[20]  David W. Warren,et al.  LWIR/MWIR imaging hyperspectral sensor for airborne and ground-based remote sensing , 1996, Optics & Photonics.

[21]  A. Gillespie Spectral mixture analysis of multispectral thermal infrared images , 1992 .

[22]  Christoph C. Borel,et al.  Iterative retrieval of surface emissivity and temperature for a hyperspectral sensor , 1997 .

[23]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[24]  James Theiler,et al.  Improved matched-filter detection techniques , 1999, Optics & Photonics.

[25]  R. M. Redheffer,et al.  SOME APPLICATIONS OF MONOTONE OPERATORS IN MARKOV PROCESSES , 1965 .

[26]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[27]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..

[28]  T. Schmugge,et al.  Spectral emissivity variations observed in airborne surface temperature measurements , 1991 .

[29]  P. S. Kealy,et al.  A comparison of techniques for extracting emissivity information from thermal infrared data for geologic studies , 1992 .

[30]  P. S. Kealy,et al.  Separating temperature and emissivity in thermal infrared multispectral scanner data: implications for recovering land surface temperatures , 1993, IEEE Trans. Geosci. Remote. Sens..