An Overview of Background Modeling for Detection of Targets and Anomalies in Hyperspectral Remotely Sensed Imagery

This paper reviews well-known classic algorithms and more recent experimental approaches for distinguishing the weak signal of a target (either known or anomalous) from the cluttered background of a hyperspectral image. Making this distinction requires characterization of the targets and characterization of the backgrounds, and our emphasis in this review is on the backgrounds. We describe a variety of background modeling strategies-Gaussian and non-Gaussian, global and local, generative and discriminative, parametric and nonparametric, spectral and spatio-spectral-in the context of how they relate to the target and anomaly detection problems. We discuss the major issues addressed by these algorithms, and some of the tradeoffs made in choosing an effective algorithm for a given detection application. We identify connections among these algorithms and point out directions where innovative modeling strategies may be developed into detection algorithms that are more sensitive and reliable.

[1]  N. Campbell.  Robust Procedures in Multivariate Analysis I: Robust Covariance Estimation , 1980 .

[2]  A non-parametric approach to anomaly detection in hyperspectral images , 2010, Remote Sensing.

[3]  Don R. Hush,et al.  Statistics for characterizing data on the periphery , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[4]  Louis L. Scharf,et al.  Matched subspace detectors , 1994, IEEE Trans. Signal Process..

[5]  Heesung Kwon,et al.  Optimal kernel bandwidth estimation for hyperspectral kernel-based anomaly detection , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[6]  S Matteoli,et al.  A tutorial overview of anomaly detection in hyperspectral images , 2010, IEEE Aerospace and Electronic Systems Magazine.

[7]  Nasser M. Nasrabadi,et al.  Hyperspectral Target Detection : An Overview of Current and Future Challenges , 2014, IEEE Signal Processing Magazine.

[8]  Stefania Matteoli,et al.  Improved estimation of local background covariance matrix for anomaly detection in hyperspectral images , 2010 .

[9]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[10]  Dimitris G. Manolakis,et al.  Hyperspectral detection algorithms: use covariances or subspaces? , 2009, Optical Engineering + Applications.

[11]  Xiuping Jia,et al.  A New Target Detector for Hyperspectral Data Using Cointegration Theory , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Gary A. Shaw,et al.  Hyperspectral subpixel target detection using the linear mixing model , 2001, IEEE Trans. Geosci. Remote. Sens..

[13]  Karl Gerlach,et al.  The effects of signal contamination on two adaptive detectors , 1995 .

[14]  Saeid Homayouni,et al.  An Approach for Subpixel Anomaly Detection in Hyperspectral Images , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[16]  Li Ma,et al.  Anomaly Detection for Hyperspectral Images Based on Robust Locally Linear Embedding , 2010 .

[17]  Katrien van Driessen,et al.  A Fast Algorithm for the Minimum Covariance Determinant Estimator , 1999, Technometrics.

[18]  Charles A. Bouman,et al.  Evaluating and improving local hyperspectral anomaly detectors , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[19]  John Ingram,et al.  Hyperspectral anomaly detection based on minimum generalized variance method , 2008, SPIE Defense + Commercial Sensing.

[20]  Trac D. Tran,et al.  Kernel sparse representation for hyperspectral target detection , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Dimitris G. Manolakis,et al.  Using elliptically contoured distributions to model hyperspectral imaging data and generate statistically similar synthetic data , 2004, SPIE Defense + Commercial Sensing.

[22]  Peyman Milanfar,et al.  Patch-Based Near-Optimal Image Denoising , 2012, IEEE Transactions on Image Processing.

[23]  D.G. Tzikas,et al.  The variational approximation for Bayesian inference , 2008, IEEE Signal Processing Magazine.

[24]  Dirk Borghys,et al.  Nonsingular approximations for a singular covariance matrix , 2012, Defense + Commercial Sensing.

[25]  John R. Schott,et al.  Comparative evaluation of background characterization techniques for hyperspectral unstructured matched filter target detection , 2007 .

[26]  Charles A. Bouman,et al.  Covariance Estimation for High Dimensional Data Vectors Using the Sparse Matrix Transform , 2008, NIPS.

[27]  Daniel R. Fuhrmann,et al.  A CFAR adaptive matched filter detector , 1992 .

[28]  James Theiler,et al.  Elliptically Contoured Distributions for Anomalous Change Detection in Hyperspectral Imagery , 2010, IEEE Geoscience and Remote Sensing Letters.

[29]  Bor-Chen Kuo,et al.  A covariance estimator for small sample size classification problems and its application to feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[30]  Stanley R. Rotman,et al.  Point target detection in segmented images , 2008, Optical Engineering + Applications.

[31]  Dimitris Manolakis,et al.  Realistic matched filter performance prediction for hyperspectral target detection , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[32]  E. J. Kelly.  An Adaptive Detection Algorithm , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[33]  Jean-Yves Tourneret,et al.  Bounds for Estimation of Covariance Matrices From Heterogeneous Samples , 2008, IEEE Transactions on Signal Processing.

[34]  Avishai Ben-David,et al.  Performance loss of multivariate detection algorithms due to covariance estimation , 2009, Remote Sensing.

[35]  James B. Farison,et al.  Spatially invariant image sequences , 1992, IEEE Trans. Image Process..

[36]  Dimitris G. Manolakis,et al.  Taxonomy of detection algorithms for hyperspectral imaging applications , 2005 .

[37]  I. Reed,et al.  A Detection Algorithm for Optical Targets in Clutter , 1987, IEEE Transactions on Aerospace and Electronic Systems.

[38]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[39]  L.L. Scharf,et al.  Adaptive matched subspace detectors and adaptive coherence estimators , 1996, Conference Record of The Thirtieth Asilomar Conference on Signals, Systems and Computers.

[40]  Chein-I Chang,et al.  Multiple-Window Anomaly Detection for Hyperspectral Imagery , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Steven M. Adler-Golden.  Improved hyperspectral anomaly detection in heavy-tailed backgrounds , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[42]  Chris J. Willis.  Hyperspectral target detection using heavy-tailed distributions , 2009, Security + Defence.

[43]  Tiziana Veracini,et al.  Fully Unsupervised Learning of Gaussian Mixtures for Anomaly Detection in Hyperspectral Imagery , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[44]  Bo Du,et al.  A Kernel-Based Target-Constrained Interference-Minimized Filter for Hyperspectral Sub-Pixel Target Detection , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Marco Diani,et al.  On the CFAR Property of the RX Algorithm in the Presence of Signal-Dependent Noise in Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Nasser M. Nasrabadi,et al.  Automated Hyperspectral Cueing for Civilian Search and Rescue , 2009, Proceedings of the IEEE.

[47]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[48]  Alan P. Schaum,et al.  Spectral subspace matched filtering , 2001, SPIE Defense + Commercial Sensing.

[49]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[50]  Tiziana Veracini,et al.  Nonparametric Framework for Detecting Spectral Anomalies in Hyperspectral Images , 2011, IEEE Geoscience and Remote Sensing Letters.

[51]  M. Hazelton.  Variable kernel density estimation , 2003 .

[52]  Stefania Matteoli,et al.  Hyperspectral Anomaly Detection With Kurtosis-Driven Local Covariance Matrix Corruption Mitigation , 2011, IEEE Geoscience and Remote Sensing Letters.

[53]  Alan D. Stocker,et al.  Design and performance of the Civil Air Patrol ARCHER hyperspectral processing system , 2005 .

[54]  James Theiler,et al.  Decision boundaries in two dimensions for target detection in hyperspectral imagery. , 2009, Optics express.

[55]  Gil Tidhar,et al.  Target detection in inhomogeneous non-Gaussian hyperspectral data based on nonparametric density estimation , 2013, Defense, Security, and Sensing.

[56]  James Theiler,et al.  Nonlinear signal contamination effects for gaseous plume detection in hyperspectral imagery , 2006, SPIE Defense + Commercial Sensing.

[57]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[58]  Dimitris G. Manolakis,et al.  Modeling hyperspectral imaging data , 2003, SPIE Defense + Commercial Sensing.

[59]  Charles A. Bouman,et al.  Sparse Matrix Transform for Hyperspectral Image Processing , 2011, IEEE Journal of Selected Topics in Signal Processing.

[60]  James Theiler,et al.  Clustering to improve matched filter detection of weak gas plumes in hyperspectral thermal imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[61]  Amit Banerjee,et al.  A support vector method for anomaly detection in hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[62]  David W. Messinger,et al.  Euclidean commute time distance embedding and its application to spectral anomaly detection , 2012, Defense + Commercial Sensing.

[63]  Tiziana Veracini,et al.  Background Density Nonparametric Estimation With Data-Adaptive Bandwidths for the Detection of Anomalies in Multi-Hyperspectral Imagery , 2014, IEEE Geoscience and Remote Sensing Letters.

[64]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering , 2013 .

[65]  David Malah,et al.  Local-global background modeling for anomaly detection in hyperspectral images , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[66]  Heesung Kwon,et al.  A Comparative Analysis of Kernel Subspace Target Detectors for Hyperspectral Imagery , 2007, EURASIP J. Adv. Signal Process..

[67]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[68]  James Theiler,et al.  Regression framework for background estimation in remote sensing imagery , 2013, 2013 5th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[69]  J. Friedman.  Regularized Discriminant Analysis , 1989 .

[70]  James Theiler,et al.  The incredible shrinking covariance estimator , 2012, Defense + Commercial Sensing.

[71]  James Theiler,et al.  EC-GLRT: Detecting Weak Plumes in Non-Gaussian Hyperspectral Clutter Using an Elliptically-Contoured Generalized Likelihood Ratio Test , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[72]  Alan P. Schaum.  Design methods for continuum fusion detectors , 2011, Defense + Commercial Sensing.

[73]  Russell C. Hardie,et al.  Anomaly detection in hyperspectral imagery: comparison of methods using diurnal and seasonal data , 2009 .

[74]  E. M. Winter,et al.  Anomaly detection from hyperspectral imagery , 2002, IEEE Signal Process. Mag..

[75]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[76]  Dan G. Blumberg,et al.  Detecting anomalous objects in hyperspectral data using segmentation , 2008, Security + Defence.

[77]  Marco Diani,et al.  Statistical Analysis of Hyper-Spectral Data: A Non-Gaussian Approach , 2007, EURASIP J. Adv. Signal Process..

[78]  William F. Basener.  Clutter and anomaly removal for enhanced target detection , 2010, Defense + Commercial Sensing.

[79]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[80]  Liangpei Zhang,et al.  Sparse Transfer Manifold Embedding for Hyperspectral Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[81]  A. Hadi,et al.  BACON: blocked adaptive computationally efficient outlier nominators , 2000 .

[82]  Melba M. Crawford,et al.  Manifold-Learning-Based Feature Extraction for Classification of Hyperspectral Data: A Review of Advances in Manifold Learning , 2014, IEEE Signal Processing Magazine.

[83]  A. Fraser,et al.  Characterizing non-Gaussian clutter and detecting weak gaseous plumes in hyperspectral imagery , 2005 .

[84]  Edip Niver,et al.  Morphological Operators for Polarimetric Anomaly Detection , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[85]  Yuval Cohen,et al.  Subpixel hyperspectral target detection using local spectral and spatial information , 2012 .

[86]  I. Reed,et al.  Rapid Convergence Rate in Adaptive Arrays , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[87]  Eric Truslow,et al.  Detection Algorithms in Hyperspectral Imaging Systems: An Overview of Practical Algorithms , 2014, IEEE Signal Processing Magazine.

[88]  Zongben Xu,et al.  Image Inpainting by Patch Propagation Using Patch Sparsity , 2010, IEEE Transactions on Image Processing.

[89]  John Cipar,et al.  Statistical characterization of hyperspectral background clutter in the reflective spectral region. , 2008, Applied optics.

[90]  James Theiler,et al.  Ellipsoid-simplex hybrid for hyperspectral anomaly detection , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[91]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[92]  Nasser M. Nasrabadi,et al.  Regularization for spectral matched filter and RX anomaly detector , 2008, SPIE Defense + Commercial Sensing.

[93]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[94]  Jean-Yves Tourneret,et al.  Covariance Matrix Estimation With Heterogeneous Samples , 2008, IEEE Transactions on Signal Processing.

[95]  Marco Diani,et al.  Adaptive detection algorithm for full pixel targets in hyperspectral images , 2005 .

[96]  S. Sain.  Multivariate locally adaptive density estimation , 2002 .

[97]  Alan P. Schaum.  Advanced hyperspectral detection based on elliptically contoured distribution models and operator feedback , 2009, 2009 IEEE Applied Imagery Pattern Recognition Workshop (AIPR 2009).

[98]  Mark J. Carlotto,et al.  A cluster-based approach for detecting man-made objects and changes in imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[99]  David W. Messinger,et al.  Anomaly detection using topology , 2007, SPIE Defense + Commercial Sensing.

[100]  Louis L. Scharf,et al.  The adaptive coherence estimator: a uniformly most-powerful-invariant adaptive detection statistic , 2005, IEEE Transactions on Signal Processing.

[101]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[102]  James Theiler,et al.  Effect of signal contamination in matched-filter detection of the signal on a cluttered background , 2006, IEEE Geoscience and Remote Sensing Letters.

[103]  A. Schaum.  A remedy for nonstationarity in background transition regions for real time hyperspectral detection , 2006, 2006 IEEE Aerospace Conference.

[104]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[105]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[106]  Tiziana Veracini,et al.  A Locally Adaptive Background Density Estimator: An Evolution for RX-Based Anomaly Detectors , 2014, IEEE Geoscience and Remote Sensing Letters.

[107]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[108]  A. Hayden,et al.  Determination of trace-gas amounts in plumes by the use of orthogonal digital filtering of thermal-emission spectra. , 1996, Applied optics.

[109]  Tiziana Veracini,et al.  Models and Methods for Automated Background Density Estimation in Hyperspectral Anomaly Detection , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[110]  Stefania Matteoli,et al.  Effects of signal contamination in RX detection of local hyperspectral anomalies , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[111]  Heesung Kwon,et al.  Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[112]  Tiziana Veracini,et al.  An anomaly detection architecture based on a data-adaptive density estimation , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[113]  Felix Hueber,et al.  Hyperspectral Imaging Techniques For Spectral Detection And Classification , 2016 .

[114]  Stefania Matteoli,et al.  Impact of Signal Contamination on the Adaptive Detection Performance of Local Hyperspectral Anomalies , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[115]  José M. F. Moura,et al.  Efficient detection in hyperspectral imagery , 2001, IEEE Trans. Image Process..

[116]  John P. Kerekes,et al.  Improved modeling of background distributions in an end-to-end spectral imaging system model , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[117]  L. Ammann.  Robust Principal Components , 1989 .

[118]  James Theiler,et al.  Detection of spectrally sparse anomalies in hyperspectral imagery , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[119]  I. Reed,et al.  Adaptive Optical Target Detection Using Correlated Images , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[120]  Daniel Cremers,et al.  Shape statistics in kernel space for variational image segmentation , 2003, Pattern Recognit..

[121]  Peter Bajorski.  Maximum Gaussianity models for hyperspectral images , 2008, SPIE Defense + Commercial Sensing.

[122]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[123]  Brendt Wohlberg,et al.  Inpainting by Joint Optimization of Linear Combinations of Exemplars , 2011, IEEE Signal Processing Letters.

[124]  S.R. Rotman,et al.  Improved covariance matrices for point target detection in hyperspectral data , 2008, 2009 IEEE International Conference on Microwaves, Communications, Antennas and Electronics Systems.

[125]  Stefania Matteoli,et al.  A kurtosis-based test to efficiently detect targets placed in close proximity by means of local covariance-based hyperspectral anomaly detectors , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[126]  K.W. Bauer,et al.  Finding Hyperspectral Anomalies Using Multivariate Outlier Detection , 2007, 2007 IEEE Aerospace Conference.

[127]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[128]  Marcus S. Stefanou,et al.  Analysis of false alarm distributions in the development and evaluation of hyperspectral point target detection algorithms , 2007 .