Variability of the endmembers in spectral unmixing

Abstract Spectral unmixing is an inverse problem in hyperspectral imaging that aims at recovering the spectra of the pure constituents of an image (called endmembers), as well as at estimating the proportions of said materials in each pixel (called abundances). A linear mixing model is typically used for this purpose, but this approach implicitly assumes that one spectrum can completely characterize each material, while in practice the materials are always subject to intraclass variability. Taking this phenomenon into account within an image amounts to allowing the endmembers to vary on a per-pixel basis. In this chapter, we review and categorize the methods addressing this endmember variability and compare their results on a real data set, thus showing the benefits of incorporating it into the unmixing chain.

[1]  Guillaume Tochon,et al.  Hierarchical analysis of multimodal images , 2015 .

[2]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[3]  Jean-Yves Tourneret,et al.  Bayesian Estimation of Linear Mixtures Using the Normal Compositional Model. Application to Hyperspectral Imagery , 2010, IEEE Transactions on Image Processing.

[4]  Jocelyn Chanussot,et al.  Nonnegative CP decomposition of multiangle hyperspectral data: A case study on CRISM observations of Martian ICY surface , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[5]  Jean-Yves Tourneret,et al.  Online Unmixing of Multitemporal Hyperspectral Images Accounting for Spectral Variability , 2015, IEEE Transactions on Image Processing.

[6]  Jean-Yves Tourneret,et al.  Hyperspectral Unmixing With Spectral Variability Using a Perturbed Linear Mixing Model , 2015, IEEE Transactions on Signal Processing.

[7]  Jocelyn Chanussot,et al.  Relationships Between Nonlinear and Space-Variant Linear Models in Hyperspectral Image Unmixing , 2017, IEEE Signal Processing Letters.

[8]  Jocelyn Chanussot,et al.  Multilinear spectral unmixing of hyperspectral multiangle images , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[9]  Jocelyn Chanussot,et al.  Dynamical Spectral Unmixing of Multitemporal Hyperspectral Images , 2015, IEEE Transactions on Image Processing.

[10]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Margaret E. Gardner,et al.  Mapping Chaparral in the Santa Monica Mountains Using Multiple Endmember Spectral Mixture Models , 1998 .

[13]  Paul D. Gader,et al.  Sampling Piecewise Convex Unmixing and Endmember Extraction , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Jocelyn Chanussot,et al.  Blind Hyperspectral Unmixing Using an Extended Linear Mixing Model to Address Spectral Variability , 2016, IEEE Transactions on Image Processing.

[15]  Antonio J. Plaza,et al.  A Signal Processing Perspective on Hyperspectral Unmixing: Insights from Remote Sensing , 2014, IEEE Signal Processing Magazine.

[16]  B. Hapke Theory of reflectance and emittance spectroscopy , 1993 .

[17]  Rob Heylen,et al.  A Multilinear Mixing Model for Nonlinear Spectral Unmixing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  X. Garcia,et al.  Evaluation des performances de l'analyse statistique et physique d'images hyperspectrales de Mars. Application au capteur multi-angulaire CRISM , 2011 .

[19]  Alina Zare,et al.  Hyperspectral unmixing with endmember variability using Partial Membership Latent Dirichlet Allocation , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Asad Mahmood,et al.  Estimation of the Intrinsic Dimension of Hyperspectral Images: Comparison of Current Methods , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Naoto Yokoya,et al.  Hyperspectral Tree Species Classification of Japanese Complex Mixed Forest With the Aid of Lidar Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[23]  Yannick Deville,et al.  A method based on nonnegative matrix factorization dealing with intra-class variability for unsupervised hyperspectral unmixing , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[24]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2005, IEEE Trans. Geosci. Remote. Sens..

[25]  Antonio J. Plaza,et al.  A new extended linear mixing model to address spectral variability , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[26]  Paul D. Gader,et al.  Spatial and Spectral Unmixing Using the Beta Compositional Model , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Rémi Gribonval,et al.  Convex Optimization Approaches for Blind Sensor Calibration Using Sparsity , 2013, IEEE Transactions on Signal Processing.

[28]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Jean-Yves Tourneret,et al.  Unsupervised Unmixing of Hyperspectral Images Accounting for Endmember Variability , 2014, IEEE Transactions on Image Processing.

[30]  Paul D. Gader,et al.  A Gaussian Mixture Model Representation of Endmember Variability in Hyperspectral Unmixing , 2017, IEEE Transactions on Image Processing.

[31]  Derek Rogge,et al.  Integration of spatial–spectral information for the improved extraction of endmembers , 2007 .

[32]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[33]  Jocelyn Chanussot,et al.  Endmembers as Directional Data for Robust Material Variability Retrieval in Hyperspectral Image Unmixing , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Qian Du,et al.  Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Mario Winter,et al.  N-FINDR: an algorithm for fast autonomous spectral end-member determination in hyperspectral data , 1999, Optics & Photonics.

[36]  Ye Zhang,et al.  SVM-Based Unmixing-to-Classification Conversion for Hyperspectral Abundance Quantification , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Antonio J. Plaza,et al.  Harmonic Mixture Modeling for Efficient Nonlinear Hyperspectral Unmixing , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Jocelyn Chanussot,et al.  From local to global unmixing of hyperspectral images to reveal spectral variability , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[39]  Maria C. Torres-Madronero,et al.  Unmixing Analysis of a Time Series of Hyperion Images Over the Guánica Dry Forest in Puerto Rico , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Spectral Unmixing-Based Binary Partition Tree Representation , 2014, IEEE Transactions on Image Processing.

[41]  Silvia Valero,et al.  Hyperspectral Image Representation and Processing With Binary Partition Trees , 2013, IEEE Transactions on Image Processing.

[42]  Pol Coppin,et al.  Endmember variability in Spectral Mixture Analysis: A review , 2011 .

[43]  Jocelyn Chanussot,et al.  Blind hyperspectral unmixing using an extended linear mixing model to address spectral variability , 2015, WHISPERS.

[44]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Antonio J. Plaza,et al.  Validation of spectral unmixing methods using photometry and topography information , 2013, 2013 5th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[46]  K. C. Ho,et al.  Endmember Variability in Hyperspectral Analysis: Addressing Spectral Variability During Spectral Unmixing , 2014, IEEE Signal Processing Magazine.

[47]  Antonio J. Plaza,et al.  A Dynamic Unmixing Framework for Plant Production System Monitoring , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[48]  José M. Bioucas-Dias,et al.  Nonlinear mixture model for hyperspectral unmixing , 2009, Remote Sensing.

[49]  Yannick Deville,et al.  Linear-Quadratic Blind Source Separation Using NMF to Unmix Urban Hyperspectral Images , 2014, IEEE Transactions on Signal Processing.

[50]  X. Ceamanos,et al.  Characterization and mapping of surface physical properties of Mars from CRISM multi-angular data : application to Gusev Crater and Meridiani Planum , 2014, 1408.5301.

[51]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[52]  Paul Honeine,et al.  Hyperspectral Unmixing in Presence of Endmember Variability, Nonlinearity, or Mismodeling Effects , 2015, IEEE Transactions on Image Processing.

[53]  Antonio J. Plaza,et al.  Automated Extraction of Image-Based Endmember Bundles for Improved Spectral Unmixing , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[54]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[55]  Antonio J. Plaza,et al.  A quantitative and comparative analysis of endmember extraction algorithms from hyperspectral data , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Richard J. Murphy,et al.  A Novel Spectral Unmixing Method Incorporating Spectral Variability Within Endmember Classes , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Jing Jin,et al.  A Novel Approach Based on Fisher Discriminant Null Space for Decomposition of Mixed Pixels in Hyperspectral Imagery , 2010, IEEE Geoscience and Remote Sensing Letters.

[58]  Bo Du,et al.  An Image-Based Endmember Bundle Extraction Algorithm Using Both Spatial and Spectral Information , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[60]  David W. Messinger,et al.  Spatially Adaptive Hyperspectral Unmixing , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[61]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.