Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear PCA band reduction

This paper presents a novel method for the enhancement of spatial quality of Hyperspectral (HS) images while making use of a high resolution panchromatic (PAN) image. Due to the high number of bands the application of a pansharpening technique to HS images may result in an increase of the computational load and complexity. Thus a dimensionality reduction preprocess, compressing the original number of measurements into a lower dimensional space, becomes mandatory. To solve this problem we propose a pansharpening technique combining both dimensionality reduction and fusion, exploited by non-linear Principal Component Analysis (NLPCA) and Indusion respectively, to enhance the spatial resolution of a hyperspectral image.

[1]  Qian Du,et al.  Unsupervised Hyperspectral Band Selection Using Graphics Processing Units , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Jocelyn Chanussot,et al.  Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique , 2008, IEEE Geoscience and Remote Sensing Letters.

[3]  LinLin Shen,et al.  Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[5]  Chein-I Chang,et al.  Progressive Band Dimensionality Expansion and Reduction Via Band Prioritization for Hyperspectral Imagery , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[7]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[8]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Jon Atli Benediktsson,et al.  Linear Versus Nonlinear PCA for the Classification of Hyperspectral Data Based on the Extended Morphological Profiles , 2012, IEEE Geoscience and Remote Sensing Letters.

[10]  Fabio Del Frate,et al.  Feature reduction of hyperspectral data using Autoassociative neural networks algorithms , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Tim R. McVicar,et al.  Preprocessing EO-1 Hyperion hyperspectral data to support the application of agricultural indexes , 2003, IEEE Trans. Geosci. Remote. Sens..

[12]  Jocelyn Chanussot,et al.  Pansharpening of Hyperspectral images using spatial distortion optimization , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[13]  Fabio Del Frate,et al.  Pixel Unmixing in Hyperspectral Data by Means of Neural Networks , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Bernhard Mayer,et al.  Atmospheric Chemistry and Physics Technical Note: the Libradtran Software Package for Radiative Transfer Calculations – Description and Examples of Use , 2022 .

[15]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[17]  Jon Atli Benediktsson,et al.  Spectral Unmixing for the Classification of Hyperspectral Images at a Finer Spatial Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[18]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[19]  Russell C. Hardie,et al.  Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Laurent Condat,et al.  A framework for image magnification: induction revisited , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[21]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[22]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[25]  Gabriele Moser,et al.  Comparison of feature reduction techniques for classification of hyperspectral remote sensing data , 2003, SPIE Remote Sensing.

[26]  David A. Landgrebe,et al.  Feature Extraction Based on Decision Boundaries , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[28]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[29]  Joachim Selbig,et al.  Non-linear PCA: a missing data approach , 2005, Bioinform..

[30]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[31]  Johannes R. Sveinsson,et al.  Classification of Pansharpened Urban Satellite Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[33]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[34]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .