Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear PCA band reduction

This article presents a novel method for the enhancement of the spatial quality of hyperspectral (HS) images through the use of a high resolution panchromatic (PAN) image. Due to the high number of bands, the application of a pan-sharpening technique to HS images may result in an increase of the computational load and complexity. Thus a dimensionality reduction preprocess, compressing the original number of measurements into a lower dimensional space, becomes mandatory. To solve this problem, we propose a pan-sharpening technique combining both dimensionality reduction and fusion, making use of non-linear principal component analysis (NLPCA) and Indusion, respectively, to enhance the spatial resolution of a HS image. We have tested the proposed algorithm on HS images obtained from CHRIS-Proba sensor and PAN image obtained from World view 2 and demonstrated that a reduction using NLPCA does not result in any significant degradation in the pan-sharpening results.

[1]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[2]  Fabio Del Frate,et al.  Pixel Unmixing in Hyperspectral Data by Means of Neural Networks , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[4]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[6]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[7]  Chein-I Chang,et al.  Progressive Band Dimensionality Expansion and Reduction Via Band Prioritization for Hyperspectral Imagery , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[9]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[10]  Russell C. Hardie,et al.  Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Tim R. McVicar,et al.  Preprocessing EO-1 Hyperion hyperspectral data to support the application of agricultural indexes , 2003, IEEE Trans. Geosci. Remote. Sens..

[13]  LinLin Shen,et al.  Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[15]  Laurent Condat,et al.  A framework for image magnification: induction revisited , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[16]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[17]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[18]  Jon Atli Benediktsson,et al.  Linear Versus Nonlinear PCA for the Classification of Hyperspectral Data Based on the Extended Morphological Profiles , 2012, IEEE Geoscience and Remote Sensing Letters.

[19]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Bernhard Mayer,et al.  Atmospheric Chemistry and Physics Technical Note: the Libradtran Software Package for Radiative Transfer Calculations – Description and Examples of Use , 2022 .

[21]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Jon Atli Benediktsson,et al.  Spectral Unmixing for the Classification of Hyperspectral Images at a Finer Spatial Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[23]  Jeffrey G. Andrews,et al.  Mode Switching for the Multi-Antenna Broadcast Channel Based on Delay and Channel Quantization , 2008, EURASIP J. Adv. Signal Process..

[24]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[25]  Qian Du,et al.  Unsupervised Hyperspectral Band Selection Using Graphics Processing Units , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Jocelyn Chanussot,et al.  Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique , 2008, IEEE Geoscience and Remote Sensing Letters.

[27]  Gabriele Moser,et al.  Comparison of feature reduction techniques for classification of hyperspectral remote sensing data , 2003, SPIE Remote Sensing.

[28]  David A. Landgrebe,et al.  Feature Extraction Based on Decision Boundaries , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Johannes R. Sveinsson,et al.  Classification of Pansharpened Urban Satellite Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[31]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[32]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[33]  Joachim Selbig,et al.  Non-linear PCA: a missing data approach , 2005, Bioinform..