Hyperspectral image superresolution: An edge-preserving convex formulation

Hyperspectral remote sensing images (HSIs) are characterized by having a low spatial resolution and a high spectral resolution, whereas multispectral images (MSIs) are characterized by low spectral and high spatial resolutions. These complementary characteristics have stimulated active research in the inference of images with high spatial and spectral resolutions from HSI-MSI pairs. In this paper, we formulate this data fusion problem as the minimization of a convex objective function containing two data-fitting terms and an edge-preserving regularizer. The data-fitting terms are quadratic and account for blur, different spatial resolutions, and additive noise; the regularizer, a form of vector Total Variation, promotes aligned discontinuities across the reconstructed hyperspectral bands. The optimization described above is rather hard, owing to its non-diagonalizable linear operators, to the non-quadratic and non-smooth nature of the regularizer, and to the very large size of the image to be inferred. We tackle these difficulties by tailoring the Split Augmented Lagrangian Shrinkage Algorithm (SALSA) - an instance of the Alternating Direction Method of Multipliers (ADMM) - to this optimization problem. By using a convenient variable splitting and by exploiting the fact that HSIs generally “live” in a low-dimensional subspace, we obtain an effective algorithm that yields state-of-the-art results, as illustrated by experiments.

[1]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[2]  Kaihua Zhang,et al.  Spatio-spectral fusion of satellite images based on dictionary-pair learning , 2014, Inf. Fusion.

[3]  Luciano Alparone,et al.  Hyperspectral image fusion , 2010 .

[4]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[5]  Aggelos K. Katsaggelos,et al.  A survey of classical methods and new trends in pansharpening of multispectral images , 2011, EURASIP J. Adv. Signal Process..

[6]  Fionn Murtagh,et al.  Image restoration with noise suppression using the wavelet transform , 1994 .

[7]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Jocelyn Chanussot,et al.  Pansharpening using total variation regularization , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[9]  H. Kramer Observation of the Earth and Its Environment , 1994 .

[10]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[11]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.

[12]  Zongben Xu,et al.  Spatial and Spectral Image Fusion Using Sparse Matrix Factorization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[14]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[15]  Michael E. Schaepman,et al.  Unmixing-Based Landsat TM and MERIS FR Data Fusion , 2008, IEEE Geoscience and Remote Sensing Letters.

[16]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[17]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[18]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[20]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Lawrence Ong,et al.  The Earth Observing One (EO-1) Satellite Mission: Over a Decade in Space , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Yasuyuki Matsushita,et al.  High-resolution hyperspectral imaging via matrix factorization , 2011, CVPR 2011.

[23]  Jocelyn Chanussot,et al.  Pansharpening of Hyperspectral images using spatial distortion optimization , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[24]  Yifan Zhang,et al.  Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jocelyn Chanussot,et al.  Fusion of hyperspectral and panchromatic images using multiresolution analysis and nonlinear PCA band reduction , 2012, EURASIP J. Adv. Signal Process..

[26]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[27]  Bruno A. Olshausen,et al.  Learning Sparse Codes for Hyperspectral Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[28]  Yifan Zhang,et al.  A Bayesian Restoration Approach for Hyperspectral Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[30]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2013, J. Optim. Theory Appl..

[32]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[33]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Quan Pan,et al.  Hyperspectral imagery super-resolution by sparse representation and spectral regularization , 2011, EURASIP J. Adv. Signal Process..