Analysis of masks for compressed acquisitions in variational-based pansharpening

—The goal of pansharpening is to generate a fused image having both the high spatial resolution of a panchromatic (PAN) and the high spectral resolution of a multispectral (MS) image. For modern low-cost satellite, we envision a strategy for a compressed acquisition with a matrix of custom sensors, which can be seen mathematically as a linear combination of masked sources. We analyze the effectiveness of different masks, both novel and adapted from the literature, on the quality of a fused product, whose reconstruction is based on a flexible inversion scheme based on a variational approach.

[1]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[2]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[3]  Kevin M. Holt,et al.  Total Nuclear Variation and Jacobian Extensions of Total Variation for Vector Fields , 2014, IEEE Transactions on Image Processing.

[4]  Jean-Baptiste Thomas,et al.  N-LMMSE Demosaicing for Spectral Filter Arrays , 2017, CIC 2017.

[5]  황준 Image sensor with improved light sensitivity and fabricating method of the same , 2001 .

[6]  Xiaoqun Zhang,et al.  A primal–dual fixed point algorithm for convex separable minimization with applications to image restoration , 2013 .

[7]  Jocelyn Chanussot,et al.  Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing , 2014, Proceedings of the IEEE.

[8]  Hairong Qi,et al.  The design and evaluation of a generic method for generating mosaicked multispectral filter arrays , 2006, IEEE Transactions on Image Processing.

[9]  N. L. Johnson,et al.  Continuous Multivariate Distributions, Volume 1: Models and Applications , 2019 .

[10]  Laurent Condat A new random color filter array with good spectral properties , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[11]  Martin Fryer,et al.  e2v CMOS and CCD sensors and systems for astronomy , 2017 .

[12]  Masatoshi Okutomi,et al.  A Practical One-Shot Multispectral Imaging System Using a Single Image Sensor , 2015, IEEE Transactions on Image Processing.

[13]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Henry Arguello,et al.  Compressive Coded Aperture Spectral Imaging: An Introduction , 2014, IEEE Signal Processing Magazine.

[15]  Laurent Condat,et al.  Pansharpening of images acquired with color filter arrays , 2018, Photonics Europe.

[16]  Martin Sweeting,et al.  Image compression systems on board satellites , 2009 .

[17]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[18]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[19]  David Alleysson,et al.  Random Color Filter Arrays are Better than Regular Ones , 2016 .