Joint structural similarity and entropy estimation for coded-exposure image restoration

We address the image deblurring using coded exposure which can keep image content that may be lost by a traditional shutter. In the restoration of a coded exposure image, the automatic estimation of smear length is the key problem. Because the coded exposure image does not lose high frequency information of the image, the structural similarity compared with the original image is retained. In this paper, we propose a joint coarse to fine estimation method. By comparing structural similarity between the coded-exposure image and its restored image, the smear length can be roughly estimated first. And then the entropy of the restored image is further computed within a small range of the previously estimated smear length. An image that is restored with the wrong smear length will be far from the structure of the coded image that will have high entropy and low structure similarity with the coded exposure image.

[1]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[2]  Yue Gao,et al.  Large-Scale Cross-Modality Search via Collective Matrix Factorization Hashing , 2016, IEEE Transactions on Image Processing.

[3]  S. Nayar,et al.  What are good apertures for defocus deblurring? , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[4]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[5]  In-So Kweon,et al.  Fluttering Pattern Generation Using Modified Legendre Sequence for Coded Exposure Imaging , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Jungong Han,et al.  Large-scale image retrieval with Sparse Embedded Hashing , 2017, Neurocomputing.

[7]  In-So Kweon,et al.  Complementary Sets of Shutter Sequences for Motion Deblurring , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Yue Gao,et al.  Zero-Shot Learning With Transferred Samples , 2017, IEEE Transactions on Image Processing.

[9]  Aswin C. Sankaranarayanan,et al.  Flutter Shutter Video Camera for compressive sensing of videos , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[11]  In-So Kweon,et al.  Generating Fluttering Patterns with Low Autocorrelation for Coded Exposure Imaging , 2017, International Journal of Computer Vision.

[12]  Stanley Osher,et al.  On a mathematical theory of coded exposure , 2016 .

[13]  Yuanyuan Ding,et al.  Design and Estimation of Coded Exposure Point Spread Functions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Fumin Zhang,et al.  Digital micromirror device camera with per-pixel coded exposure for high dynamic range imaging. , 2017, Applied optics.

[15]  In So Kweon,et al.  Multi-Image Deblurring Using Complementary Sets of Fluttering Patterns , 2017, IEEE Transactions on Image Processing.

[16]  Yuanyuan Ding,et al.  Analysis of Motion Blur with a Flutter Shutter Camera for Non-linear Motion , 2010, ECCV.

[17]  Shree K. Nayar,et al.  Efficient Space-Time Sampling with Pixel-Wise Coded Exposure for High-Speed Imaging , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[19]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[20]  Fumin Zhang,et al.  Per-Pixel Coded Exposure for High-Speed and High-Resolution Imaging Using a Digital Micromirror Device Camera , 2016, Sensors.

[21]  Sos S. Agaian,et al.  Quantifying image similarity using measure of enhancement by entropy , 2007, SPIE Defense + Commercial Sensing.

[22]  Shree K. Nayar,et al.  Video from a single coded exposure photograph using a learned over-complete dictionary , 2011, 2011 International Conference on Computer Vision.

[23]  Ralph Etienne-Cummings,et al.  CMOS implementation of pixel-wise coded exposure imaging for insect-based sensor node , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[24]  Gonzalo R Arce,et al.  Compressive imaging via a rotating coded aperture. , 2017, Applied optics.

[25]  Efstathios E. Michaelides,et al.  Entropy, Order and Disorder , 2008 .

[26]  Ling Shao,et al.  Learning to Hash With Optimized Anchor Embedding for Scalable Retrieval , 2017, IEEE Transactions on Image Processing.

[27]  Jie Zhang,et al.  Compact all-CMOS spatiotemporal compressive sensing video camera with pixel-wise coded exposure. , 2016, Optics express.

[28]  Jun Zhang,et al.  Motion Blur Identification Using Image Statistics for Coded Exposure Photography , 2013 .

[29]  K. S. Venkatesh,et al.  Flutter shutter based motion deblurring in complex scenes , 2013, 2013 Annual IEEE India Conference (INDICON).

[30]  Yi Xu,et al.  Coded exposure deblurring: Optimized codes for PSF estimation and invertibility , 2009, CVPR.

[31]  Jungong Han,et al.  Robust Quantization for General Similarity Search , 2018, IEEE Transactions on Image Processing.