Inpainting by Joint Optimization of Linear Combinations of Exemplars

Exemplar-based methods, in which actual image blocks are used to fill in missing content, have achieved state of the art performance in image inpainting. The majority of these adopt a progressive approach, filling in the missing region inwards from the boundary. The final result is highly dependent on fill order, and while significant progress has been made on the choice of this order, the greedy nature of such a process leads to artifacts in some cases. The alternative exemplar-based approach proposed here is defined via joint optimization of a single functional, simultaneously assigning an estimated value to the entire inpainting region. The results are found to be highly competitive with other recent inpainting methods.

[1]  Zongben Xu,et al.  Image Inpainting by Patch Propagation Using Patch Sparsity , 2010, IEEE Transactions on Image Processing.

[2]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Wei Hu,et al.  Image inpainting via sparse representation , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[5]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Brendt Wohlberg,et al.  Inpainting with sparse linear combinations of exemplars , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Paul A. Ardis,et al.  Inpainting quality assessment , 2010, J. Electronic Imaging.

[12]  Alexander Wong,et al.  A nonlocal-means approach to exemplar-based inpainting , 2008, 2008 15th IEEE International Conference on Image Processing.

[13]  Brendt Wohlberg,et al.  An efficient algorithm for sparse representations with lp data fidelity term , 2008 .

[14]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[15]  Jean-Michel Morel,et al.  Image denoising by non-local averaging , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[16]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.