Exact Support Recovery for Sparse Spikes Deconvolution

This paper studies sparse spikes deconvolution over the space of measures. We focus on the recovery properties of the support of the measure (i.e., the location of the Dirac masses) using total variation of measures (TV) regularization. This regularization is the natural extension of the $$\ell ^1$$ℓ1 norm of vectors to the setting of measures. We show that support identification is governed by a specific solution of the dual problem (a so-called dual certificate) having minimum $$L^2$$L2 norm. Our main result shows that if this certificate is non-degenerate (see the definition below), when the signal-to-noise ratio is large enough TV regularization recovers the exact same number of Diracs. We show that both the locations and the amplitudes of these Diracs converge toward those of the input measure when the noise drops to zero. Moreover, the non-degeneracy of this certificate can be checked by computing a so-called vanishing derivative pre-certificate. This proxy can be computed in closed form by solving a linear system. Lastly, we draw connections between the support of the recovered measure on a continuous domain and on a discretized grid. We show that when the signal-to-noise level is large enough, and provided the aforementioned dual certificate is non-degenerate, the solution of the discretized problem is supported on pairs of Diracs which are neighbors of the Diracs of the input measure. This gives a precise description of the convergence of the solution of the discretized problem toward the solution of the continuous grid-free problem, as the grid size tends to zero.

[1]  O. Scherzer,et al.  A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators , 2007 .

[2]  Arjan Kuijper,et al.  Scale Space and Variational Methods in Computer Vision , 2013, Lecture Notes in Computer Science.

[3]  O. Scherzer,et al.  Necessary and sufficient conditions for linear convergence of ℓ1‐regularization , 2011 .

[4]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[5]  S. Osher,et al.  Convergence rates of convex variational regularization , 2004 .

[6]  Otmar Scherzer,et al.  Sparsity Regularization for Radon Measures , 2009, SSVM.

[7]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[8]  Emmanuel J. Candès,et al.  Super-Resolution from Noisy Data , 2012, Journal of Fourier Analysis and Applications.

[9]  S. Levy,et al.  Reconstruction of a sparse spike train from a portion of its spectrum and application to high-resolution deconvolution , 1981 .

[10]  Marco F. Duarte,et al.  Spectral compressive sensing , 2013 .

[11]  Dirk A. Lorenz,et al.  Greedy Deconvolution of Point-like Objects , 2009 .

[12]  Emmanuel J. Cand Towards a Mathematical Theory of Super-Resolution , 2012 .

[13]  Mohamed-Jalal Fadili,et al.  Robust Sparse Analysis Regularization , 2011, IEEE Transactions on Information Theory.

[14]  Jean-Jacques Fuchs,et al.  On sparse representations in arbitrary redundant bases , 2004, IEEE Transactions on Information Theory.

[15]  F. Gamboa,et al.  Spike detection from inaccurate samplings , 2013, 1301.5873.

[16]  F. Santosa,et al.  Linear inversion of ban limit reflection seismograms , 1986 .

[17]  M. Vetterli,et al.  Sparse Sampling of Signal Innovations , 2008, IEEE Signal Processing Magazine.

[18]  Yohann de Castro,et al.  Exact Reconstruction using Beurling Minimal Extrapolation , 2011, 1103.4951.

[19]  J. Claerbout,et al.  Robust Modeling With Erratic Data , 1973 .

[20]  Peng Zhao,et al.  On Model Selection Consistency of Lasso , 2006, J. Mach. Learn. Res..

[21]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[22]  Laurent Condat,et al.  Cadzow Denoising Upgraded: A New Projection Method for the Recovery of Dirac Pulses from Noisy Linear Measurements , 2015 .

[23]  Gongguo Tang,et al.  Near minimax line spectral estimation , 2013, 2013 47th Annual Conference on Information Sciences and Systems (CISS).

[24]  Gongguo Tang,et al.  Atomic Norm Denoising With Applications to Line Spectral Estimation , 2012, IEEE Transactions on Signal Processing.

[25]  Jari Lindberg,et al.  Mathematical concepts of optical superresolution , 2012 .

[26]  K. Bredies,et al.  Inverse problems in spaces of measures , 2013 .

[27]  Laurent Condat,et al.  Recovery of nonuniformdirac pulses from noisy linear measurements , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[28]  C. Dossal SPARSE SPIKE DECONVOLUTION WITH MINIMUM SCALE , .

[29]  D. Slepian Prolate spheroidal wave functions, fourier analysis, and uncertainty — V: the discrete case , 1978, The Bell System Technical Journal.

[30]  Laurent Demanet,et al.  Super-resolution via superset selection and pruning , 2013, ArXiv.

[31]  Carlos Fernandez-Granda Support detection in super-resolution , 2013, ArXiv.

[32]  D. Donoho Superresolution via sparsity constraints , 1992 .

[33]  Etienne Barnard,et al.  Two-dimensional superresolution radar imaging using the MUSIC algorithm , 1994 .

[34]  Wenjing Liao,et al.  Coherence Pattern-Guided Compressive Sensing with Unresolved Grids , 2011, SIAM J. Imaging Sci..

[35]  H. Brezis Analyse fonctionnelle : théorie et applications , 1983 .

[36]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..