An efficient algorithm for sparse representations with lp data fidelity term

Basis Pursuit (BP) and Basis Pursuit Denoising (BPDN), well established techniques for computing sparse representations, minimize an ` data fidelity term, subject to an ` sparsity constraint or regularization term, by mapping the problem to a linear or quadratic program. BPDN with an ` data fidelity term has recently been proposed, also implemented via a mapping to a linear program. We introduce an alternative approach via an Iteratively Reweighted Least Squares algorithm, providing computational advantages and greater flexibility in the choice of data fidelity term norm.

[1]  Brendt Wohlberg,et al.  An Iteratively Reweighted Norm Algorithm for Minimization of Total Variation Functionals , 2007, IEEE Signal Processing Letters.

[2]  R. Wolke,et al.  Iteratively Reweighted Least Squares: Algorithms, Convergence Analysis, and Numerical Comparisons , 1988 .

[3]  J. Scales,et al.  Robust methods in inverse theory , 1988 .

[4]  P. Vandergheynst,et al.  Sparse Approximation by Linear Programming using an L1 Data-Fidelity Term , 2005 .

[5]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[6]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[7]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[8]  Pierre Vandergheynst,et al.  Very low bit rate image coding using redundant dictionaries , 2003, SPIE Optics + Photonics.

[9]  David L. Donoho,et al.  Application of basis pursuit in spectrum estimation , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[10]  B. Wohlberg,et al.  An Iteratively Reweighted Norm Algorithm for Total Variation Regularization , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[11]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[12]  K. Bube,et al.  Hybrid l 1 /l 2 minimization with applications to tomography , 1997 .

[13]  Mila Nikolova,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[14]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[15]  B. Rao,et al.  A new iterative weighted norm minimization algorithm and its applications , 1992, [1992] IEEE Sixth SP Workshop on Statistical Signal and Array Processing.

[16]  Mila Nikolova,et al.  Efficient Minimization Methods of Mixed l2-l1 and l1-l1 Norms for Image Restoration , 2005, SIAM J. Sci. Comput..

[17]  J. Tukey,et al.  The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data , 1974 .

[18]  P. J. Huber Robust Regression: Asymptotics, Conjectures and Monte Carlo , 1973 .

[19]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[20]  Elwood T. Olsen,et al.  L1 and L∞ minimization via a variant of Karmarkar's algorithm , 1989, IEEE Trans. Acoust. Speech Signal Process..