Compressive Sensing of Analog Signals Using Discrete Prolate Spheroidal Sequences

Compressive sensing (CS) has recently emerged as a framework for efficiently capturing signals that are sparse or compressible in an appropriate basis. While often motivated as an alternative to Nyquist-rate sampling, there remains a gap between the discrete, finite-dimensional CS framework and the problem of acquiring a continuous-time signal. In this paper, we attempt to bridge this gap by exploiting the Discrete Prolate Spheroidal Sequences (DPSS's), a collection of functions that trace back to the seminal work by Slepian, Landau, and Pollack on the effects of time-limiting and bandlimiting operations. DPSS's form a highly efficient basis for sampled bandlimited functions; by modulating and merging DPSS bases, we obtain a dictionary that offers high-quality sparse approximations for most sampled multiband signals. This multiband modulated DPSS dictionary can be readily incorporated into the CS framework. We provide theoretical guarantees and practical insight into the use of this dictionary for recovery of sampled multiband signals from compressive measurements.

[1]  S. Izu,et al.  Time-Frequency Localization and Sampling of Multiband Signals , 2009 .

[2]  Richard G. Baraniuk,et al.  The Pros and Cons of Compressive Sensing for Wideband Signal Acquisition: Noise Folding versus Dynamic Range , 2011, IEEE Transactions on Signal Processing.

[3]  Volkan Cevher,et al.  An ALPS view of sparse recovery , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  D. Thomson,et al.  Spectrum estimation and harmonic analysis , 1982, Proceedings of the IEEE.

[5]  Per Christian Hansen,et al.  Regularization Tools version 4.0 for Matlab 7.3 , 2007, Numerical Algorithms.

[6]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[7]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[8]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[9]  John S. Thompson,et al.  Reconciling Compressive Sampling Systems for Spectrally Sparse Continuous-Time Signals , 2011, IEEE Transactions on Signal Processing.

[10]  Marco F. Duarte,et al.  Spectral compressive sensing , 2013 .

[11]  M. A. Davenport,et al.  A wideband compressive radio receiver , 2010, 2010 - MILCOM 2010 MILITARY COMMUNICATIONS CONFERENCE.

[12]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[13]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[14]  Mingui Sun,et al.  Compressive sensing and random filtering of EEG signals using Slepian basis , 2008, 2008 16th European Signal Processing Conference.

[15]  Richard G. Baraniuk,et al.  Signal Processing With Compressive Measurements , 2010, IEEE Journal of Selected Topics in Signal Processing.

[16]  I. Daubechies,et al.  Approximating a bandlimited function using very coarsely quantized data: A family of stable sigma-delta modulators of arbitrary order , 2003 .

[17]  Stephen J. Wright,et al.  Toeplitz-Structured Compressed Sensing Matrices , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[18]  Justin K. Romberg,et al.  Compressive Sensing by Random Convolution , 2009, SIAM J. Imaging Sci..

[19]  Robert H. Walden,et al.  Analog-to-digital converter survey and analysis , 1999, IEEE J. Sel. Areas Commun..

[20]  Minh N. Do,et al.  A Theory for Sampling Signals from a Union of Subspaces , 2022 .

[21]  Roman Vershynin,et al.  Introduction to the non-asymptotic analysis of random matrices , 2010, Compressed Sensing.

[22]  Yonina C. Eldar,et al.  Blind Multiband Signal Reconstruction: Compressed Sensing for Analog Signals , 2007, IEEE Transactions on Signal Processing.

[23]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[24]  D. Slepian Prolate spheroidal wave functions, fourier analysis, and uncertainty — V: the discrete case , 1978, The Bell System Technical Journal.

[25]  Yonina C. Eldar,et al.  Compressed Sensing with Coherent and Redundant Dictionaries , 2010, ArXiv.

[26]  R. DeVore,et al.  Instance optimal decoding by thresholding in compressed sensing , 2008 .

[27]  Avideh Zakhor,et al.  Theoretical and numerical aspects of an SVD-based method for band-limiting finite-extent sequences , 1994, IEEE Trans. Signal Process..

[28]  Seda Senay,et al.  Signal Reconstruction from Nonuniformly Spaced Samples Using Evolutionary Slepian Transform-Based POCS , 2010, EURASIP J. Adv. Signal Process..

[29]  Henry Stark,et al.  Probability, Random Processes, and Estimation Theory for Engineers , 1995 .

[30]  H. Landau Necessary density conditions for sampling and interpolation of certain entire functions , 1967 .

[31]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[32]  D. Slepian,et al.  On bandwidth , 1976, Proceedings of the IEEE.

[33]  Richard G. Baraniuk,et al.  The Pros and Cons of Compressive Sensing for Wideband Signal Acquisition: Noise Folding vs. Dynamic Range , 2011, ArXiv.

[34]  D. Slepian Prolate spheroidal wave functions, Fourier analysis and uncertainty — IV: Extensions to many dimensions; generalized prolate spheroidal functions , 1964 .

[35]  Mike E. Davies,et al.  Sampling Theorems for Signals From the Union of Finite-Dimensional Linear Subspaces , 2009, IEEE Transactions on Information Theory.

[36]  R. DeVore,et al.  Instance-optimality in probability with an ℓ1-minimization decoder , 2009 .

[37]  A Tikhonov,et al.  Solution of Incorrectly Formulated Problems and the Regularization Method , 1963 .

[38]  Yoram Bresler,et al.  Further results on spectrum blind sampling of 2D signals , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[39]  Richard G. Baraniuk,et al.  The compressive multiplexer for multi-channel compressive sensing , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[41]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[42]  E.J. Candes Compressive Sampling , 2022 .

[43]  Deanna Needell,et al.  Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit , 2007, Found. Comput. Math..

[44]  D. Slepian,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — II , 1961 .

[45]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[46]  Zhifeng Zhang,et al.  Adaptive time-frequency decompositions , 1994 .

[47]  Justin K. Romberg,et al.  Beyond Nyquist: Efficient Sampling of Sparse Bandlimited Signals , 2009, IEEE Transactions on Information Theory.

[48]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[49]  Dale H. Mugler,et al.  LINEAR PREDICTION OF BANDPASS SIGNALS BASED ON PAST SAMPLES , 1999 .

[50]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[51]  H. Pollak,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — III: The dimension of the space of essentially time- and band-limited signals , 1962 .

[52]  David L. Phillips,et al.  A Technique for the Numerical Solution of Certain Integral Equations of the First Kind , 1962, JACM.

[53]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[54]  Luis F. Chaparro,et al.  Reconstruction of nonuniformly sampled time-limited signals using prolate spheroidal wave functions , 2009, Signal Process..

[55]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[56]  Louis L. Scharf,et al.  The SVD and reduced rank signal processing , 1991, Signal Process..

[57]  David L. Donoho,et al.  Sparse Solution Of Underdetermined Linear Equations By Stagewise Orthogonal Matching Pursuit , 2006 .

[58]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[59]  Laurent Gosse,et al.  Compressed sensing with preconditioning for sparse recovery with subsampled matrices of Slepian prolate functions , 2013 .

[60]  Yonina C. Eldar,et al.  From Theory to Practice: Sub-Nyquist Sampling of Sparse Wideband Analog Signals , 2009, IEEE Journal of Selected Topics in Signal Processing.

[61]  Emmanuel J. Candès,et al.  How well can we estimate a sparse vector? , 2011, ArXiv.

[62]  Richard Baraniuk,et al.  Compressive Domain Interference Cancellation , 2009 .

[63]  Y. Bresler,et al.  Spectrum-blind minimum-rate sampling and reconstruction of 2-D multiband signals , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[64]  Richard G. Baraniuk,et al.  Random Filters for Compressive Sampling and Reconstruction , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[65]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[66]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[67]  Michael B. Wakin,et al.  Analysis of Orthogonal Matching Pursuit Using the Restricted Isometry Property , 2009, IEEE Transactions on Information Theory.

[68]  Kareem E. Baddour,et al.  Channel estimation using DPSS based frames , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[69]  Richard G. Lyons,et al.  Understanding Digital Signal Processing , 1996 .

[70]  D. Slepian Some comments on Fourier analysis, uncertainty and modeling , 1983 .

[71]  José Carlos Príncipe,et al.  On the relationship between the Karhunen-Loeve transform and the prolate spheroidal wave functions , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[72]  V. Buldygin,et al.  Metric characterization of random variables and random processes , 2000 .

[73]  Ping Feng,et al.  Spectrum-blind minimum-rate sampling and reconstruction of multiband signals , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[74]  Thomas Blumensath,et al.  Sampling and Reconstructing Signals From a Union of Linear Subspaces , 2009, IEEE Transactions on Information Theory.