Nonlinear Solution of Linear Inverse Problems by Wavelet–Vaguelette Decomposition

We describe the wavelet–vaguelette decomposition (WVD) of a linear inverse problem. It is a substitute for the singular value decomposition (SVD) of an inverse problem, and it exists for a class of special inverse problems of homogeneous type—such as numerical differentiation, inversion of Abel-type transforms, certain convolution transforms, and the Radon transform. We propose to solve ill-posed linear inverse problems by nonlinearly "shrinking" the WVD coefficients of the noisy, indirect data. Our approach offers significant advantages over traditional SVD inversion in recovering spatially inhomogeneous objects. We suppose that observations are contaminated by white noise and that the object is an unknown element of a Besov space. We prove that nonlinear WVD shrinkage can be tuned to attain the minimax rate of convergence, for L2 loss, over the entire scale of Besov spaces. The important case of Besov spaces Bσp,q, p < 2, which model spatial inhomogeneity, is included. In comparison, linear procedures— SVD included—cannot attain optimal rates of convergence over such classes in the case p < 2. For example, our methods achieve faster rates of convergence for objects known to lie in the bump algebra or in bounded variation than any linear procedure.

[1]  D. Slepian,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — II , 1961 .

[2]  A Tikhonov,et al.  Solution of Incorrectly Formulated Problems and the Regularization Method , 1963 .

[3]  Advances in Electronics and Electron Physics , 1973 .

[4]  O. Strand Theory and methods related to the singular-function expansion and Landweber's iteration for integral equations of the first kind , 1974 .

[5]  Michael A. Golberg A method of adjoints for solving some Ill-posed equations of the first kind , 1979 .

[6]  R. Anderssen On the Use of Linear Functionals for Abel—Type Integral Equations in Applications , 1980 .

[7]  R. Young,et al.  An introduction to nonharmonic Fourier series , 1980 .

[8]  Mario Bertero,et al.  On the recovery and resolution of exponential relaxation rates from experimental data: a singular-value analysis of the Laplace transform inversion in the presence of noise , 1982, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[9]  M. Nussbaum Spline Smoothing in Regression Models and Asymptotic Efficiency in $L_2$ , 1985 .

[10]  F. Gori,et al.  Signal restoration for linear systems with weighted inputs. Singular value analysis for two cases of low-pass filtering , 1985 .

[11]  I. Ibragimov,et al.  On Nonparametric Estimation of the Value of a Linear Functional in Gaussian White Noise , 1985 .

[12]  Y. Meyer,et al.  Ondelettes et bases hilbertiennes. , 1986 .

[13]  Jürgen Pilz,et al.  Minimax linear regression estimation with symmetric parameter restrictions , 1986 .

[14]  F. O’Sullivan A Statistical Perspective on Ill-posed Inverse Problems , 1986 .

[15]  Intensity fluctuation distributions from photon counting distributions: a singular-system analysis of Poisson transform inversion , 1986 .

[16]  R. S. Anderssen,et al.  The Linear Functional Strategy for Improperly Posed Problems , 1986 .

[17]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[18]  M. Bertero,et al.  Computation of the singular system for a class of integral operators related to data inversion in confocal microscopy , 1989 .

[19]  Andreas Rieder,et al.  Incomplete data problems in X-ray computerized tomography , 1989 .

[20]  S. Mallat Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[21]  Michael Nussbaum,et al.  Minimax quadratic estimation of a quadratic functional , 1990, J. Complex..

[22]  B. Jawerth,et al.  A discrete transform and decompositions of distribution spaces , 1990 .

[23]  D. Donoho,et al.  Minimax Risk Over Hyperrectangles, and Implications , 1990 .

[24]  G. Weiss,et al.  Littlewood-Paley Theory and the Study of Function Spaces , 1991 .

[25]  Bernard W. Silverman,et al.  Discretization effects in statistical inverse problems , 1991, J. Complex..

[26]  D. Donoho,et al.  Renormalization Exponents and Optimal Pointwise Rates of Convergence , 1992 .

[27]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[28]  D. Donoho Unconditional Bases Are Optimal Bases for Data Compression and for Statistical Estimation , 1993 .

[29]  L. Brown,et al.  Asymptotic equivalence of nonparametric regression and white noise , 1996 .