Topics in Non-Parametric Statistics

The subject of Nonparametric statistics is statistical inference applied to noisy observations of infinite-dimensional “parameters” like images and time-dependent signals. This is a mathematical area on the border between Statistics and Functional Analysis, the latter name taken in its “literal” meaning – as geometry of spaces of functions. What follows is the 8-lecture course given by the author at The XXVIII Saint-Flour Summer School on Probability Theory. It would be impossible to outline in a short course the contents of rich and highly developed area of Non-parametric Statistics; we restrict ourselves with a number of selected topics related to estimating nonparametric regression functions and functionals of these functions. The presentation is self-contained, modulo a few facts from the theory of functional spaces.

[1]  G. Pisier.  Remarques sur un résultat non publié de B. Maurey , 1981 .

[2]  R. Z. Khasʹminskiĭ,et al.  Statistical estimation : asymptotic theory , 1981 .

[3]  Prakasa Rao.  Nonparametric functional estimation , 1983 .

[4]  John Darzentas,et al.  Problem Complexity and Method Efficiency in Optimization , 1983 .

[5]  Lucien Birgé.  Approximation dans les espaces métriques et théorie de l'estimation , 1983 .

[6]  G. Andrews,et al.  Classical orthogonal polynomials , 1985 .

[7]  B. Yandell.  Spline smoothing and nonparametric regression , 1989 .

[8]  G. Wahba.  Spline models for observational data , 1990 .

[9]  A. Nemirovskii.  On Necessary Conditions for Efficient Estimation of Functionals of a Nonparametric Signal in White Noise , 1991 .

[10]  O. Lepskii.  On a Problem of Adaptive Estimation in Gaussian White Noise , 1991 .

[11]  Murray Rosenblatt,et al.  Stochastic Curve Estimation , 1991 .

[12]  O. Lepskii.  Asymptotically Minimax Adaptive Estimation. I: Upper Bounds. Optimally Adaptive Estimates , 1992 .

[13]  W. Härdle.  Applied Nonparametric Regression , 1992 .

[14]  A. Nemirovskii,et al.  On nonparametric estimation of functions satisfying differential inequalities , 1992 .

[15]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[16]  A. Tsybakov,et al.  Minimax theory of image reconstruction , 1993 .

[17]  D. L. Donoho,et al.  Ideal spacial adaptation via wavelet shrinkage , 1994 .

[18]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[19]  E. Mammen,et al.  Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors , 1997 .

[20]  Arkadi Nemirovski,et al.  Adaptive de-noising of signals satisfying differential inequalities , 1997, IEEE Trans. Inf. Theory.