Covering numbers for real-valued function classes

We find tight upper and lower bounds on the growth rate for the covering numbers of functions of bounded variation in the /spl Lscr//sub 1/ metric in terms of all the relevant constants. We also find upper and lower bounds on covering numbers for general function classes over the family of /spl Lscr//sub 1/(dP) metrics in terms of a scale-sensitive combinatorial dimension of the function class.

[1]  A. Kolmogorov,et al.  Entropy and "-capacity of sets in func-tional spaces , 1961 .

[2]  J. Lamperti.  ON CONVERGENCE OF STOCHASTIC PROCESSES , 1962 .

[3]  G. Lorentz.  Metric entropy and approximation , 1966 .

[4]  R. A. Silverman,et al.  Introductory Real Analysis , 1972 .

[5]  R. Dudley.  Central Limit Theorems for Empirical Measures , 1978 .

[6]  R. F. Hoskins,et al.  Sampling Expansions for Functions Band-Limited in the Distributional Sense , 1984 .

[7]  P. Groeneboom.  Some current developments in density estimation , 1985 .

[8]  L. Birge.  Estimating a Density under Order Restrictions: Nonasymptotic Minimax Risk , 1987 .

[9]  G. Walter.  Sampling Bandlimited Functions of Polynomial Growth , 1988 .

[10]  David Haussler,et al.  Decision Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications , 1992, Inf. Comput..

[11]  Noga Alon,et al.  Scale-sensitive dimensions, uniform convergence, and learnability , 1993, Proceedings of 1993 IEEE 34th Annual Foundations of Computer Science.

[12]  Philip M. Long,et al.  More theorems about scale-sensitive dimensions and learning , 1995, COLT '95.

[13]  David Haussler,et al.  Sphere Packing Numbers for Subsets of the Boolean n-Cube with Bounded Vapnik-Chervonenkis Dimension , 1995, J. Comb. Theory, Ser. A.

[14]  Peter L. Bartlett,et al.  On efficient agnostic learning of linear combinations of basis functions , 1995, COLT '95.

[15]  Noga Alon,et al.  Scale-sensitive dimensions, uniform convergence, and learnability , 1997, JACM.

[16]  David Haussler,et al.  A Graph-theoretic Generalization of the Sauer-Shelah Lemma , 1998, Discret. Appl. Math..