Generalized Additive Models: Some Applications

Abstract Generalized additive models have the form η(x) = α + σ fj (x j ), where η might be the regression function in a multiple regression or the logistic transformation of the posterior probability Pr(y = 1 | x) in a logistic regression. In fact, these models generalize the whole family of generalized linear models η(x) = β′x, where η(x) = g(μ(x)) is some transformation of the regression function. We use the local scoring algorithm to estimate the functions fj (xj ) nonparametrically, using a scatterplot smoother as a building block. We demonstrate the models in two different analyses: a nonparametric analysis of covariance and a logistic regression. The procedure can be used as a diagnostic tool for identifying parametric transformations of the covariates in a standard linear analysis. A variety of inferential tools have been developed to aid the analyst in assessing the relevance and significance of the estimated functions: these include confidence curves, degrees of freedom estimates, and approximat...

[1]  R. M. Williams.  EXPERIMENTAL DESIGNS FOR SERIALLY CORRELATED OBSERVATIONS , 1952 .

[2]  C. Reinsch.  Smoothing by spline functions , 1967 .

[3]  Frank M. Andrews,et al.  Multiple classification analysis , 1967 .

[4]  Anthony C. Atkinson,et al.  The use of residuals as a concomitant variable , 1969 .

[5]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[6]  J. Anderson.  Separate sample logistic discrimination , 1972 .

[7]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[8]  G. Wahba,et al.  A completely automatic french curve: fitting spline functions by cross validation , 1975 .

[9]  M. Stone,et al.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[10]  B. Efron.  The Efficiency of Cox's Likelihood Function for Censored Data , 1977 .

[11]  Frederick Mosteller,et al.  Data Analysis and Regression , 1978 .

[12]  Stephen E. Fienberg,et al.  The analysis of cross-classified categorical data , 1980 .

[13]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[14]  J. Nelder,et al.  The GLIM System Release 3. , 1979 .

[15]  G. Dyke,et al.  An investigation into inter-plot interactions, in experiments with mildew on barley, using balanced designs , 1979 .

[16]  Irwin Guttman,et al.  Incorporating Overlap Effects from Neighbouring Units into Response Surface Models , 1980 .

[17]  L. Simons,et al.  CORONARY RISK FACTOR SCREENING , 1980, The Medical journal of Australia.

[18]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[19]  D. Pregibon.  Logistic Regression Diagnostics , 1981 .

[20]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[21]  Jerome H. Friedman,et al.  Smoothing of Scatterplots , 1982 .

[22]  D. Pregibon.  Resistant fits for some commonly used logistic models with medical application. , 1982, Biometrics.

[23]  J. Rossouw,et al.  Coronary risk factor screening in three rural communities. The CORIS baseline study. , 1983, South African medical journal = Suid-Afrikaanse tydskrif vir geneeskunde.

[24]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[25]  D. Pregibon,et al.  Graphical Methods for Assessing Logistic Regression Models , 1984 .

[26]  P. Green.  Iteratively reweighted least squares for maximum likelihood estimation , 1984 .

[27]  Peter Green.  Linear models for field trials, smoothing and cross-validation , 1985 .

[28]  B. Silverman,et al.  Some Aspects of the Spline Smoothing Approach to Non‐Parametric Regression Curve Fitting , 1985 .

[29]  J. Friedman,et al.  Estimating Optimal Transformations for Multiple Regression and Correlation. , 1985 .

[30]  B. Yandell,et al.  Semi-Parametric Generalized Linear Models. , 1985 .

[31]  N. Draper,et al.  Role of the Papadakis estimator in one- and two-dimensional field trials , 1985 .

[32]  C. J. Stone,et al.  The Dimensionality Reduction Principle for Generalized Additive Models , 1986 .

[33]  B. Yandell,et al.  Automatic Smoothing of Regression Functions in Generalized Linear Models , 1986 .

[34]  R. Tibshirani,et al.  Generalized Additive Models, Cubic Splines and Penalized Likelihood. , 1987 .

[35]  Trevor Hastie,et al.  Non‐Parametric Logistic and Proportional Odds Regression , 1987 .

[36]  R. Tibshirani,et al.  Local Likelihood Estimation , 1987 .