An implicit function based procedure for analyzing maximum likelihood estimates from nonidentically distributed data

A methodology is presented for gaining insight into properties — such as outlier influence, bias, and width of confidence intervals — of maximum likelihood estimates from nonidentically distributed Gaussian data. The methodology is based on an application of the implicit function theorem to derive an approximation to the maximum likelihood estimator. This approximation, unlike the maximum likelihood estimator, is expressed in closed form and thus it can be used in lieu of costly Monte Carlo simulation to study the properties of the maximum likelihood estimator.

[1]  3 – Variance Estimates for Complex Statistics from Multistage Sample Surveys , 1978 .

[2]  Beverley D. Causey,et al.  Computerized Method for Approximating the Variance of a Complicated Estimate , 1976 .

[3]  J. Rao,et al.  Inference From Stratified Samples: Properties of the Linearization, Jackknife and Balanced Repeated Replication Methods , 1981 .

[4]  William S. Levine,et al.  Efficient Maximum Likelihood Identification of a Positive Semi-Definite Covariance of Initial Population Statistics , 1984, 1984 American Control Conference.

[5]  Influence and a Quadratic Form in the Andrews—Pregibon Statistic , 1985 .

[6]  R. Shumway,et al.  Estimation and tests of hypotheses for the initial mean and covariance in the kalman filter model , 1981 .

[7]  Ralph A. Bradley,et al.  The asymptotic properties of ML estimators when sampling from associated populations , 1962 .

[8]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[9]  Fang-Kuo Sun,et al.  A maximum likelihood algorithm for the mean and covariance of nonidentically distributed observations , 1982 .

[10]  J. Berger,et al.  Empirical Bayes Estimation of Rates in Longitudinal Studies , 1983 .

[11]  S. Geisser,et al.  A Predictive View of the Detection and Characterization of Influential Observations in Regression Analysis , 1983 .

[12]  B. Hoadley Asymptotic Properties of Maximum Likelihood Estimators for the Independent Not Identically Distributed Case , 1971 .

[13]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[14]  Subir Ghosh Influential observations in view of design and inference , 1983 .

[15]  R. R. Hocking,et al.  The regression dilemma , 1983 .

[16]  Subir Ghosh Information in an observation in robust designs , 1982 .

[17]  G. Gray,et al.  Estimation for small areas in household surveys , 1981 .