Bayesian Experimental Design: A Review

This paper reviews the literature on Bayesian experimental design, both for linear and nonlinear models. A uniied view of the topic is presented by putting experimental design in a decision theoretic framework. This framework justiies many optimality criteria, and opens new possibilities. Various design criteria become part of a single, coherent approach.

[1]  G. Elfving.  Optimum Allocation in Linear Regression Theory , 1952 .

[2]  H. Chernoff.  Locally Optimal Designs for Estimating Parameters , 1953 .

[3]  D. Lindley.  On a Measure of the Information Provided by an Experiment , 1956 .

[4]  M. Stone.  Application of a Measure of Information to the Design and Comparison of Regression Experiments , 1959 .

[5]  H. L. Lucas,et al.  DESIGN OF EXPERIMENTS IN NON-LINEAR SITUATIONS , 1959 .

[6]  G. Box,et al.  A Basis for the Selection of a Response Surface Design , 1959 .

[7]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[8]  Herman Chernoff,et al.  Optimal Accelerated Life Designs for Estimation , 1962 .

[9]  M. Degroot.  Uncertainty, Information, and Sequential Experiments , 1962 .

[10]  Howard Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[11]  W. G. Hunter,et al.  Design of experiments for parameter estimation in multiresponse situations , 1966 .

[12]  W. G. Hunter,et al.  The use of prior distributions in the design of experiments for parameter estimation in non-linear situations. , 1967, Biometrika.

[13]  W. G. Hunter,et al.  The use of prior distributions in the design of experiments for parameter estimation in non-linear situations: multiresponse case. , 1967, Biometrika.

[14]  D. Lindley.  The Choice of Variables in Multiple Regression , 1968 .

[15]  Bimal Kumar Sinha,et al.  A Bayesian Approach to Optimum Allocation in Regression Problems , 1970 .

[16]  P. Freeman.  Optimal Bayesian sequential estimation of the median effective dose , 1970 .

[17]  M. Degroot.  Optimal Statistical Decisions , 1970 .

[18]  R. J. Owen,et al.  The Optimum Design of a Two-Factor Experiment Using Prior Information , 1970 .

[19]  S. Silvey,et al.  Optimal regression designs with previous observations , 1970 .

[20]  O. Dykstra.  The Augmentation of Experimental Data to Maximize [X′X] , 1971 .

[21]  I. Guttman.  A Remark on the Optimal Regression Designs with Previous Observations of Covey-Crump and Silvey , 1971 .

[22]  R. Brooks.  A decision theory approach to optimal regression designs , 1972 .

[23]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[24]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[25]  Anthony C. Atkinson,et al.  Planning experiments to detect inadequate regression models , 1972 .

[26]  Robert K. Tsutakawa,et al.  Design of Experiment for Bioassay , 1972 .

[27]  A. Hendrickson,et al.  A Method for Constructing an Optimal Regression Design After an Initial Set of Input Values Has Been Selected , 1973 .

[28]  L. White.  An extension of the General Equivalence Theorem to nonlinear models , 1973 .

[29]  Model choice and parameter estimation in regression analysis , 1973 .

[30]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[31]  R. Brooks.  On the choice of an experiment for prediction in linear regression , 1974 .

[32]  Raman K. Mehra,et al.  Optimal input signals for parameter estimation in dynamic systems--Survey and new results , 1974 .

[33]  E. Läuter.  Experimental design in a class of models , 1974 .

[34]  J. Kiefer.  Construction and optimality of generalized Youden designs II , 1975 .

[35]  R. Owen,et al.  A Bayesian Sequential Procedure for Quantal Response in the Context of Adaptive Mental Testing , 1975 .

[36]  S. Zacks,et al.  Problems and Approaches in Design of Experiments for Estimation and Testing in Non-Linear Models. , 1975 .

[37]  D. V. Gokhale,et al.  A Survey of Statistical Design and Linear Models. , 1976 .

[38]  L. White.  The optimal design of experiments for estimation in non-linear models , 1975 .

[39]  R. Brooks.  Optimal regression designs for prediction when prior knowledge is available , 1976 .

[40]  G. C. Tiao,et al.  Some bayesian considerations of the choice of design for ranking, selection and estimation , 1976 .

[41]  E. Läuter,et al.  Optimal multipurpose designs for regression models , 1976 .

[42]  R. J. Brooks.  Optimal regression design for control in linear regression , 1977 .

[43]  J. Bernardo.  Expected Information as Expected Utility , 1979 .

[44]  James W. Evans.  Computer Augmentation of Experimental Designs to Maximize |X'X , 1979 .

[45]  Prem K. Goel,et al.  Bayesian estimation and optimal designs in partially accelerated life testing , 1979 .

[46]  S. Silvey,et al.  A sequentially constructed design for estimating a nonlinear parametric function , 1980 .

[47]  W. Näther,et al.  Estimation and experimental design in a linear regression model using prior information , 1980 .

[48]  R. Tsutakawa.  Selection of Dose Levels for Estimating a Percentage Point of a Logistic Quantal Response Curve , 1980 .

[49]  I. Verdinelli,et al.  A note on Bayes designs for inference using a hierarchical linear model , 1980 .

[50]  F. Pukelsheim.  On linear regression designs which maximize information , 1980 .

[51]  V. Fedorov,et al.  Convex design theory 1 , 1980 .

[52]  D. DeMets,et al.  Sample sizes for long-term medical trial with time-dependent dropout and event rates. , 1980, Controlled clinical trials.

[53]  M. R. Novick,et al.  The Role of Exchangeability in Inference , 1981 .

[54]  J. Pilz,et al.  Robust bayes and minimax-bayes estimation design in linear regression 1 , 1981 .

[55]  Christopher J. Nachtsheim,et al.  Model Robust, Linear-Optimal Designs , 1982 .

[56]  Elliot M. Landaw,et al.  Optimal multicompartmental sampling designs for parameter estimation: Practical aspects of the identification problem , 1982 .

[57]  On the loss of information through censoring , 1982 .

[58]  George E. P. Box.  Choice of Response Surface Design and Alphabetic Optimality. , 1982 .

[59]  Jürgen Pilz,et al.  Construction of optimal designs in random coefficient regression models , 1982 .

[60]  Jürgen Pilz,et al.  Bayes designs for multiple linear regression on the unit sphere , 1982 .

[61]  D. Katz,et al.  Experimental design for estimating integrals by numerical quadrature, with applications to pharmacokinetic studies. , 1983, Biometrics.

[62]  Alessandra Giovagnoli,et al.  Bayes D-optimal and E-optimal block designs , 1983 .

[63]  Experimental design for Bayesian estimations in the linear regression model taking costs into account , 1983 .

[64]  M. E. Johnson,et al.  Some Guidelines for Constructing Exact D-Optimal Designs on Convex Design Spaces , 1983 .

[65]  L. Kuo.  Bayesian Bioassay Design , 1983 .

[66]  Michael A. Saunders,et al.  User''s guide for NPSOL (Ver-sion 4.0): A FORTRAN package for nonlinear programming , 1984 .

[67]  Jerome Sacks,et al.  Some Model Robust Designs in Regression , 1984 .

[68]  J. Buonaccorsi,et al.  A comparison of confidence regions and designs in estimation of a ratio , 1984 .

[69]  Fulvio Spezzaferri,et al.  A Predictive Model Selection Criterion , 1984 .

[70]  K. Chaloner.  Optimal Bayesian Experimental Design for Linear Models , 1984 .

[71]  Jorge Alberto Achcar,et al.  Use of bayesian analysis to design of clinical trials with one treatment , 1984 .

[72]  Donald A. Berry,et al.  Bandit Problems: Sequential Allocation of Experiments. , 1986 .

[73]  W. G. Hunter,et al.  Experimental Design: Review and Comment , 1984 .

[74]  Charles DeLisi,et al.  Mathematics and Computers in Biomedical Applications , 1985 .

[75]  D. G. Watts,et al.  A Quadratic Design Criterion for Precise Estimation in Nonlinear Regression Models , 1985 .

[76]  E. Walter,et al.  How to Design Experiments that are Robust to Parameter Uncertainty , 1985 .

[77]  J. Buonaccorsi.  RATIOS OF LINEAR-COMBINATIONS IN THE GENERAL LINEAR-MODEL , 1985 .

[78]  C. F. Wu,et al.  Efficient Sequential Designs with Binary Data , 1985 .

[79]  E. Walter,et al.  Robust experiment design via stochastic approximation , 1985 .

[80]  D. Titterington,et al.  Inference and sequential design , 1985 .

[81]  D. Steinberg.  Model robust response surface designs: Scaling two-level factorials , 1985 .

[82]  J. Buonaccorsi,et al.  OPTIMAL DESIGNS FOR RATIOS OF LINEAR-COMBINATIONS IN THE GENERAL LINEAR-MODEL , 1986 .

[83]  D. Spiegelhalter,et al.  A predictive approach to selecting the size of a clinical trial, based on subjective clinical opinion. , 1986, Statistics in medicine.

[84]  Prem K. Goel,et al.  Bayesian Design and Analysis of Accelerated Life Testing with Step Stress , 1986 .

[85]  Morris H. DeGroot,et al.  Concepts of Information Based on Utility , 1986 .

[86]  Jürgen Pilz,et al.  Once more: optimal experimental design for regression models (with discussion) , 1987 .

[87]  David Lindley,et al.  Bayesian Statistics, a Review , 1987 .

[88]  David S. Scott,et al.  A computer program for the design of group testing experiments , 1987 .

[89]  H. Chernoff.  Sequential Analysis and Optimal Design , 1987 .

[90]  P. W. Jones,et al.  Bandit Problems, Sequential Allocation of Experiments , 1987 .

[91]  R. Brooks,et al.  On the design of comparative lifetime studies , 1987 .

[92]  I. Verdinelli,et al.  A feasible directions method for computing Bayes E -optimal block designs , 1988 .

[93]  Eric Walter,et al.  Qualitative and Quantitative Experiment Design for Nonlinear Models , 1988 .

[94]  Optimal design for the estimation of variance components , 1988 .

[95]  E. Lakatos,et al.  Sample sizes based on the log-rank statistic in complex clinical trials. , 1988, Biometrics.

[96]  Paul H. Garthwaite,et al.  Quantifying Expert Opinion in Linear Regression Problems , 1988 .

[97]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[98]  R J Sylvester,et al.  A bayesian approach to the design of phase II clinical trials. , 1988, Biometrics.

[99]  D. Titterington,et al.  An optimal design problem in rhythmometry. , 1988, Biometrics.

[100]  李幼升,et al.  Ph , 1989 .

[101]  K. Chaloner.  Bayesian design for estimating the turning point of a quadratic regression , 1989 .

[102]  K. Chaloner,et al.  Optimal Bayesian design applied to logistic regression experiments , 1989 .

[103]  Paola Sebastiani,et al.  Experimental designs for mean and variance estimation in variance components models , 1989 .

[104]  D. M. Titterington,et al.  Recent advances in nonlinear experiment design , 1989 .

[105]  William D. Dupont,et al.  Power and sample size calculations. A review and computer program. , 1990, Controlled clinical trials.

[106]  D Z D'Argenio,et al.  Incorporating prior parameter uncertainty in the design of sampling schedules for pharmacokinetic parameter estimation experiments. , 1990, Mathematical biosciences.

[107]  Società italiana di fisica,et al.  Accelerated Life Testing and Experts' Opinion in Reliability , 1990 .

[108]  Francisco J. Samaniego.  Accelerated Life Testing and Experts' Opinions in Reliability , 1990 .

[109]  H. Dette,et al.  A Generalization of $D$- and $D_1$-Optimal Designs in Polynomial Regression , 1990 .

[110]  D A Berry,et al.  Experimental design for drug development: a Bayesian approach. , 1991, Journal of biopharmaceutical statistics.

[111]  Blaza Toman,et al.  Bayesian optimal experimental design for treatment—control comparisons in the presence of two-way heterogeneity , 1991 .

[112]  Holger Dette,et al.  A note on robust designs for polynomial regression , 1991 .

[113]  Computing the optimal design for a calibration experiment , 1991 .

[114]  T. J. Mitchell,et al.  Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments , 1991 .

[115]  A. Atkinson,et al.  Optimum experimental design for discriminating between two rival models in the presence of prior information , 1991 .

[116]  W. J. Studden,et al.  Bayesian Optimal Designs for Linear Regression Models , 1991 .

[117]  I. Ford,et al.  The Use of a Canonical Form in the Construction of Locally Optimal Designs for Non‐Linear Problems , 1992 .

[118]  W. J. Studden,et al.  Compromise designs in heteroscedastic linear models , 1992 .

[119]  Rick L. Edgeman,et al.  LISP-STAT: An Object-Oriented Environment for Statistical Computing and Dynamic Graphics , 1992 .

[120]  F. Pukelsheim,et al.  Efficient rounding of approximate designs , 1992 .

[121]  K. Chaloner,et al.  Bayesian design for accelerated life testing , 1992 .

[122]  I. Verdinelli,et al.  Bayesian designs for maximizing information and outcome , 1992 .

[123]  Dibyen Majumdar.  Optimal Designs for Comparing Test Treatments with a Control Utilizing Prior Information , 1992 .

[124]  Matthias Nagel,et al.  LISP-Stat: an object-oriented environment for statistical computing and dynamic graphics: Luke Tierney (1990) New York: John Wiley & Sons, 397 pp, ISBN 0-471-50916-7, 32.15 [pound sign] sterling , 1992 .

[125]  Henry P. Wynn,et al.  Screening, predicting, and computer experiments , 1992 .

[126]  Jürgen Pilz,et al.  Bayesian estimation and experimental design in linear regression models , 1992 .

[127]  S. F. Mousavi,et al.  An approach to the design of experiments for discriminating among alternative conceptual models , 1992 .

[128]  Bayesian robust experimental designs for the one-way analysis of variance , 1992 .

[129]  Andrej Pázman,et al.  Nonlinear experimental design based on the distribution of estimators , 1992 .

[130]  Dulal K. Bhaumik,et al.  Optimal data augmentation strategies for additive models , 1993 .

[131]  I. Verdinelli,et al.  Shannon Information and Bayesian Design for Prediction in Accelerated Life-Testing , 1993 .

[132]  T. J. Mitchell,et al.  Bayesian design and analysis of computer experiments: Use of derivatives in surface prediction , 1993 .

[133]  K. Chaloner,et al.  Optimum experimental designs for properties of a compartmental model. , 1993, Biometrics.

[134]  James L. Rosenberger,et al.  Experimental Designs for Model Discrimination , 1993 .

[135]  H. Dette.  Elfving's Theorem for $D$-Optimality , 1993 .

[136]  Giovanni Parmigiani,et al.  On Optimal Screening Ages , 1993 .

[137]  Joseph B. Kadane,et al.  Optimal Experimental Design for Another's Analysis , 1993 .

[138]  Kathryn Chaloner,et al.  A note on optimal Bayesian design for nonlinear problems , 1993 .

[139]  Giovanni Parmigiani,et al.  A Cost-Utility Analysis of Alternative Strategies in Screening for Breast Cancer , 1993 .

[140]  Isabella Verdinelli,et al.  Biased coin designs with a Bayesian bias , 1993 .

[141]  J. Gastwirth,et al.  Robust Bayesian experimental design and estimation for analysis of variance models using a class of normal mixtures , 1993 .

[142]  Nancy Flournoy,et al.  A Clinical Experiment in Bone Marrow Transplantation: Estimating a Percentage Point of a Quantal Response Curve , 1993 .

[143]  Weng Kee Wong,et al.  On the Equivalence of Constrained and Compound Optimal Designs , 1994 .

[144]  W. Näther.  Optimum experimental designs , 1994 .

[145]  Michael Jackson,et al.  Optimal Design of Experiments , 1994 .

[146]  Blaza Toman,et al.  Bayes Optimal Designs for Two- and Three-Level Factorial Experiments , 1994 .

[147]  Robert E. Kass,et al.  Some Diagnostics of Maximum Likelihood and Posterior Nonnormality , 1994 .

[148]  Anirban DasGupta,et al.  Uniform and subuniform posterior robustness: The sample size problem , 1994 .

[149]  D. Berry,et al.  Applications of Lindley Information Measure to the Design of Clinical Experiments , 1994 .

[150]  W. DuMouchel,et al.  A simple Bayesian modification of D-optimal designs to reduce dependence on an assumed model , 1994 .

[151]  M. Lawera.  Predictive inference : an introduction , 1995 .

[152]  Anthony C. Atkinson,et al.  D-Optimum Designs for Heteroscedastic Linear Models , 1995 .

[153]  J H Shih,et al.  Sample size calculation for complex clinical trials with survival endpoints. , 1995, Controlled clinical trials.

[154]  P. Laycock,et al.  Optimum Experimental Designs , 1995 .

[155]  Linda M. Haines,et al.  Bayesian D-optimal designs for the exponential growth model , 1995 .

[156]  Linda M. Haines,et al.  A Geometric Approach to Optimal Design for One‐Parameter Non‐Linear Models , 1995 .

[157]  M. Clyde.  Bayesian Designs for Approximate Normality , 1995 .

[158]  Giovanni Parmigiani,et al.  Optimal Design for Heart Defibrillators , 1995 .

[159]  M. S. Ridout,et al.  Three-stage designs for seed testing experiments , 1995 .

[160]  Seymour Geisser,et al.  8. Predictive Inference: An Introduction , 1995 .

[161]  S. Lohr.  Optimal Bayesian design of experiments for the one-way random effects model , 1995 .

[162]  Holger Dette,et al.  A note on Bayesian c- and D-optimal designs in nonlinear regression models , 1996 .

[163]  Eva Riccomagno,et al.  Experimental Design and Observation for Large Systems , 1996 .

[164]  B. Toman.  Bayesian Experimental Design for Multiple Hypothesis Testing , 1996 .

[165]  K. Chaloner,et al.  The Equivalence of Constrained and Weighted Designs in Multiple Objective Design Problems , 1996 .

[166]  Dongchu Sun,et al.  Bayesian design of experiment for quantal responses: What is promised versus what is delivered , 1996 .

[167]  M. L. Eaton,et al.  A predictive approach to the Bayesian design problem with application to normal regression models , 1996 .

[168]  P. Müller,et al.  Numerical Evaluation of Information- Theoretic Measures , 1996 .

[169]  Holger Dette,et al.  Bayesian D-optimal designs for exponential regression models , 1997 .