Bayesian Active Learning for Sensitivity Analysis

Designs of micro electro-mechanical devices need to be robust against fluctuations in mass production. Computer experiments with tens of parameters are used to explore the behavior of the system, and to compute sensitivity measures as expectations over the input distribution. Monte Carlo methods are a simple approach to estimate these integrals, but they are infeasible when the models are computationally expensive. Using a Gaussian processes prior, expensive simulation runs can be saved. This Bayesian quadrature allows for an active selection of inputs where the simulation promises to be most valuable, and the number of simulation runs can be reduced further. We present an active learning scheme for sensitivity analysis which is rigorously derived from the corresponding Bayesian expected loss. On three fully featured, high dimensional physical models of electro-mechanical sensors, we show that the learning rate in the active learning scheme is significantly better than for passive learning.

[1]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .

[2]  D. Lindley The Choice of Variables in Multiple Regression , 1968 .

[3]  A. O'Hagan,et al.  Curve Fitting and Optimal Design for Prediction , 1978 .

[4]  David Lindley,et al.  Bayesian Statistics, a Review , 1987 .

[5]  Anthony O'Hagan,et al.  Monte Carlo is fundamentally unsound , 1987 .

[6]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[7]  M. E. Johnson,et al.  Minimax and maximin distance designs , 1990 .

[8]  A. O'Hagan,et al.  Bayes–Hermite quadrature , 1991 .

[9]  David J. C. MacKay,et al.  Information-Based Objective Functions for Active Data Selection , 1992, Neural Computation.

[10]  Harald Niederreiter,et al.  Random number generation and Quasi-Monte Carlo methods , 1992, CBMS-NSF regional conference series in applied mathematics.

[11]  Henry P. Wynn,et al.  Screening, predicting, and computer experiments , 1992 .

[12]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[13]  Maurice Queyranne,et al.  An Exact Algorithm for Maximum Entropy Sampling , 1995, Oper. Res..

[14]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[15]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[16]  Carl E. Rasmussen,et al.  Bayesian Monte Carlo , 2002, NIPS.

[17]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[18]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[19]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[20]  T. Pfingsten,et al.  Model-Based Design Analysis and Yield Optimization , 2006, IEEE Transactions on Semiconductor Manufacturing.