Robust test design for reliability estimation with modeling error when combining full system and subsystem tests

This paper develops a method for finding a robust test plan, which consists of a mixture of full system and subsystem tests, to estimate the reliability of a system given that the model for the system reliability is flawed. A robust test plan is developed by trading off the number of full system and subsystem tests to minimize the mean-squared error (MSE) of the maximum likelihood estimate (MLE) of system reliability. The MSE is decomposed into the variance of the MLE and a bias from incorrectly specifying the model that relates the subsystem reliabilities to the full system reliability (series, parallel, other). The variance of the MLE is based on the inverse Fisher Information. The bias is due to the modeling error. A demonstration of the test plan determination is given for a hypothetical system by trading off between the MSE (estimation accuracy), the degree of modeling error, and the cost of doing system and subsystem tests. A Pareto frontier can be identified, as illustrated in the paper.

[1]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[2]  James C. Spall,et al.  System reliability estimation and confidence regions from subsystem and full system tests , 2009, 2009 American Control Conference.

[3]  Coire J. Maranzano,et al.  Bayesian reanalysis of the Challenger O-ring data. , 2008, Risk analysis : an official publication of the Society for Risk Analysis.

[4]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[5]  Tim Hesterberg,et al.  Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control , 2004, Technometrics.

[6]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[7]  Roman Krzysztofowicz,et al.  Hydrologic uncertainty processor for probabilistic river stage forecasting , 2000 .

[8]  Sankaran Mahadevan,et al.  Model uncertainty and Bayesian updating in reliability-based inspection , 2000 .

[9]  Shin Ta Liu,et al.  Risk Modeling, Assessment, and Management , 1999, Technometrics.

[10]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[11]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[12]  M. Kupperman.  Linear Statistical Inference and Its Applications 2nd Edition (C. Radhakrishna Rao) , 1975 .

[13]  W. F. Trench,et al.  Multivariable Calculus with Linear Algebra and Series , 1972 .

[14]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .