System reliability estimation and confidence regions from subsystem and full system tests

This paper develops a rigorous and practical method for estimating the reliability-with confidence regions-of a complex system based on a combination of full system and subsystem (and/or component or other) tests. It is assumed that the system is composed of multiple processes (e.g., the subsystems and/or components within subsystems), where the subsystems may be arranged in series, parallel (i.e., redundant), combination series/parallel, or other mode. Maximum likelihood estimation (MLE) is used to estimate the overall system reliability. Interestingly, for a given number of subsystems and/or components, the likelihood function does not change with the system configuration; rather, only the optimization constraints change, leading to an appropriate MLE. The MLE approach is well suited to providing asymptotic or finite-sample confidence bounds through the use of Fisher information or bootstrap Monte Carlo-based sampling.

[1]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[2]  D.G. Dudley,et al.  Dynamic system identification experiment design and data analysis , 1979, Proceedings of the IEEE.

[3]  Albert H. Moore,et al.  Comparison of Monte Carlo Techniques for Obtaining System-Reliability Confidence Limits , 1980, IEEE Transactions on Reliability.

[4]  B. Hoadley.  Asymptotic Properties of Maximum Likelihood Estimators for the Independent Not Identically Distributed Case , 1971 .

[5]  Bengt Lindoff,et al.  Bootstrap control , 2006, IEEE Transactions on Automatic Control.

[6]  Sam C. Saunders,et al.  On Confidence Limits for the Reliability of Systems , 1968 .

[7]  Lawrence M. Leemis,et al.  Reliability: Probabilistic Models and Statistical Methods , 1994 .

[8]  R. Serfling.  Approximation Theorems of Mathematical Statistics , 1980 .

[9]  D. Coit.  System-reliability confidence-intervals for complex-systems with estimated component-reliability , 1997 .

[10]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[11]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[12]  Frank A. Tillman,et al.  System-Reliability Evaluation Techniques for Complex/Large SystemsߞA Review , 1981, IEEE Transactions on Reliability.

[13]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[14]  H. Piaggio.  Mathematical Analysis , 1955, Nature.

[15]  Robert G. Easterling,et al.  Approximate Confidence Limits for System Reliability , 1972 .

[16]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[17]  M. Kupperman.  Linear Statistical Inference and Its Applications 2nd Edition (C. Radhakrishna Rao) , 1975 .

[18]  P. W. Zehna.  Invariance of Maximum Likelihood Estimators , 1966 .

[19]  Jason Brown,et al.  Reliability: Probabilistic Models and Statistical Methods , 1996 .

[20]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[21]  Wei Jiang,et al.  On improved confidence bounds for system reliability , 2006, IEEE Transactions on Reliability.

[22]  J.C. Spall,et al.  Variance of Bounds in Inequality-Based Reliability Estimates , 2007, 2007 American Control Conference.

[23]  R. Serfling.  Approximation Theorems of Mathematical Statistics , 1980 .