Identification for Systems With Binary Subsystems

Consider a stochastic system of multiple subsystems, each subsystem having binary (“0” or “1”) output. The full system may have general binary or nonbinary (e.g., Gaussian) output. Such systems are widely encountered in practice, and include engineering systems for reliability, communications, and sensor networks, the collection of patients in a clinical trial, and Internet-based control systems. This paper considers the identification of parameters for such systems for general structural relationships between the subsystems and the full system. Maximum likelihood estimation (MLE) is used to estimate the mean output for the full system and the “success” probabilities for the subsystems. We present formal conditions for the convergence of the MLEs to the true full system and subsystem values as well as results on the asymptotic distributions for the MLEs. The MLE approach is well suited to providing asymptotic or finite-sample confidence bounds through the use of Fisher information or bootstrap Monte Carlo-based sampling.

[1]  Donghua Zhou,et al.  Leakage Fault Diagnosis for an Internet-Based Three-Tank System: An Experimental Study , 2012, IEEE Transactions on Control Systems Technology.

[2]  Ori Davidov,et al.  Order-Restricted Inference for Multivariate Binary Data With Application to Toxicology , 2011, Journal of the American Statistical Association.

[3]  G. Yin,et al.  System Identification with Quantized Observations , 2010 .

[4]  Fang-Kuo Sun,et al.  A maximum likelihood algorithm for the mean and covariance of nonidentically distributed observations , 1982 .

[5]  James C. Spall,et al.  Asymptotic normality and uncertainty bounds for reliability estimates from subsystem and full system tests , 2012, 2012 American Control Conference (ACC).

[6]  R. Serfling.  Approximation Theorems of Mathematical Statistics , 1980 .

[7]  Z. Birnbaum,et al.  Modules of Coherent Binary Systems , 1965 .

[8]  Han La Poutré,et al.  A Versatile Approach to Combining Trust Values for Making Binary Decisions , 2006, iTrust.

[9]  Luc Pronzato,et al.  Optimal experimental design and some related control problems , 2008, Autom..

[10]  Coire J. Maranzano,et al.  Robust test design for reliability estimation with modeling error when combining full system and subsystem tests , 2010, Proceedings of the 2010 American Control Conference.

[11]  Harry F. Martz,et al.  Bayesian reliability analysis of series systems of binomial subsystems and components , 1988 .

[12]  Nick G. Duffield,et al.  Network Tomography of Binary Network Performance Characteristics , 2006, IEEE Transactions on Information Theory.

[13]  Joel W. Burdick,et al.  Analysis of Search Decision Making Using Probabilistic Search Strategies , 2012, IEEE Transactions on Robotics.

[14]  Wei Jiang,et al.  On improved confidence bounds for system reliability , 2006, IEEE Transactions on Reliability.

[15]  Adrian Pagan,et al.  Estimation, Inference and Specification Analysis. , 1996 .

[16]  James C. Spall,et al.  Maximum likelihood-based estimation of parameters in systems with binary subsystems , 2013, 2013 47th Annual Conference on Information Sciences and Systems (CISS).

[17]  Christos G. Cassandras,et al.  Distributed Coverage Control and Data Collection With Mobile Sensor Networks , 2010, IEEE Transactions on Automatic Control.

[18]  Christine M. Anderson-Cook,et al.  Reliability Models for Almost-Series and Almost-Parallel Systems , 2010, Technometrics.

[19]  W. Fleming.  Functions of Several Variables , 1965 .

[20]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[21]  Thomas L. Marzetta,et al.  Parameter estimation problems with singular information matrices , 2001, IEEE Trans. Signal Process..

[22]  Alexandros A. Taflanidis,et al.  Probabilistically-robust performance optimization for controlled linear stochastic systems , 2009, 2009 American Control Conference.

[23]  James C. Spall.  Convergence analysis for maximum likelihood-based reliability estimation from subsystem and full system tests , 2010, 49th IEEE Conference on Decision and Control (CDC).

[24]  James C. Spall,et al.  System reliability estimation and confidence regions from subsystem and full system tests , 2009, 2009 American Control Conference.

[25]  S. D. Silvey,et al.  The Lagrangian Multiplier Test , 1959 .

[26]  Le Yi Wang,et al.  Quantized Identification With Dependent Noise and Fisher Information Ratio of Communication Channels , 2010, IEEE Transactions on Automatic Control.

[27]  T. Apostol.  Mathematical Analysis , 1957 .

[28]  James C. Spall,et al.  Parameter estimation for systems with binary subsystems , 2013, 2013 American Control Conference.

[29]  James C. Spall,et al.  Framework for estimating system reliability from full system and subsystem tests with dependence on dynamic inputs , 2011, IEEE Conference on Decision and Control and European Control Conference.

[30]  B. Hoadley.  Asymptotic Properties of Maximum Likelihood Estimators for the Independent Not Identically Distributed Case , 1971 .