Predicting dire outcomes of patients with community acquired pneumonia

Community-acquired pneumonia (CAP) is an important clinical condition with regard to patient mortality, patient morbidity, and healthcare resource utilization. The assessment of the likely clinical course of a CAP patient can significantly influence decision making about whether to treat the patient as an inpatient or as an outpatient. That decision can in turn influence resource utilization, as well as patient well being. Predicting dire outcomes, such as mortality or severe clinical complications, is a particularly important component in assessing the clinical course of patients. We used a training set of 1601 CAP patient cases to construct 11 statistical and machine-learning models that predict dire outcomes. We evaluated the resulting models on 686 additional CAP-patient cases. The primary goal was not to compare these learning algorithms as a study end point; rather, it was to develop the best model possible to predict dire outcomes. A special version of an artificial neural network (NN) model predicted dire outcomes the best. Using the 686 test cases, we estimated the expected healthcare quality and cost impact of applying the NN model in practice. The particular, quantitative results of this analysis are based on a number of assumptions that we make explicit; they will require further study and validation. Nonetheless, the general implication of the analysis seems robust, namely, that even small improvements in predictive performance for prevalent and costly diseases, such as CAP, are likely to result in significant improvements in the quality and efficiency of healthcare delivery. Therefore, seeking models with the highest possible level of predictive performance is important. Consequently, seeking ever better machine-learning and statistical modeling methods is of great practical significance.

[1]  M. Fine,et al.  The Cost of Treating Patients with Community-Acquired Pneumonia , 1999 .

[2]  M. Niederman,et al.  The cost of treating community-acquired pneumonia. , 1998, Clinical therapeutics.

[3]  Pat Langley,et al.  Induction of Selective Bayesian Classifiers , 1994, UAI.

[4]  A. Fasoli [Clinical decision analysis]. , 1986, Annali italiani di medicina interna : organo ufficiale della Societa italiana di medicina interna.

[5]  Peter C. Cheeseman,et al.  Bayesian Classification (AutoClass): Theory and Results , 1996, Advances in Knowledge Discovery and Data Mining.

[6]  Inger,et al.  A prediction rule to identify low-risk patients with community-acquired pneumonia. , 1997, The New England journal of medicine.

[7]  Gregory F. Cooper,et al.  A Bayesian Network Classifier that Combines a Finite Mixture Model and a NaIve Bayes Model , 1999, UAI.

[8]  D. Hand,et al.  Idiot's Bayes—Not So Stupid After All? , 2001 .

[9]  T. Marrie,et al.  A controlled trial of a critical pathway for treatment of community-acquired pneumonia. CAPITAL Study Investigators. Community-Acquired Pneumonia Intervention Trial Assessing Levofloxacin. , 2000, JAMA.

[10]  C. Schoenborn,et al.  Current estimates from the National Health Interview Survey. , 1988, Vital and health statistics. Series 10, Data from the National Health Survey.

[11]  P. F. Adams,et al.  Current estimates from the National Health Interview Survey, 1994. , 1995, Vital and health statistics. Series 10, Data from the National Health Survey.

[12]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[13]  Tom M. Mitchell,et al.  Using the Future to Sort Out the Present: Rankprop and Multitask Learning for Medical Risk Evaluation , 1995, NIPS.

[14]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[15]  Pat Langley,et al.  An Analysis of Bayesian Classifiers , 1992, AAAI.

[16]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[17]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[18]  David Maxwell Chickering,et al.  Efficient Approximations for the Marginal Likelihood of Bayesian Networks with Hidden Variables , 1997, Machine Learning.

[19]  Yaser S. Abu-Mostafa,et al.  Learning from hints in neural networks , 1990, J. Complex..

[20]  John Foster Provost,et al.  Policies for the selection of bias in inductive machine learning , 1992 .

[21]  L. Ohno-Machado Journal of Biomedical Informatics , 2001 .

[22]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[23]  G. Chapman,et al.  [Medical decision making]. , 1976, Lakartidningen.

[24]  Henry Tirri,et al.  On the Accuracy of Stochastic Complexity Approximations , 1999 .

[25]  E. Graves Summary : National Hospital Discharge Survey , 1994 .

[26]  Foster J. Provost,et al.  Inductive policy: The pragmatics of bias selection , 1995, Machine Learning.

[27]  Pneumonia and influenza death rates--United States, 1979-1994. , 1995, MMWR. Morbidity and mortality weekly report.

[28]  Steven C. Suddarth,et al.  Symbolic-Neural Systems and the Use of Hints for Developing Complex Systems , 1991, Int. J. Man Mach. Stud..

[29]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[30]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[31]  Bruce G. Buchanan,et al.  A framework for autonomous knowledge discovery from databases , 2001 .

[32]  V. Clark,et al.  Computer-aided multivariate analysis , 1991 .

[33]  W. P. Dixon,et al.  BMPD statistical software manual , 1988 .

[34]  E J Graves,et al.  1994 summary: National Hospital Discharge Survey. , 1996, Advance data.

[35]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[36]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[37]  M. Weinstein,et al.  Clinical Decision Analysis , 1980 .