Using aggregate patient data at the bedside via an on-demand consultation service

Using evidence derived from previously collected medical records to guide patient care has been a long standing vision of clinicians and informaticians, and one with the potential to transform medical practice. As a result of advances in technical infrastructure, statistical analysis methods, and the availability of patient data at scale, an implementation of this vision is now possible. Motivated by these advances, and the information needs of clinicians in our academic medical center, we offered an on-demand consultation service to derive evidence from patient data to answer clinician questions and support their bedside decision making. We describe the design and implementation of the service as well as a summary of our experience in responding to the first 100 requests. Consultation results informed individual patient care, resulted in changes to institutional practices, and motivated further clinical research. We make the tools and methods developed to implement the service publicly available to facilitate the broad adoption of such services by health systems and academic medical centers.

[1]  K. Mandl,et al.  HIPAA and the Leak of "Deidentified" EHR Data. , 2021, The New England journal of medicine.

[2]  M. Suchard,et al.  Use of repurposed and adjuvant drugs in hospital patients with covid-19: multinational network cohort study , 2021, BMJ.

[3]  Jennifer L. Caswell-Jin,et al.  Treatment and Monitoring Variability in US Metastatic Breast Cancer Care. , 2021, JCO clinical cancer informatics.

[4]  James R. Rogers,et al.  Comparison of Clinical Characteristics Between Clinical Trial Participants and Nonparticipants Using Electronic Health Record Data , 2021, JAMA network open.

[5]  M. Suchard,et al.  COVID-19 in patients with autoimmune diseases: characteristics and outcomes in a multinational network of cohorts across three countries , 2021, Rheumatology.

[6]  Alison Callahan,et al.  ACE: the Advanced Cohort Engine for searching longitudinal patient records , 2021, J. Am. Medical Informatics Assoc..

[7]  A. Callahan,et al.  Association of Systemic Diseases With Surgical Treatment for Obstructive Sleep Apnea Compared With Continuous Positive Airway Pressure. , 2021, JAMA otolaryngology-- head & neck surgery.

[8]  S. Schneeweiss,et al.  Emulating Randomized Clinical Trials with Nonrandomized Real-World Evidence Studies: First Results from the RCT DUPLICATE Initiative. , 2020, Circulation.

[9]  Rae Woong Park,et al.  Deep phenotyping of 34,128 adult patients hospitalised with COVID-19 in an international network study , 2020, Nature Communications.

[10]  Rae Woong Park,et al.  Comparative safety and effectiveness of alendronate versus raloxifene in women with osteoporosis , 2020, Scientific Reports.

[11]  Jonathan H. Chen,et al.  Research and Reporting Considerations for Observational Studies Using Electronic Health Record Data , 2020, Annals of Internal Medicine.

[12]  Somalee Datta,et al.  A new paradigm for accelerating clinical data science at Stanford Medicine , 2020, ArXiv.

[13]  N. Shah,et al.  Treatment Patterns for Chronic Comorbid Conditions in Patients With Cancer Using a Large-Scale Observational Data Network , 2020, JCO clinical cancer informatics.

[14]  Kush R. Varshney,et al.  Characterization of Overlap in Observational Studies , 2019, AISTATS.

[15]  Mark S Levenson,et al.  Nonrandomized Real‐World Evidence to Support Regulatory Decision Making: Process for a Randomized Trial Replication Project , 2020, Clinical pharmacology and therapeutics.

[16]  A. Callahan,et al.  210. Step-down from IV to oral therapy in patients with bacteremia due to Enterobacteriaceae: fluoroquinolones (FQ) vs. ß-lactams (BL) or trimethoprim-sulfamethoxazole (TMP-SMX) , 2019, Open Forum Infectious Diseases.

[17]  A. Callahan,et al.  Real-world efficacy of bone modifying agents (BMAs) in patients with breast cancer (BC) treated in an academic health system: Use of the “green button. , 2019, Journal of Clinical Oncology.

[18]  J. Robins,et al.  On Nearly Assumption-Free Tests of Nominal Confidence Interval Coverage for Causal Parameters Estimated by Machine Learning , 2019, 2008.03288.

[19]  Christopher Ré,et al.  Medical device surveillance with electronic health records , 2019, npj Digital Medicine.

[20]  Alison Callahan,et al.  It is time to learn from patients like mine , 2019, npj Digital Medicine.

[21]  M. Wheeler,et al.  CARDIOVASCULAR SAFETY OF MEXILETINE AS A THERAPY FOR MYOTONIA IN PATIENTS WITH MYOTONIC DYSTROPHY , 2019, Journal of the American College of Cardiology.

[22]  Atul J Butte,et al.  A call for deep-learning healthcare , 2019, Nature Medicine.

[23]  Yan Kang,et al.  Comparison of diagnostic accuracy among procalcitonin, C-reactive protein, and interleukin 6 for blood culture positivity in general ICU patients , 2018, Critical Care.

[24]  M. Bassetti,et al.  Comparison between procalcitonin and C-reactive protein to predict blood culture results in ICU patients , 2018, Critical Care.

[25]  George Hripcsak,et al.  Association of Hemoglobin A1c Levels With Use of Sulfonylureas, Dipeptidyl Peptidase 4 Inhibitors, and Thiazolidinediones in Patients With Type 2 Diabetes Treated With Metformin , 2018, JAMA network open.

[26]  Tina Hernandez-Boussard,et al.  Advances in Electronic Phenotyping: From Rule-Based Definitions to Machine Learning Models. , 2018, Annual review of biomedical data science.

[27]  M. Schuemie,et al.  Comparative effectiveness of canagliflozin, SGLT2 inhibitors and non‐SGLT2 inhibitors on the risk of hospitalization for heart failure and amputation in patients with type 2 diabetes mellitus: A real‐world meta‐analysis of 4 observational databases (OBSERVE‐4D) , 2018, Diabetes, obesity & metabolism.

[28]  Alison Callahan,et al.  Performing an Informatics Consult: Methods and Challenges. , 2018, Journal of the American College of Radiology : JACR.

[29]  Inci M. Baytas,et al.  An MCEM Framework for Drug Safety Signal Detection and Combination from Heterogeneous Real World Evidence , 2018, Scientific Reports.

[30]  P. Pronovost,et al.  Funding Innovation in a Learning Health Care System. , 2018, JAMA.

[31]  Trevor Hastie,et al.  Some methods for heterogeneous treatment effect estimation in high dimensions , 2017, Statistics in medicine.

[32]  Nigam H. Shah,et al.  Identifying cases of metastatic prostate cancer using machine learning on electronic health records , 2018, AMIA.

[33]  Michel Wolff,et al.  Procalcitonin to initiate or discontinue antibiotics in acute respiratory tract infections. , 2017, The Cochrane database of systematic reviews.

[34]  N. Roberts,et al.  Clinician-targeted interventions to influence antibiotic prescribing behaviour for acute respiratory infections in primary care: an overview of systematic reviews. , 2017, The Cochrane database of systematic reviews.

[35]  Nigam H. Shah,et al.  Electronic phenotyping with APHRODITE and the Observational Health Sciences and Informatics (OHDSI) data network , 2017, CRI.

[36]  George Hripcsak,et al.  Risk of angioedema associated with levetiracetam compared with phenytoin: Findings of the observational health data sciences and informatics research network , 2017, Epilepsia.

[37]  N. Shah,et al.  Association Between Androgen Deprivation Therapy and Risk of Dementia , 2017, JAMA oncology.

[38]  Peter J Embi,et al.  Creating Local Learning Health Systems: Think Globally, Act Locally. , 2016, JAMA.

[39]  Petra Kaufmann,et al.  Transforming Evidence Generation to Support Health and Health Care Decisions. , 2016, The New England journal of medicine.

[40]  Christopher Lucas,et al.  The Balance-Sample Size Frontier in Matching Methods for Causal Inference , 2016 .

[41]  Harlan M. Krumholz,et al.  Data Acquisition, Curation, and Use for a Continuously Learning Health System. , 2016, JAMA.

[42]  Joel T Dudley,et al.  Androgen Deprivation Therapy and Future Alzheimer's Disease Risk. , 2016, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[43]  Rae Woong Park,et al.  Characterizing treatment pathways at scale using the OHDSI network , 2016, Proceedings of the National Academy of Sciences.

[44]  Nigam H. Shah,et al.  Learning statistical models of phenotypes using noisy labeled training data , 2016, J. Am. Medical Informatics Assoc..

[45]  J. Brooks,et al.  New Paradigms for Patient-Centered Outcomes Research in Electronic Medical Records: An Example of Detecting Urinary Incontinence Following Prostatectomy , 2016, EGEMS.

[46]  M. Makary,et al.  Medical error—the third leading cause of death in the US , 2016, British Medical Journal.

[47]  James M Robins,et al.  Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available. , 2016, American journal of epidemiology.

[48]  Jacques LeLorier,et al.  Head to head comparison of the propensity score and the high-dimensional propensity score matching methods , 2016, BMC Medical Research Methodology.

[49]  Guan Wang,et al.  A method for systematic discovery of adverse drug events from clinical notes , 2015, J. Am. Medical Informatics Assoc..

[50]  Suzanne Tamang,et al.  Detecting unplanned care from clinician notes in electronic health records. , 2015, Journal of oncology practice.

[51]  N. Shah,et al.  A 'green button' for using aggregate patient data at the point of care. , 2014, Health affairs.

[52]  S Claiborne Johnston,et al.  Transforming from centers of learning to learning health systems: the challenge for academic health centers. , 2014, JAMA.

[53]  T. Werge,et al.  Dose-Specific Adverse Drug Reaction Identification in Electronic Patient Records: Temporal Data Mining in an Inpatient Psychiatric Population , 2014, Drug Safety.

[54]  Mei‐Ling Yeh Achieving knowledge translation in nursing care: the need for greater rigor in applying evidence to practice. , 2014, The journal of nursing research : JNR.

[55]  N. Shah,et al.  Pharmacovigilance Using Clinical Notes , 2013, Clinical pharmacology and therapeutics.

[56]  Cédrick Fairon,et al.  Annotation analysis for testing drug safety signals using unstructured clinical notes , 2012, J. Biomed. Semant..

[57]  Madeleine Udell,et al.  Analyzing Patterns of Drug Use in Clinical Notes for Patient Safety , 2012, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[58]  Martijn J. Schuemie,et al.  A Reference Standard for Evaluation of Methods for Drug Safety Signal Detection Using Electronic Healthcare Record Databases , 2012, Drug Safety.

[59]  J. Frankovich,et al.  Evidence-based medicine in the EMR era. , 2011, The New England journal of medicine.

[60]  McGinnis Jm,et al.  Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care: Workshop Series Summary , 2011 .

[61]  P. Austin An Introduction to Propensity Score Methods for Reducing the Effects of Confounding in Observational Studies , 2011, Multivariate behavioral research.

[62]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[63]  Elizabeth A Stuart,et al.  Matching methods for causal inference: A review and a look forward. , 2010, Statistical science : a review journal of the Institute of Mathematical Statistics.

[64]  Susan C. Weber,et al.  STRIDE - An Integrated Standards-Based Translational Research Informatics Platform , 2009, AMIA.

[65]  T. Bregenzer,et al.  Effect of procalcitonin-based guidelines vs standard guidelines on antibiotic use in lower respiratory tract infections: the ProHOSP randomized controlled trial. , 2009, JAMA.

[66]  Isaac S Kohane,et al.  Tectonic shifts in the health information economy. , 2008, The New England journal of medicine.

[67]  James M. Walker,et al.  Bridging the inferential gap: the electronic health record and clinical evidence. , 2007, Health affairs.

[68]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[69]  M. Christ-Crain,et al.  Effect of procalcitonin-guided treatment on antibiotic use and outcome in lower respiratory tract infections: cluster-randomised, single-blinded intervention trial , 2004, The Lancet.

[70]  N. Black Why we need observational studies to evaluate the effectiveness of health care , 1996, BMJ.

[71]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[72]  A. Detsky,et al.  Evidence-based medicine. A new approach to teaching the practice of medicine. , 1992, JAMA.

[73]  C F Starmer,et al.  A new information system for medical practice. , 1975, Archives of internal medicine.

[74]  A R Feinstein,et al.  Estimating prognosis with the aid of a conversational-mode computer program. , 1972, Annals of internal medicine.