Implementation Details
Model Development and Training
Duke Health initiated Sepsis Watch in 2016 through DIHI, collaborating with data scientists, clinicians, and ethicists. The team curated a dataset from over 250,000 patient encounters (2014-2017), labeling sepsis per Sepsis-3 criteria. Using deep neural networks (LSTM-based for time-series data), the model processed 200+ features from EHRs, outperforming traditional ML like XGBoost with an AUROC of 0.935 for 3-hour predictions and 0.927 at 6 hours. [1] Explainability features, like feature importance visualizations, built trust.
Integration into Clinical Workflows
Launched in November 2018 on inpatient units, Sepsis Watch integrated as an Epic Best Practice Advisory (BPA), alerting nurses via banner when risk >5%. Phased rollout: pilot on one unit, then system-wide by 2020 including all three EDs (Duke University Hospital, Duke Regional, Duke Raleigh). Customization ensured alerts fired only for high-confidence cases, with low volume (1-2/day per unit) to combat fatigue. Clinician feedback loops refined thresholds quarterly. [2]
Overcoming Implementation Challenges
Key hurdles included data quality (missing EHR values) addressed via imputation and robust training; regulatory hurdles navigated with IRB approval and FDA discussions (deemed non-device); and change management. DIHI's human-centered AI approach involved 100+ clinician interviews, resulting in 95% satisfaction and <10% override rate. Scalability tested via A/B pilots showed no unintended consequences. [3]
Evaluation and Iteration
Post-deployment, Duke tracked metrics via dashboards: time-to-antibiotics dropped 1.2 hours, bundle compliance rose 20%. A 2020 JMIR study confirmed feasibility, with plans for expansion to other conditions like AKI. By 2023, monitoring thousands daily, it reshaped Duke's AI governance, emphasizing reproducibility and equity. [4] Ongoing updates incorporate new data, maintaining performance.