Clinical Decision Support for Improved Neonatal Care: The Development of a Machine Learning Model for the Prediction of Late-onset Sepsis and Necrotizing Enterocolitis

Objective

To develop an artificial intelligence-based software system for predicting late-onset sepsis (LOS) and necrotizing enterocolitis (NEC) in infants admitted to the neonatal intensive care unit (NICU).

Study design

Single-center, retrospective cohort study, conducted in the NICU of the Antwerp University Hospital. Continuous monitoring data of 865 preterm infants born at <32 weeks gestational age, admitted to the NICU in the first week of life, were used to train an XGBoost machine learning (ML) algorithm for LOS and NEC prediction in a cross-validated setup. Afterward, the model's performance was assessed on an independent test set of 148 patients (internal validation).

Results

The ML model delivered hourly risk predictions with an overall sensitivity of 69% (142/206) for all LOS/NEC episodes and 81% (67/83) for severe LOS/NEC episodes. The model showed a median time gain of ≤10 hours (IQR, 3.1-21.0 hours), compared with historical clinical diagnosis. On the complete retrospective dataset, the ML model made 721 069 predictions, of which 9805 (1.3%) depicted a LOS/NEC probability of ≥0.15, resulting in a total alarm rate of <1 patient alarm-day per week. The model reached a similar performance on the internal validation set.

Conclusions

Artificial intelligence technology can assist clinicians in the early detection of LOS and NEC in the NICU, which potentially can result in clinical and socioeconomic benefits. Additional studies are required to quantify further the effect of combining artificial and human intelligence on patient outcomes in the NICU.