Multicenter Development and Validation of a Multimodal Deep Learning Model to Predict Moderate to Severe Acute Kidney Injury

Background: Prior models for the early identification of acute kidney injury (AKI) have utilized structured data (e.g., vital signs and laboratory values). We aimed to develop and validate a deep learning model to predict moderate to severe AKI by combining structured data and information from unstructured notes. Methods: Adults (≥18 years) admitted to the University of Wisconsin (2009-20) and the University of Chicago Medicine (2016-22) were eligible for inclusion. Patients were excluded if they had no documented serum creatinine (SCr), end-stage kidney disease, an admission SCr≥3.0mg/dL, developed ≥Stage 2 AKI before reaching the wards or intensive care unit (ICU), or required dialysis (KRT) within the first 48 hours. Text from unstructured notes was mapped to standardized Concept Unique Identifiers (CUIs) to create predictor variables, and structured data variables were also included. An intermediate fusion deep learning recurrent neural network architecture was used to predict ≥Stage 2 AKI within the next 48 hours. This multimodal model was developed in the first 80% of the data and temporally validated in the next 20%. Results: There were 339,998 admissions in the derivation cohort and 84,581 in the validation cohort, with 12,748 (3%) developing ≥Stage 2 AKI. Patients with ≥Stage 2 AKI were older, more likely to be male, had higher baseline SCr, and were more commonly in the ICU (p<0.001 for all). The multimodal model outperformed a model based only on structured data for all outcomes, with an area under the receiver operating characteristic curve (95% CI) of 0.88(0.88-0.88) for predicting ≥Stage 2 AKI and 0.93(0.93-0.94) for receiving KRT. The area under the precision-recall-curve for ≥Stage 2 AKI was 0.20. Results were similar during external validation. Conclusions: We developed and validated a multimodal deep learning model using structured and unstructured data that predicts the development of severe AKI across the hospital stay for earlier intervention.