Deep learning-based analysis of infrared fundus photography for automated diagnosis of diabetic retinopathy with cataracts

To develop deep learning-based networks for the diagnosis of diabetic retinopathy (DR) with cataracts based on infrared fundus images.Shanghai General Hospital, Shanghai Eye Disease Prevention & Treatment Center, Shanghai, China.Development and evaluation of an artificial intelligence (AI) diagnostic method.A total of 10 665 infrared fundus images from 4553 patients with diabetes were used to train and test the model. For image quality assessment, left and right eye classification, DR diagnosis and grading, and segmentation of 3 DR lesions, an end-to-end software using EfficientNet and UNet was developed. The accuracy and performance of the software in comparison to human experts was evaluated.The model achieved an accuracy of 75.31% for left and right eye classification, 100% for DR grading and diagnosis tasks, and 73.67% for internal test set, with corresponding areas under the curve (AUCs) of 0.88, 1.00, and 0.89, respectively. For DR lesion segmentation, the AUCs of hemorrhagic, microangioma, and exudative lesions were 0.86, 0.66, and 0.84, respectively. In addition, a contrast test of human-machine film reading confirmed the software's high sensitivity (96.3%) and specificity (90.0%) and consistency with the manual film reading group (κ = 0.869, P < .001). This easily deployable software generated reports quickly and promoted efficient DR screening with cataracts in clinical and community settings.AI-assisted software can perform automatic analysis of infrared fundus images and has substantial application value for the diagnosis of DR patients with cataracts.