Deep learning framework to improve the quality of cone‐beam computed tomography for radiotherapy scenarios

Abstract Background The application of cone‐beam computed tomography (CBCT) in image‐guided radiotherapy and adaptive radiotherapy remains limited due to its poor image quality. Purpose In this study, we aim to develop a deep learning framework to generate high‐quality CBCT images for therapeutic applications. Methods The synthetic CT (sCT) generation from the CBCT was proposed using a transformer‐based network with a hybrid loss function. The network was trained and validated using the data from 176 patients to produce a general model that can be extensively applied to enhance CBCT images. After the first therapy, each patient can receive paired CBCT/planning CT (pCT) scans, and the obtained data were used to fine‐tune the general model for further improvement. For subsequent treatment, a patient‐specific, personalized model was made available. In total, 34 patients were examined for general model testing, and another six patients who underwent rescanned pCT scan were used for personalized model training and testing. Results The general model decreased the mean absolute error (MAE) from 135 HU to 59 HU as compared to the CBCT. The hybrid loss function demonstrated superior performance in CT number correction and noise/artifacts reduction. The proposed transformer‐based network also showed superior power in CT number correction compared to the classical convolutional neural network. The personalized model showed improvement based on the general model in some details, and the MAE was reduced from 59 HU (for the general model) to 57 HU ( p < 0.05 Wilcoxon signed‐rank test). Conclusion We established a deep learning framework based on transformer for clinical needs. The deep learning model demonstrated potential for continuous improvement with the help of a suggested personalized training strategy compatible with the clinical workflow.