Accuracy and clinical validity of automated cephalometric analysis using convolutional neural networks

Abstract Background This study aimed to assess the error range of cephalometric measurements based on the landmarks detected using cascaded CNNs and determine how horizontal and vertical positional errors of individual landmarks affect lateral cephalometric measurements. Methods In total, 120 lateral cephalograms were obtained consecutively from patients (mean age, 32.5 ± 11.6) who visited the Asan Medical Center, Seoul, Korea, for orthodontic treatment between 2019 and 2021. An automated lateral cephalometric analysis model previously developed from a nationwide multi‐centre database was used to digitize the lateral cephalograms. The horizontal and vertical landmark position error attributable to the AI model was defined as the distance between the landmark identified by the human and that identified by the AI model on the x‐ and y‐axes. The differences between the cephalometric measurements based on the landmarks identified by the AI model vs those identified by the human examiner were assessed. The association between the lateral cephalometric measurements and the positioning errors in the landmarks comprising the cephalometric measurement was assessed. Results The mean difference in the angular and linear measurements based on AI vs human landmark localization was .99 ± 1.05°, and .80 ± .82 mm, respectively. Significant differences between the measurements derived from AI‐based and human localization were observed for all cephalometric variables except SNA, pog‐Nperp, facial angle, SN‐GoGn, FMA, Bjork sum, U1‐SN, U1‐FH, IMPA, L1‐NB (angular) and interincisal angle. Conclusions The errors in landmark positions, especially those that define reference planes, may significantly affect cephalometric measurements. The possibility of errors generated by automated lateral cephalometric analysis systems should be considered when using such systems for orthodontic diagnoses.