Comparison of consistency in acute stroke: Automated ASPECT score software tools and manual consensus scores

Purpose The Alberta Stroke Program Early Computed Tomography Score (ASPECTS) is a standardized semi-quantitative scoring system. It is widely used to assess the extent of acute ischemic stroke (AIS). We evaluated the consistency of three automatic software packages with the overall and region-specific manual ASPECTS scores of AIS patients. Methods Retrospectively, we gathered patients who presented with stroke symptoms between February 2019 and June 2022, and 174 cases were eventually included in the trial. Two radiologists reviewed the NCCT images independently; After four weeks, the same two radiologists began randomly reviewing the DWI images, discussed different scores and give consistent results as ground truth. Results Median ASPECTS of the expert consensus reading was 7 (5–9). Good to excellent correlation of ASPECTS total scores among the three software tools (0.70, 0.74 and 0.83). Correlation among ground truth and Rapid-ASPECTS, RealNow-ASPECTS, ShuKun-ASPECTS (ICC = 0.51, Cronbach's α = 0.53), (ICC = 0.60, Cronbach's α = 0.70) and (ICC = 0.52, Cronbach's α = 0.64) respectively. The AUCs for Rapid, RealNow and ShuKun were 0.61, 0.67, and 0.62 respectively. The region-specific results showed a poor to good correlation. The correlations between the non-dominant and dominant cerebral hemispheres and the ground truth were statistically different (P < 0.05). Conclusions Overall, the scoring consistency between the three automated scoring software and the ground truth is comparable, with RealNow-ASPECTS being no less consistent and effective than Rapid-ASPECTS and ShuKun-ASPECTS, and even better than both. But the consistency grade that still is developable.