Reproducibility and Accuracy of the PRIMARY Score on PSMA PET and of PI-RADS on Multiparametric MRI for Prostate Cancer Diagnosis Within a Real-World Database

The PRIMARY score is a 5-category scale developed to identify clinically significant intraprostate malignancy (csPCa) on ⁶⁸Ga-prostate-specific membrane antigen (PSMA)-11 PET/CT (⁶⁸Ga-PSMA PET) using a combination of anatomic site, pattern, and intensity. Developed within the PRIMARY trial, the score requires evaluation in external datasets. This study aimed to assess the reproducibility and diagnostic accuracy of the PRIMARY score in a cohort of patients who underwent multiparametric MRI (mpMRI) and ⁶⁸Ga-PSMA PET before prostate biopsy for the diagnosis of prostate cancer. Methods: In total, data from 242 men who had undergone ⁶⁸Ga-PSMA PET and mpMRI before transperineal prostate biopsy were available for this ethics-approved retrospective study. ⁶⁸Ga-PSMA PET and mpMRI data were centrally collated in a cloud-based deidentified image database. Six experienced prostate-focused nuclear medicine specialists were trained (1 h) in applying the PRIMARY score with 30 sample images. Six radiologists experienced in prostate mpMRI read images as per the Prostate Imaging-Reporting and Data System (PI-RADS), version 2.1. All images were read (with masking of clinical information) at least twice, with discordant findings sent to a masked third (or fourth) reader as necessary. Cohen κ was determined for both imaging scales as 5 categories and then collapsed to binary (negative and positive) categories (score 1 or 2 vs. 3, 4, or 5). Diagnostic performance parameters were calculated, with an International Society of Urological Pathology grade group of at least 2 (csPCa) on biopsy defined as the gold standard. Combined-imaging-positive results were defined as any PI-RADS score of 4 or 5 or as a PI-RADS score of 1-3 with a PRIMARY score of 3-5. Results: In total, 227 patients with histopathology, ⁶⁸Ga-PSMA PET, and mpMRI imaging before prostate biopsy were included; 33% had no csPCa, and 67% had csPCa. Overall interrater reliability was higher for the PRIMARY scale (κ = 0.70) than for PI-RADS (κ = 0.58) when assessed as a binary category (benign vs. malignant). This was similar for all 5 categories (κ = 0.65 vs. 0.48). Diagnostic performance to detect csPCa was comparable between PSMA PET and mpMRI (sensitivity, 86% vs. 89%; specificity, 76% vs. 74%; positive predictive value, 88% vs. 88%; negative predictive value, 72% vs. 76%). Using combined imaging, sensitivity was 94%, specificity was 68%, positive predictive value was 86%, and negative predictive value was 85%. Conclusion: The PRIMARY score applied by first-user nuclear medicine specialists showed substantial interrater reproducibility, exceeding that of PI-RADS applied by mpMRI-experienced radiologists. Diagnostic performance was similar between the 2 modalities. The PRIMARY score should be considered when interpreting intraprostatic PSMA PET images.