Diagnostic Accuracy and Observer Agreement of the MRI Prostate Imaging for Recurrence Reporting Assessment Score

Background Prostate cancer local recurrence location and extent must be determined in an accurate and timely manner. Because of the lack of a standardized MRI approach after whole-gland treatment, a panel of international experts recently proposed the Prostate Imaging for Recurrence Reporting (PI-RR) assessment score. Purpose To determine the diagnostic accuracy of PI-RR for detecting local recurrence in patients with biochemical recurrence (BCR) after radiation therapy (RT) or radical prostatectomy (RP) and to evaluate the interreader variability of PI-RR scoring. Materials and Methods This retrospective observational study included patients who underwent multiparametric MRI between September 2016 and May 2021 for BCR after RT or RP. MRI scans were analyzed, and a PI-RR score was assigned independently by four radiologists. The reference standard was defined using histopathologic findings, follow-up imaging, or clinical response to treatment. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were calculated to assess PI-RR performance for each reader. The intraclass correlation coefficient was used to determine interreader agreement. Results A total of 100 men were included: 48 patients after RT (median age, 76 years [IQR, 70-82 years]) and 52 patients after RP (median age, 70 years [IQR, 66-74 years]). After RT, with PI-RR of 3 or greater as a cutoff (assigned when recurrence is uncertain), diagnostic performance ranges were 71%-81% sensitivity, 74%-93% specificity, 71%-89% PPV, 79%-86% NPV, and 77%-88% accuracy across the four readers. After RP, with PI-RR of 3 or greater as a cutoff, performance ranges were 59%-83% sensitivity, 87%-100% specificity, 88%-100% PPV, 66%-80% NPV, and 75%-85% accuracy. The intraclass correlation coefficient was 0.87 across the four readers for both the RT and RP groups. Conclusion MRI scoring with the Prostate Imaging for Recurrence Reporting assessment provides structured, reproducible, and accurate evaluation of local recurrence after definitive therapy for prostate cancer. © RSNA, 2022 Online supplemental material is available for this article. See also the editorial by Haider in this issue. An earlier incorrect version appeared online. This article was corrected on May 11, 2022.