Performance of multiple multi-cancer detection tests using a large independent reference set (Alliance A212102)

Abstract Background Reference sets are needed to evaluate performance of multi-cancer detection (MCD) assays. The National Cancer Institute (NCI) funded the Alliance reference set study to assess MCDs for use in future trials. Methods Individuals with cancer and controls were recruited; blood specimens were collected prior to cancer treatment. A performance evaluation study was designed utilizing reference set samples. Companies (n = 6) were selected to participate based on review of performance data and ability to utilize the blood collection tube. Companies received samples from cancer types their assay was designed to detect (“targeted”), plus additional “non-targeted” and control samples. Companies reported positive/negative calls, risk scores, and tissue-of-origin (TOO) predictions. Sensitivity was computed for early (I-II) and late (III-IV) stage cases, based on positive/negative calls (SEPN) and at fixed 98% specificity (SE98). Specificity and TOO accuracy were computed. Results 549 cases (encompassing 13 cancer types) and 413 controls from the reference set were included in the study. Companies assessed samples from median 6 (range 5-9) targeted cancer types and median 8 (range: 7-11) overall cancer types. Median (range) specificity was 92.3% (76.5%-98.5%). Median (range) SEPN was 32% (25%-42%) for early stage 73% (48%-89%) for late stage; while median (range) SE98 was 19% (8%-35%) for early stage and 66% (13%-79%) for late stage. Median sensitivity for non-targeted types was 40% (early stage) and 52% (late stage). Median (range) TOO accuracy (primary predicted site) was 75% (64%-78%). Conclusions Sensitivity and specificity varied widely across assays with early-stage sensitivity substantially lower than late-stage sensitivity.