Reproducibility assessment of radiomics features in various ultrasound scan settings and different scanner vendors

Introduction Radiomics in Ultrasound (US) imaging has been investigated for the prediction and prognosis of cancers. However, inter-scanner and intra-scanner variations may affect the reproducibility of radiomics results. This study aims to evaluate the reproducibility of US textural radiomics features across various scan settings and scanner vendors. Materials and methods US images in quality control (QC) phantom were obtained by three scanners (Philips, Samsung, and Siemens) with different scan settings and parameters. Circular regions of interest (ROIs) inside isoechoic, hypoechoic, and hyperechoic objects were manually delineated. Forty textural radiomics features were extracted from each ROI, and then the robust features that could distinguish different echogenic objects were obtained by the Mann-Whitney U test. Reproducibility of the robust radiomics features was assessed by the intraclass correlation coefficient (ICC) and coefficient of variation (CV); ICC>0.90 and %CV<20 were considered reproducible. Results According to the Mann-Whitney U test results, ten robust features could differentiate the hypoechoic, and 15 robust features could differentiate the hyperechoic objects from the isoechoic objects (P<0.001). The total ICC of the robust features for each echogenic object was >0.95 in different scanners and scan settings. Four and seven features were individually reproducible (%CV < 20, ICC>0.90) in hypoechoic and hyperechoic objects, respectively. Also, four features seem reproducible by changing the ROI location across the horizontal and vertical lines for both convex and linear array transducers. Conclusions Most of the US textural radiomics features in this study were not reproducible. However, several features showed high reproducibility at different scan settings and scanners. These features may also be reproducible when ROI size and location change slightly.