Objective: Our study aimed to evaluate the quality of radiomics studies on brain metastases based on the radiomics quality score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist, and the Image Biomarker Standardization Initiative (IBSI) guidelines. Materials and Methods: PubMed MEDLINE, and EMBASE were searched for articles on radiomics for evaluating brain metastases, published until February 2021. Of the 572 articles, 29 relevant original research articles were included and evaluated according to the RQS, TRIPOD checklist, and IBSI guidelines. Results: External validation was performed in only three studies (10.3%). The median RQS was 3.0 (range,-6 to 12), with a low basic adherence rate of 50.0%. The adherence rate was low in comparison to the “gold standard” (10.3%), stating the potential clinical utility (10.3%), performing the cut-off analysis (3.4%), reporting calibration statistics (6.9%), and providing open science and data (3.4%). None of the studies involved test-retest or phantom studies, prospective studies, or cost-effectiveness analyses. The overall rate of adherence to the TRIPOD checklist was 60.3% and low for reporting title (3.4%), blind assessment of outcome (0%), description of the handling of missing data (0%), and presentation of the full prediction model (0%). The majority of studies lacked pre-processing steps, with bias-field correction, isovoxel resampling, skull stripping, and gray-level discretization performed in only six (20.7%), nine (31.0%), four (3.8%), and four (13.8%) studies, respectively. Conclusion: The overall scientific and reporting quality of radiomics studies on brain metastases published during the study period was insufficient. Radiomics studies should adhere to the RQS, TRIPOD, and IBSI guidelines to facilitate the translation of radiomics into the clinical field.
|Number of pages||12|
|Journal||Korean journal of radiology|
|Publication status||Published - 2022 Jan|
Bibliographical noteFunding Information:
Dain Kim https://orcid.org/0000-0003-3425-0182 Eui Hyun Kim https://orcid.org/0000-0002-2523-7122 Seok-Gu Kang https://orcid.org/0000-0001-5676-2037 Jong Hee Chang https://orcid.org/0000-0003-1509-9800 Se Hoon Kim https://orcid.org/0000-0001-7516-7372 Seung-Koo Lee https://orcid.org/0000-0001-5646-4072 Funding Statement This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2020R1I1A1A01071648) and the “Team Science Award” of Yonsei University College of Medicine (6-2021-0009).
© 2022 The Korean Society of Radiology.
All Science Journal Classification (ASJC) codes
- Radiology Nuclear Medicine and imaging