Effect of training on ultrasonography (US) BI-RADS features for radiology residents

a multicenter study comparing performances after training

Jung Hyun Yoon, Hye Sun Lee, You Me Kim, Ji Hyun Youk, Sung Hun Kim, Sun Hye Jeong, Ji Young Hwang, Jin Hee Moon, Young Mi Park, minjung Kim

Research output: Contribution to journalArticle

Abstract

Objectives: To evaluate the effect of training radiology residents on breast ultrasonography (US) according to the Breast Imaging Reporting And Data System (BI-RADS) and the factors that influence the training effect. Methods: This multicenter, prospective study was approved by eight institutional review boards. From September 2013 to July 2014, 248 breast masses in 227 women were included for US image acquisition. Representative B-mode and video images of the breast masses were recorded, among which 54 cases were included in the education set and 66 in the test set. Sixty-one radiology residents scheduled for breast imaging training individually reviewed the test set, immediately before, 1 month after, and 6 months after training. Diagnostic performances and US descriptors of the residents were evaluated and compared against those of expert radiologists. Results: Agreements between residents and experienced radiologists showed improvement after training, while agreements between post-training and post-6-month training descriptors did not show significant differences (all p > 0.05, respectively). Sensitivity, negative predictive value (NPV), and AUC were significantly improved for residents post-training and post-6-month training (all p < 0.05), while approximating the performances of expert radiologists except for AUC (0.836, 0.840, and 0.908, respectively, p < 0.05). Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC. Conclusion: Training using education material dedicated for breast US imaging effectively improved the diagnostic performances of radiology residents and agreements with experienced radiologists on US BI-RADS features. Key Points: • Agreements on lesion descriptors between residents and experienced radiologists showed improvement after training, regardless of test point. • Sensitivity, NPV, and AUC were significantly improved for residents in post-training and post-6-month training (all p < 0.05). • Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC.

Original languageEnglish
JournalEuropean Radiology
DOIs
Publication statusAccepted/In press - 2019 Jan 1

Fingerprint

Mammary Ultrasonography
Radiology
Information Systems
Multicenter Studies
Area Under Curve
Breast
Ultrasonography
Education
Research Ethics Committees
Radiologists
Prospective Studies

All Science Journal Classification (ASJC) codes

  • Radiology Nuclear Medicine and imaging

Cite this

Yoon, Jung Hyun ; Lee, Hye Sun ; Kim, You Me ; Youk, Ji Hyun ; Kim, Sung Hun ; Jeong, Sun Hye ; Hwang, Ji Young ; Moon, Jin Hee ; Park, Young Mi ; Kim, minjung. / Effect of training on ultrasonography (US) BI-RADS features for radiology residents : a multicenter study comparing performances after training. In: European Radiology. 2019.
@article{31cd991ab1fc4077823867a2392cf576,
title = "Effect of training on ultrasonography (US) BI-RADS features for radiology residents: a multicenter study comparing performances after training",
abstract = "Objectives: To evaluate the effect of training radiology residents on breast ultrasonography (US) according to the Breast Imaging Reporting And Data System (BI-RADS) and the factors that influence the training effect. Methods: This multicenter, prospective study was approved by eight institutional review boards. From September 2013 to July 2014, 248 breast masses in 227 women were included for US image acquisition. Representative B-mode and video images of the breast masses were recorded, among which 54 cases were included in the education set and 66 in the test set. Sixty-one radiology residents scheduled for breast imaging training individually reviewed the test set, immediately before, 1 month after, and 6 months after training. Diagnostic performances and US descriptors of the residents were evaluated and compared against those of expert radiologists. Results: Agreements between residents and experienced radiologists showed improvement after training, while agreements between post-training and post-6-month training descriptors did not show significant differences (all p > 0.05, respectively). Sensitivity, negative predictive value (NPV), and AUC were significantly improved for residents post-training and post-6-month training (all p < 0.05), while approximating the performances of expert radiologists except for AUC (0.836, 0.840, and 0.908, respectively, p < 0.05). Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC. Conclusion: Training using education material dedicated for breast US imaging effectively improved the diagnostic performances of radiology residents and agreements with experienced radiologists on US BI-RADS features. Key Points: • Agreements on lesion descriptors between residents and experienced radiologists showed improvement after training, regardless of test point. • Sensitivity, NPV, and AUC were significantly improved for residents in post-training and post-6-month training (all p < 0.05). • Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC.",
author = "Yoon, {Jung Hyun} and Lee, {Hye Sun} and Kim, {You Me} and Youk, {Ji Hyun} and Kim, {Sung Hun} and Jeong, {Sun Hye} and Hwang, {Ji Young} and Moon, {Jin Hee} and Park, {Young Mi} and minjung Kim",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/s00330-018-5934-9",
language = "English",
journal = "European Radiology",
issn = "0938-7994",
publisher = "Springer Verlag",

}

Effect of training on ultrasonography (US) BI-RADS features for radiology residents : a multicenter study comparing performances after training. / Yoon, Jung Hyun; Lee, Hye Sun; Kim, You Me; Youk, Ji Hyun; Kim, Sung Hun; Jeong, Sun Hye; Hwang, Ji Young; Moon, Jin Hee; Park, Young Mi; Kim, minjung.

In: European Radiology, 01.01.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Effect of training on ultrasonography (US) BI-RADS features for radiology residents

T2 - a multicenter study comparing performances after training

AU - Yoon, Jung Hyun

AU - Lee, Hye Sun

AU - Kim, You Me

AU - Youk, Ji Hyun

AU - Kim, Sung Hun

AU - Jeong, Sun Hye

AU - Hwang, Ji Young

AU - Moon, Jin Hee

AU - Park, Young Mi

AU - Kim, minjung

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Objectives: To evaluate the effect of training radiology residents on breast ultrasonography (US) according to the Breast Imaging Reporting And Data System (BI-RADS) and the factors that influence the training effect. Methods: This multicenter, prospective study was approved by eight institutional review boards. From September 2013 to July 2014, 248 breast masses in 227 women were included for US image acquisition. Representative B-mode and video images of the breast masses were recorded, among which 54 cases were included in the education set and 66 in the test set. Sixty-one radiology residents scheduled for breast imaging training individually reviewed the test set, immediately before, 1 month after, and 6 months after training. Diagnostic performances and US descriptors of the residents were evaluated and compared against those of expert radiologists. Results: Agreements between residents and experienced radiologists showed improvement after training, while agreements between post-training and post-6-month training descriptors did not show significant differences (all p > 0.05, respectively). Sensitivity, negative predictive value (NPV), and AUC were significantly improved for residents post-training and post-6-month training (all p < 0.05), while approximating the performances of expert radiologists except for AUC (0.836, 0.840, and 0.908, respectively, p < 0.05). Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC. Conclusion: Training using education material dedicated for breast US imaging effectively improved the diagnostic performances of radiology residents and agreements with experienced radiologists on US BI-RADS features. Key Points: • Agreements on lesion descriptors between residents and experienced radiologists showed improvement after training, regardless of test point. • Sensitivity, NPV, and AUC were significantly improved for residents in post-training and post-6-month training (all p < 0.05). • Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC.

AB - Objectives: To evaluate the effect of training radiology residents on breast ultrasonography (US) according to the Breast Imaging Reporting And Data System (BI-RADS) and the factors that influence the training effect. Methods: This multicenter, prospective study was approved by eight institutional review boards. From September 2013 to July 2014, 248 breast masses in 227 women were included for US image acquisition. Representative B-mode and video images of the breast masses were recorded, among which 54 cases were included in the education set and 66 in the test set. Sixty-one radiology residents scheduled for breast imaging training individually reviewed the test set, immediately before, 1 month after, and 6 months after training. Diagnostic performances and US descriptors of the residents were evaluated and compared against those of expert radiologists. Results: Agreements between residents and experienced radiologists showed improvement after training, while agreements between post-training and post-6-month training descriptors did not show significant differences (all p > 0.05, respectively). Sensitivity, negative predictive value (NPV), and AUC were significantly improved for residents post-training and post-6-month training (all p < 0.05), while approximating the performances of expert radiologists except for AUC (0.836, 0.840, and 0.908, respectively, p < 0.05). Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC. Conclusion: Training using education material dedicated for breast US imaging effectively improved the diagnostic performances of radiology residents and agreements with experienced radiologists on US BI-RADS features. Key Points: • Agreements on lesion descriptors between residents and experienced radiologists showed improvement after training, regardless of test point. • Sensitivity, NPV, and AUC were significantly improved for residents in post-training and post-6-month training (all p < 0.05). • Low levels of pre-training AUC, total number of breast US examinations, and the number of sessions per week that residents were involved in were factors influencing the improvement of AUC.

UR - http://www.scopus.com/inward/record.url?scp=85059677501&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85059677501&partnerID=8YFLogxK

U2 - 10.1007/s00330-018-5934-9

DO - 10.1007/s00330-018-5934-9

M3 - Article

JO - European Radiology

JF - European Radiology

SN - 0938-7994

ER -