Improving the Performance of Radiologists Using Artificial Intelligence-Based Detection Support Software for Mammography: A Multi-Reader Study
Jeong Hoon Lee, Ki Hwan Kim, Eun Hye Lee, Jong Seok Ahn, Jung Kyu Ryu, Young Mi Park, Gi Won Shin, Young Joong Kim, Hye Young Choi
Abstract
OBJECTIVE: To evaluate whether artificial intelligence (AI) for detecting breast cancer on mammography can improve the performance and time efficiency of radiologists reading mammograms. MATERIALS AND METHODS: A commercial deep learning-based software for mammography was validated using external data collected from 200 patients, 100 each with and without breast cancer (40 with benign lesions and 60 without lesions) from one hospital. Ten readers, including five breast specialist radiologists (BSRs) and five general radiologists (GRs), assessed all mammography images using a seven-point scale to rate the likelihood of malignancy in two sessions, with and without the aid of the AI-based software, and the reading time was automatically recorded using a web-based reporting system. Two reading sessions were conducted with a two-month washout period in between. Differences in the area under the receiver operating characteristic curve (AUROC), sensitivity, specificity, and reading time between reading with and without AI were analyzed, accounting for data clustering by readers when indicated. RESULTS: < 0.001). CONCLUSION: AI-based software improved the performance of radiologists regardless of their experience and affected the reading time.