Automatic origin prediction of liver metastases via hierarchical artificial-intelligence system trained on multiphasic CT data: a retrospective, multicentre study
Hongjie Xin, Yiwen Zhang, Qianwei Lai, Naying Liao, Jing Zhang, Yan Liu, Zhihua Chen, Pengyuan He, Jian He, Junwei Liu, Yuchen Zhou, Yuchen Zhou, Wei Yang, Yuanping Zhou, Yuanping Zhou
Abstract
Background: Currently, the diagnostic testing for the primary origin of liver metastases (LMs) can be laborious, complicating clinical decision-making. Directly classifying the primary origin of LMs at computed tomography (CT) images has proven to be challenging, despite its potential to streamline the entire diagnostic workflow. Methods: We developed ALMSS, an artificial intelligence (AI)-based LMs screening system, to provide automated liver contrast-enhanced CT analysis for distinguishing LMs from hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC), as well as subtyping primary origin of LMs as six organ systems. We processed a CECT dataset between January 1, 2013 and June 30, 2022 (n = 3105: 840 HCC, 354 ICC, and 1911 LMs) for training and internally testing ALMSS, and two additional cohorts (n = 622) for external validation of its diagnostic performance. The performance of radiologists with and without the assistance of ALMSS in diagnosing and subtyping LMs was assessed. Findings: ALMSS achieved average area under the curve (AUC) of 0.917 (95% confidence interval [CI]: 0.899-0.931) and 0.923 (95% [CI]: 0.905-0.937) for differentiating LMs, HCC and ICC on both the internal testing set and external testing set, outperformed that of two radiologists. Moreover, ALMSS yielded average AUC of 0.815 (95% [CI]: 0.794-0.836) and 0.818 (95% [CI]: 0.790-0.842) for predicting six primary origins on both two testing sets. Interestingly, ALMSS assigned origin diagnoses for LMs with pathological phenotypes beyond the training categories with average AUC of 0.761 (95% [CI]: 0.657-0.842), which verify the model's diagnostic expandability. Interpretation: Our study established an AI-based diagnostic system that effectively identifies and characterizes LMs directly from multiphasic CT images. Funding: National Natural Science Foundation of China, Guangdong Provincial Key Laboratory of Medical Image Processing.