Tandem deep learning and logistic regression models to optimize hypertrophic cardiomyopathy detection in routine clinical practice

Abstract

BackgroundAn electrocardiogram (ECG)-based artificial intelligence (AI) algorithm has shown good performance in detecting hypertrophic cardiomyopathy (HCM). However, its application in routine clinical practice may be challenging owing to the low disease prevalence and potentially high false-positive rates.ObjectiveIdentify clinical characteristics associated with true- and false-positive HCM AI-ECG results to improve its clinical application.MethodsWe reviewed the records of the 200 patients with highest HCM AI-ECG scores in January 2021 at our institution. Logistic regression was used to create a clinical variable–based “Candidacy for HCM Detection (HCM-DETECT)” score, differentiating true-positive from false-positive AI-ECG results. We validated the HCM-DETECT score in an independent cohort of 200 patients with the highest AI-ECG scores from January 2022.ResultsIn the 2021 cohort (median age 71 [interquartile range 58–80] years, 48% female), the rates of true-positive, false-positive, and indeterminate AI-ECG results for HCM detection were 36%, 48%, and 16%, respectively. In the 2022 cohort, the rates were 26%, 47%, and 27%, respectively. The HCM-DETECT score included age, coronary artery disease, prior pacemaker, and prior cardiac valve surgery, and had an area under the receiver operating characteristic curve of 0.81 (95% confidence interval 0.73–0.87) for differentiating true- vs false-positive AI results. When the 2022 cohort was limited to HCM detection candidates identified with the HCM-DETECT score, the false-positive AI-ECG rate was reduced from 47% to 13.5%.ConclusionApplication of a clinical score (HCM-DETECT) in tandem with an AI-ECG model improved HCM detection yield, reducing the false-positive rate of AI-ECG more than 3-fold. An electrocardiogram (ECG)-based artificial intelligence (AI) algorithm has shown good performance in detecting hypertrophic cardiomyopathy (HCM). However, its application in routine clinical practice may be challenging owing to the low disease prevalence and potentially high false-positive rates. Identify clinical characteristics associated with true- and false-positive HCM AI-ECG results to improve its clinical application. We reviewed the records of the 200 patients with highest HCM AI-ECG scores in January 2021 at our institution. Logistic regression was used to create a clinical variable–based “Candidacy for HCM Detection (HCM-DETECT)” score, differentiating true-positive from false-positive AI-ECG results. We validated the HCM-DETECT score in an independent cohort of 200 patients with the highest AI-ECG scores from January 2022. In the 2021 cohort (median age 71 [interquartile range 58–80] years, 48% female), the rates of true-positive, false-positive, and indeterminate AI-ECG results for HCM detection were 36%, 48%, and 16%, respectively. In the 2022 cohort, the rates were 26%, 47%, and 27%, respectively. The HCM-DETECT score included age, coronary artery disease, prior pacemaker, and prior cardiac valve surgery, and had an area under the receiver operating characteristic curve of 0.81 (95% confidence interval 0.73–0.87) for differentiating true- vs false-positive AI results. When the 2022 cohort was limited to HCM detection candidates identified with the HCM-DETECT score, the false-positive AI-ECG rate was reduced from 47% to 13.5%. Application of a clinical score (HCM-DETECT) in tandem with an AI-ECG model improved HCM detection yield, reducing the false-positive rate of AI-ECG more than 3-fold.

Topics & Concepts