So You’ve Got a High AUC, Now What? An Overview of Important Considerations when Bringing Machine-Learning Models from Computer to Bedside
Jiawen Deng, Mohamed E. Elghobashy, Kathleen Zang, Shubh K. Patel, Eddie Guo, Kiyan Heybati
Abstract
Machine-learning (ML) models have the potential to transform health care by enabling more personalized and data-driven clinical decision making. However, their successful implementation in clinical practice requires careful consideration of factors beyond predictive accuracy. We provide an overview of essential considerations for developing clinically applicable ML models, including methods for assessing and improving calibration, selecting appropriate decision thresholds, enhancing model explainability, identifying and mitigating bias, as well as methods for robust validation. We also discuss strategies for improving accessibility to ML models and performing real-world testing.HighlightsThis tutorial provides clinicians with a comprehensive guide to implementing machine-learning classification models in clinical practice.Key areas covered include model calibration, threshold selection, explainability, bias mitigation, validation, and real-world testing, all of which are essential for the clinical deployment of machine-learning models.Following these guidance can help clinicians bridge the gap between machine-learning model development and real-world application and enhance patient care outcomes.