Randomized Controlled Trials in Medical AI A Methodological Critique
Konstantin Genin, Thomas Grote
Abstract
Various publications claim that medical AI systems perform as well, or better, than clinical experts.However, there have been very few controlled trials and the quality of existing studies has been calledinto question. There is growing concern that existing studies overestimate the clinical benefits of AIsystems. This has led to calls for more, and higher-quality, randomized controlled trials of medicalAI systems. While this a welcome development, AI RCTs raise novel methodological challenges thathave seen little discussion. We discuss some of the challenges arising in the context of AI RCTs andmake some suggestions for how to meet them.
Topics & Concepts
Randomized controlled trialContext (archaeology)Quality (philosophy)Clinical trialEngineering ethicsManagement sciencePsychologyMedicineEpistemologyEngineeringPathologyHistoryPhilosophyArchaeologyArtificial Intelligence in Healthcare and EducationMachine Learning in HealthcareExplainable Artificial Intelligence (XAI)