A practical framework for appropriate implementation and review of artificial intelligence (FAIR-AI) in healthcare
Brian J. Wells, Hieu Nguyen, Andrew McWilliams, Matt Pallini, Amy Bovi, Andrew Kuzma, Justin Kramer, Shih‐Hsiung Chou, Timothy Hetherington, Patricia Corn, Yhenneko J. Taylor, Audrey Cuison, Mary Gagen, McKenzie Isreal, Oğuz Akbilgiç, Katie Barr, Alicia Bowers, Rikki Gaber Caffrey, Michael S. Carroll, Matthew CiRullo, Stephen M. Downs, N. Chantelle Hardy, Jason Heuay, Kristina Katzovitz, Eric S. Kirkendall, Elsie Lindgren, Lindsey Lonergan, E.Graham McKinley, Nicholas M. Pajewski, Laura Sak-Castellano, Erika Setliff, Gabe Wright
Abstract
Health systems face the challenge of balancing innovation and safety to responsibly implement artificial intelligence (AI) solutions. The rapid proliferation, growing complexity, ethical considerations, and rising demand for these tools require timely and efficient processes for rigorous evaluation and ongoing monitoring. Current AI evaluation frameworks often lack the practical guidance for health systems to address these challenges. To fill this gap, we developed a prescriptive evaluation framework informed by a literature review, in-depth interviews with key stakeholders, including patients, and a multidisciplinary design workshop. The resulting framework provides health systems an outline of the resources, structures, criteria, and template documents to enable pre-implementation evaluation and post-implementation monitoring of AI solutions. Health systems will need to treat this or any alternative framework as a living document to maintain relevance and effectiveness as the AI landscape and regulations continue to evolve.