Evaluation of the Potential Utility of an Artificial Intelligence Chatbot in Gastroesophageal Reflux Disease Management
Jacqueline B. Henson, Jeremy R. Glissen Brown, Joshua P. Lee, Amit Patel, David A. Leiman
Abstract
INTRODUCTION: Artificial intelligence chatbots could serve as an information resource for patients and a tool for clinicians. Their ability to respond appropriately to questions regarding gastroesophageal reflux disease is unknown. METHODS: Twenty-three prompts regarding gastroesophageal reflux disease management were submitted to ChatGPT, and responses were rated by 3 gastroenterologists and 8 patients. RESULTS: ChatGPT provided largely appropriate responses (91.3%), although with some inappropriateness (8.7%) and inconsistency. Most responses (78.3%) contained at least some specific guidance. Patients considered this a useful tool (100%). DISCUSSION: ChatGPT's performance demonstrates the potential for this technology in health care, although also its limitations in its current state.