ChatGPT Hallucinates when Attributing Answers
Guido Zuccon, Bevan Koopman, Razia S. Shaik
Abstract
Can ChatGPT provide evidence to support its answers? Does the evidence it suggests actually exist and does it really support the answer? We investigate these questions using a collection of domain-specific knowledge-based questions, specifically prompting ChatGPT to provide both an answer and supporting evidence in the form of references to external sources. We also investigate how different prompts impact answers and evidence.
Topics & Concepts
Computer scienceDomain (mathematical analysis)Questions and answersData scienceEpistemologyPsychologyWorld Wide WebPhilosophyMathematicsMathematical analysisTopic ModelingExplainable Artificial Intelligence (XAI)Artificial Intelligence in Healthcare and Education