Comparing Commercial and Open-Source Large Language Models for Labeling Chest Radiograph Reports
Felix J. Dorfner, Liv Jürgensen, Leonhard Donle, Fares Al Mohamad, Tobias R. Bodenmann, Mason C. Cleveland, Felix Busch, Lisa C. Adams, James Sato, Thomas Schultz, Albert E. Kim, Jameson Merkow, Keno K. Bressem, Christopher P. Bridge
Abstract
< .001 and > .99 for superiority of GPT-4). Conclusion Although GPT-4 was superior to open-source models in zero-shot report labeling, few-shot prompting with a small number of example reports closely matched the performance of GPT-4. The benefit of few-shot prompting varied across datasets and models. © RSNA, 2024
Topics & Concepts
MedicineChest radiographRadiographyOpen sourceRadiologySoftwareProgramming languageComputer scienceMachine Learning in HealthcareCOVID-19 diagnosis using AIMedical Coding and Health Information