Litcius/Paper detail

The role of large language models in the peer-review process: opportunities and challenges for medical journal reviewers and editors

Jisoo Lee, Jieun Lee, Jeong‐Ju Yoo

2025Journal of Educational Evaluation for Health Professions25 citationsDOIOpen Access PDF

Abstract

The peer review process ensures the integrity of scientific research. This is particularly important in the medical field, where research findings directly impact patient care. However, the rapid growth of publications has strained reviewers, causing delays and potential declines in quality. Generative artificial intelligence, especially large language models (LLMs) such as ChatGPT, may assist researchers with efficient, high-quality reviews. This review explores the integration of LLMs into peer review, highlighting their strengths in linguistic tasks and challenges in assessing scientific validity, particularly in clinical medicine. Key points for integration include initial screening, reviewer matching, feedback support, and language review. However, implementing LLMs for these purposes will necessitate addressing biases, privacy concerns, and data confidentiality. We recommend using LLMs as complementary tools under clear guidelines to support, not replace, human expertise in maintaining rigorous peer review standards.

Topics & Concepts

ConfidentialityProcess (computing)Computer sciencePeer reviewQuality (philosophy)Matching (statistics)Field (mathematics)Engineering ethicsData scienceMedicinePolitical sciencePathologyComputer securityEpistemologyPure mathematicsEngineeringPhilosophyLawMathematicsOperating systemArtificial Intelligence in Healthcare and EducationEthics in Clinical ResearchSocial Media in Health Education