Litcius/Paper detail

Benefits and Challenges of Using AI for Peer Review: A Study on Researchers’ Perceptions

Louie Giray

2024The Serials Librarian13 citationsDOI

Abstract

As AI becomes increasingly integrated into the peer review process, understanding its implications remains limited. This paper examines researchers’ perceptions of AI in peer review, highlighting both its benefits and challenges. Qualitative data were gathered from peer reviewers on a social media platform, revealing mixed feelings about AI’s role in the review process. AI may enhance feedback by allowing reviewers to rephrase their comments. This results in kinder and more professional reviews. It also has the potential to speed up the process by saving time on pre-submission checks and managing larger volumes of submissions. However, concerns persist that comments using AI may be overly generic and lack specific insights. Reviewers fear that outputs from AI could be passed to authors without proper verification. Moreover, ethical issues arise when AI is employed without consent, risking confidentiality and compromising the review’s quality. As the academic community navigates these complexities, it is essential to proceed with caution. It ensures that AI’s integration does not undermine the integrity of peer review. A balance between AI’s efficiency and the unique insights provided by human reviewers is imperative. To address these concerns, institutions should focus on transparency with AI tools, maintain quality assurance through validation, establish clear ethical guidelines, prioritize privacy and data protection, and support ongoing professional development for reviewers. Only time will tell if AI will genuinely revolutionize peer review or complicate existing challenges.

Topics & Concepts

PerceptionPeer reviewPsychologyData scienceComputer sciencePolitical scienceNeuroscienceLawArtificial Intelligence in Healthcare and EducationExplainable Artificial Intelligence (XAI)Ethics and Social Impacts of AI