Comparing human and AI expertise in the academic peer review process
Towards a hybrid approach
Bibliographic Data
| ID | 21555780 |
|---|---|
| Authors | Shai Farber (0000-0002-6252-805X, Emek Jezreel Academic College, corresponding author) |
| Year | 2025 |
| Volume | 44 |
| Issue | 4 |
| Pages | 871-885 |
| Publication date | 2025-05-19 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Higher Education Research & Development (JOURNAL) |
| Journal identifiers | ISSN: 0729-4360 • E-ISSN: 1469-8366 |
| Publisher | Informa UK Limited (PUBLISHER • GB) |
| DOI | 10.1080/07294360.2024.2445575 |
| OpenAlex | W4406621282 |
| Language | EN |
| Citations received | 10 |
| References cited | 36 |
This study assesses the strengths and limitations of peer reviews of Humanities and Social Sciences manuscripts conducted by human experts as compared to those completed using AI systems, focusing on the potential benefits of the integration of these two approaches in higher education research. Using a comparative design, it analyzed reviews of ten unpublished papers by ten human reviewers and the AI-based system Claude-3 Anthropic. While AI showed advantages in efficiency and consistency, human expertise was essential for contextual understanding and ethical judgment. The findings highlight distinct strengths and limitations of both methods, suggesting a hybrid approach that leverages their complementary skills. The study proposes strategies for integration, including diverse training data, explainable AI, and fostering human-AI collaboration. Although a combined approach could enhance research rigor and impartiality, challenges remain in addressing biases, ensuring transparency, and building trust. This research sets the stage for future efforts to harmonize human and AI capabilities, aiming for a streamlined, robust peer review process that upholds academic integrity and advances knowledge
Higher education · Mathematics education · Pedagogy · Peer review · Political science · Artificial Intelligence in Healthcare and Education · Computer Science · Ethics and Social Impacts of AI · Explainable Artificial Intelligence (XAI · Psychology
Accountability perspectives in the context of AI in intelligence and security investigations
Accelerating research excellence and impact in developing countries using performance-based research funding systems
Ethical Problems in the Use of Artificial Intelligence by University Educators
A comparative study of expert, AI, and no external feedback on mathematics teacher learning outcomes in reflective practice
Exploring the Factors That Promote a Balance Between Academic Integrity and the Effective Use of GenAI Tools in Higher Education
Co-Reviewer
The case for humanities-based studies of AI production and effects
GenAI! GenAI? GenAI
The Epistemic Shift in Science Communication
AI in the gatekeeper’s chair
Scientific peer review
The Oligopoly of Academic Publishers in the Digital Era
Peer Review
Artificial Intelligence trends in education
AI-assisted peer review
Death of a reviewer or death of peer review integrity? the challenges of using AI tools in peer reviewing and the need to go beyond publishing policies
AI and its implications for research in higher education
A scholarly dialogue
Blurring boundaries between humans and technology
Improving the peer-review process for grant applications
Systematic review of research on artificial intelligence applications in higher education – where are the educators
| Unique citing works | 10 |
|---|---|
| Citations per year | 10 |
| Citation span | 2025 - 2026 (2) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 10 |