mlsanityData to 14 Oct 2026

AI and the Future of Academic Peer Review

arXiv 2509.14189 ↗First posted 17 Sep 2025cs.CYcited by 4

Not on the map. Why?

Abstract (arXiv)

Peer review remains the central quality-control mechanism of science, yet its ability to fulfill this role is increasingly strained. Empirical studies document serious shortcomings: long publication delays, escalating reviewer burden concentrated on a small minority of scholars, inconsistent quality and low inter-reviewer agreement, and systematic biases by gender, language, and institutional prestige. Decades of human-centered reforms have yielded only marginal improvements. Meanwhile, artificial intelligence, especially large language models (LLMs), is being piloted across the peer-review pipeline by journals, funders, and individual reviewers. Early studies suggest that AI assistance can produce reviews comparable in quality to humans, accelerate reviewer selection and feedback, and reduce certain biases, but also raise distinctive concerns about hallucination, confidentiality, gaming, novelty recognition, and loss of trust. In this paper, we map the aims and persistent failure modes of peer review to specific LLM applications and systematically analyze the objections they raise alongside safeguards that could make their use acceptable. Drawing on emerging evidence, we show that targeted, supervised LLM assistance can plausibly improve error detection, timeliness, and reviewer workload without displacing human judgment. We highlight advanced architectures, including fine-tuned, retrieval-augmented, and multi-agent systems, that may enable more reliable, auditable, and interdisciplinary review. We argue that ethical and practical considerations are not peripheral but constitutive: the legitimacy of AI-assisted peer review depends on governance choices as much as technical capacity. The path forward is neither uncritical adoption nor reflexive rejection, but carefully scoped pilots with explicit evaluation metrics, transparency, and accountability.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Sep 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Automating Scientific Review with Google's Paper Assistant Tool
  2. 2026LLM-Based Scientific Peer Review: Methods, Benchmarks, and Reliability Challenges
  3. 2026Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge
  4. 2025MMReview: A Multidisciplinary and Multimodal Benchmark for LLM-Based Peer Review Automation
  5. 2025BadScientist: Can a Research Agent Write Convincing but Unsound Papers that Fool LLM Reviewers?
  6. 2024CycleResearcher: Improving Automated Research via Automated Review
  7. 2026Review the Code, Not the Story: A Vision and Protocol for Code-First Peer Review ↗
  8. 2026When AI Reviews Train AI Reviewers: Scientific-Judgment Collapse and Mitigation