Reimagining Peer Review Process Through Multi-Agent Mechanism Design
Not on the map. Why?
Abstract (arXiv)
The software engineering research community faces a systemic crisis: peer review is failing under growing submissions, misaligned incentives, and reviewer fatigue. Community surveys reveal that researchers perceive the process as "broken." This position paper argues that these dysfunctions are mechanism design failures amenable to computational solutions. We propose modeling the research community as a stochastic multi-agent system and applying multi-agent reinforcement learning to design incentive-compatible protocols. We outline three interventions: a credit-based submission economy, MARL-optimized reviewer assignment, and hybrid verification of review consistency. We present threat models, equity considerations, and phased pilot metrics. This vision charts a research agenda toward sustainable peer review.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
15 of 28 references.
References · 15
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2017Constrained Policy Optimizationcited by 983
- 2018A Survey and Critique of Multiagent Deep Reinforcement Learningcited by 177
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
- 2018Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobservedcited by 94
- 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
- 2021Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experimentcited by 53
- 2021You Are the Best Reviewer of Your Own Papers: An Owner-Assisted Scoring Mechanismcited by 19
- 2018On Strategyproof Conference Peer Reviewcited by 17
- 2023The strain on scientific publishingcited by 17
- 2023Reviewer assignment problem: A scoping reviewcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Review
- 2026InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttal
- 2026ScholarPeer: A Context-Aware Multi-Agent Framework for Automated Peer Review
- 2026Review the Code, Not the Story: A Vision and Protocol for Code-First Peer Review ↗
- 2026REM-CTX: Automated Peer Review via Reinforcement Learning with Auxiliary Context
- 2025BadScientist: Can a Research Agent Write Convincing but Unsound Papers that Fool LLM Reviewers?
- 2025AI and the Future of Academic Peer Review
- 2026EGTR-Review: Efficient Evidence-Grounded Scientific Peer Review Generation via Multi-Agent Teacher Distillation