mlsanityData to 14 Oct 2026

Reimagining Peer Review Process Through Multi-Agent Mechanism Design

arXiv 2601.19778 ↗First posted 27 Jan 2026cs.MA cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

The software engineering research community faces a systemic crisis: peer review is failing under growing submissions, misaligned incentives, and reviewer fatigue. Community surveys reveal that researchers perceive the process as "broken." This position paper argues that these dysfunctions are mechanism design failures amenable to computational solutions. We propose modeling the research community as a stochastic multi-agent system and applying multi-agent reinforcement learning to design incentive-compatible protocols. We outline three interventions: a credit-based submission economy, MARL-optimized reviewer assignment, and hybrid verification of review consistency. We present threat models, equity considerations, and phased pilot metrics. This vision charts a research agenda toward sustainable peer review.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 27 Jan 2026.

Builds on

15 of 28 references.

References · 15

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2017Constrained Policy Optimizationcited by 983
  3. 2018A Survey and Critique of Multiagent Deep Reinforcement Learningcited by 177
  4. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  5. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
  6. 2018Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobservedcited by 94
  7. 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
  8. 2021Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experimentcited by 53
  9. 2021You Are the Best Reviewer of Your Own Papers: An Owner-Assisted Scoring Mechanismcited by 19
  10. 2018On Strategyproof Conference Peer Reviewcited by 17
  11. 2023The strain on scientific publishingcited by 17
  12. 2023Reviewer assignment problem: A scoping reviewcited by 4
3 more
  1. 2014Incentive Design in Peer Review: Rating and Repeated Endogenous Matchingcited by 3
  2. 2021Auctions and Peer Prediction for Academic Peer Reviewcited by 2
  3. 2025The Impact Market to Save Conference Peer Review: Decoupling Dissemination and Credentialingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Review
  2. 2026InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttal
  3. 2026ScholarPeer: A Context-Aware Multi-Agent Framework for Automated Peer Review
  4. 2026Review the Code, Not the Story: A Vision and Protocol for Code-First Peer Review ↗
  5. 2026REM-CTX: Automated Peer Review via Reinforcement Learning with Auxiliary Context
  6. 2025BadScientist: Can a Research Agent Write Convincing but Unsound Papers that Fool LLM Reviewers?
  7. 2025AI and the Future of Academic Peer Review
  8. 2026EGTR-Review: Efficient Evidence-Grounded Scientific Peer Review Generation via Multi-Agent Teacher Distillation