A One-Size-Fits-All Approach to Improving Randomness in Paper Assignment
Not on the map. Why?
Abstract (arXiv)
The assignment of papers to reviewers is a crucial part of the peer review processes of large publication venues, where organizers (e.g., conference program chairs) rely on algorithms to perform automated paper assignment. As such, a major challenge for the organizers of these processes is to specify paper assignment algorithms that find appropriate assignments with respect to various desiderata. Although the main objective when choosing a good paper assignment is to maximize the expertise of each reviewer for their assigned papers, several other considerations make introducing randomization into the paper assignment desirable: robustness to malicious behavior, the ability to evaluate alternative paper assignments, reviewer diversity, and reviewer anonymity. However, it is unclear in what way one should randomize the paper assignment in order to best satisfy all of these considerations simultaneously. In this work, we present a practical, one-size-fits-all method for randomized paper assignment intended to perform well across different motivations for randomness. We show theoretically and experimentally that our method outperforms currently-deployed methods for randomized paper assignment on several intuitive randomness metrics, demonstrating that the randomized assignments produced by our method are general-purpose.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 3.
6 papers.
- 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 92
- 2024Vulnerability of Text-Matching in ML/AI Conference Reviewer Assignments to Collusionscited by 7
- 2026CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Reviewcited by 1
- 2025Who is a Better Matchmaker? Human vs. Algorithmic Judge Assignment in a High-Stakes Startup Competitioncited by 0
- 2026Allocate Marginal Reviews to Borderline Papers Using LLM Comparative Rankingcited by 0
- 2026Impact of large language models on peer review opinions from a fine-grained perspective: Evidence from top conference proceedings in AIcited by 0
- 2026CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Review4 Sep 2026
- 2026Impact of large language models on peer review opinions from a fine-grained perspective: Evidence from top conference proceedings in AI21 Apr 2026
- 2026Allocate Marginal Reviews to Borderline Papers Using LLM Comparative Ranking4 Feb 2026
- 2025Who is a Better Matchmaker? Human vs. Algorithmic Judge Assignment in a High-Stakes Startup Competition14 Oct 2025
- 2024Vulnerability of Text-Matching in ML/AI Conference Reviewer Assignments to Collusions9 Dec 2024
- 2024AgentReview: Exploring Peer Review Dynamics with LLM Agents18 Jun 2024