On Strategyproof Conference Peer Review
Not on the map. Why?
Abstract (arXiv)
We consider peer review in a conference setting where there is typically an overlap between the set of reviewers and the set of authors. This overlap can incentivize strategic reviews to influence the final ranking of one's own papers. In this work, we address this problem through the lens of social choice, and present a theoretical framework for strategyproof and efficient peer review. We first present and analyze an algorithm for reviewer-assignment and aggregation that guarantees strategyproofness and a natural efficiency property called unanimity, when the authorship graph satisfies a simple property. Our algorithm is based on the so-called partitioning method, and can be thought as a generalization of this method to conference peer review settings. We then empirically show that the requisite property on the authorship graph is indeed satisfied in the submission data from the ICLR conference, and further demonstrate a simple trick to make the partitioning method more practically appealing for conference peer review. Finally, we complement our positive results with negative theoretical results where we prove that under various ways of strengthening the requirements, it is impossible for any algorithm to be strategyproof and efficient.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 1; 2024: 1; 2025: 3; 2026: 1.
16 papers.
Sort:
- 2021Making Paper Reviewing Robust to Bid Manipulation Attackscited by 12
- 2022A Dataset on Malicious Paper Bidding in Peer Reviewcited by 9
- 2021Near-Optimal Reviewer Splitting in Two-Phase Paper Reviewing and Conference Experiment Designcited by 6
- 2021Combating Collusion Rings is Hard but Possiblecited by 6
- 2022Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertisecited by 6
- 2024Group Fairness in Peer Reviewcited by 5
- 2025exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problemcited by 5
- 2021Peer Selection with Noisy Assessmentscited by 2
- 2021Auctions and Peer Prediction for Academic Peer Reviewcited by 2
- 2022Manipulation and Peer Mechanisms: A Surveycited by 1
- 2021Improving Peer Assessment with Graph Convolutional Networkscited by 0
- 2022No Agreement Without Loss: Learning and Social Choice in Peer Reviewcited by 0
4 more
- 2023Eliciting Honest Information From Authors Using Sequential Reviewcited by 0
- 2025Who is a Better Matchmaker? Human vs. Algorithmic Judge Assignment in a High-Stakes Startup Competitioncited by 0
- 2025Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policycited by 0
- 2026Reimagining Peer Review Process Through Multi-Agent Mechanism Designcited by 0
- 2026Reimagining Peer Review Process Through Multi-Agent Mechanism Design27 Jan 2026
- 2025Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policy17 Dec 2025
- 2025Who is a Better Matchmaker? Human vs. Algorithmic Judge Assignment in a High-Stakes Startup Competition14 Oct 2025
- 2025exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problem11 Feb 2025
- 2024Group Fairness in Peer Review4 Oct 2024
- 2023Eliciting Honest Information From Authors Using Sequential Review24 Nov 2023
- 2022No Agreement Without Loss: Learning and Social Choice in Peer Review3 Nov 2022
- 2022Manipulation and Peer Mechanisms: A Survey5 Oct 2022
- 2022A Dataset on Malicious Paper Bidding in Peer Review24 Jun 2022
- 2022Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertise25 Jan 2022
- 2021Combating Collusion Rings is Hard but Possible14 Dec 2021
- 2021Improving Peer Assessment with Graph Convolutional Networks4 Nov 2021
4 more
- 2021Making Paper Reviewing Robust to Bid Manipulation Attackscited by 12
- 2022A Dataset on Malicious Paper Bidding in Peer Reviewcited by 9
- 2021Near-Optimal Reviewer Splitting in Two-Phase Paper Reviewing and Conference Experiment Designcited by 6
- 2021Combating Collusion Rings is Hard but Possiblecited by 6
- 2022Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertisecited by 6
- 2024Group Fairness in Peer Reviewcited by 5
- 2025exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problemcited by 5
- 2021Peer Selection with Noisy Assessmentscited by 2
- 2021Auctions and Peer Prediction for Academic Peer Reviewcited by 2
- 2022Manipulation and Peer Mechanisms: A Surveycited by 1
- 2021Improving Peer Assessment with Graph Convolutional Networkscited by 0
- 2022No Agreement Without Loss: Learning and Social Choice in Peer Reviewcited by 0
12 most cited of 16 All 16 (JSON)
- 2026Reimagining Peer Review Process Through Multi-Agent Mechanism Design27 Jan 2026
- 2025Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policy17 Dec 2025
- 2025Who is a Better Matchmaker? Human vs. Algorithmic Judge Assignment in a High-Stakes Startup Competition14 Oct 2025
- 2025exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problem11 Feb 2025
- 2024Group Fairness in Peer Review4 Oct 2024
- 2023Eliciting Honest Information From Authors Using Sequential Review24 Nov 2023
- 2022No Agreement Without Loss: Learning and Social Choice in Peer Review3 Nov 2022
- 2022Manipulation and Peer Mechanisms: A Survey5 Oct 2022
- 2022A Dataset on Malicious Paper Bidding in Peer Review24 Jun 2022
- 2022Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertise25 Jan 2022
- 2021Combating Collusion Rings is Hard but Possible14 Dec 2021
- 2021Improving Peer Assessment with Graph Convolutional Networks4 Nov 2021
12 newest of 16 All 16 (JSON)