Large Language Models Threaten Double-blind Review
Not on the map. Why?
Abstract (arXiv)
Double blind peer review serves as the scientific community primary defense against status and affiliation bias. Its effectiveness rests on the assumption that anonymized manuscripts convey scientific merit without revealing their authors. While authorship can often be recovered using citation networks or stylistic markers, we show that this assumption is increasingly fragile in the presence of large language models (LLMs). Using only titles and abstracts from papers published after model training, we find that LLMs collapse anonymity more efficiently than humans, with belief concentrating onto a small subset of plausible authors drawn from pools of five domain expert candidates. This vulnerability persists even when stylistic and bibliographic cues are excluded, indicating that stable patterns in problem framing and research focus function as latent conceptual signatures of authorship. Together, these findings indicate that double blind review is vulnerable to automated semantic inference, necessitating a revaluation of how anonymity and fairness are maintained in an AI augmented research ecosystem.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 22 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
9 of 22 references.
References · 9
- 2023Large Language Modelscited by 780
- 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
- 2024Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Datacited by 85
- 2024What Do Learning Dynamics Reveal About Generalization in LLM Reasoning?cited by 23
- 2020A Girl Has A Name: Detecting Authorship Obfuscationcited by 7
- 2022Cracking Double-Blind Review: Authorship Attribution with Deep Learningcited by 6
- 2021Rethinking the Authorship Verification Experimental Setupscited by 5
- 2024AIDBench: A benchmark for evaluating the authorship identification capability of large language modelscited by 4
- 2017Effectiveness of Anonymization in Double-Blind Reviewcited by 3
Built on by
Not cited yet.