mlsanityData to 14 Oct 2026

Gaming AI-Assisted Peer Reviews Poses New Risks to the Scientific Community

arXiv 2606.10159 ↗First posted 8 Jun 2026cs.CL cs.AI cs.CYcited by 3

Not on the map. Why?

Abstract (arXiv)

AI is increasingly used to support scientific peer review, from manuscript screening, reviewer assistance to editorial triage. Although such systems promise to reduce reviewer burden and accelerate publication, their robustness to strategic manipulation remains poorly understood. Here we show that AI-mediated peer review is vulnerable to a simple, low-cost manipulation: superficial rephrasing of the manuscript abstract. Without changing the underlying scientific content and communication, and even without knowledge of the reviewing model, adversarially rewritten abstracts substantially improve AI review outcomes. We see this across disciplines and publication venues, for both human-written and AI-generated papers. Our strongest attack achieves an attack-success-rate of about 38%, increasing acceptance ratings by +1.31 for Gemini 3 Flash reviewers and by +0.88 for GPT 5.4 Mini reviewers on a 10-point scale. When the original AI review suggests 'reject', the success rate rises to more than 50%. This effect extends beyond overall score inflation, increasing review confidence and scores on core scientific criteria such as soundness, significance and perceived contribution. The attack is practical, requiring only about 5 minutes and 1 for a 10-page AI conference submission, and is hard to distinguish from ordinary scientific editing. Inflated AI reviews could bias downstream human decision-making, shifting editorial recommendations from rejection towards acceptance. These findings reveal a general vulnerability in AI-assisted scientific evaluation: when AI-generated review influence editorial decisions, authors may be incentivized to optimize manuscripts for AI judgment rather than scientific merit. Our results suggest that AI tools should not be treated as neutral evaluators in high-stakes peer review without systematic robustness testing, transparent safeguards and careful human oversight.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 12 of its 34 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

12 of 34 references.

References · 12

  1. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
  2. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  3. 2026Towards End-to-End Automation of AI Researchcited by 159
  4. 2024The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance Ratescited by 69
  5. 2024OpenReviewer: A Specialized Large Language Model for Generating Critical Scientific Paper Reviewscited by 65
  6. 2024Technical Report on the Pangram AI-Generated Text Classifiercited by 34
  7. 2025Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewardscited by 34
  8. 2026AI-Assisted Peer Review at Scale: The AAAI-26 AI Review Pilotcited by 19
  9. 2026Stop Automating Peer Review Without Rigorous Evaluationcited by 14
  10. 2025Exploring the use of AI authors and reviewers at Agents4Sciencecited by 13
  11. 2025SECA: Semantically Equivalent and Coherent Attacks for Eliciting LLM Hallucinationscited by 9
  12. 2025Stop DDoS Attacking the Research Community with AI-Generated Survey Paperscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.