mlsanityData to 14 Oct 2026

No Hidden Prompts Needed! You Can Game AI Peer Review with Presentation-Only Revisions

arXiv 2606.13044 ↗First posted 11 Jun 2026cs.CLcited by 2

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

As AI-generated reviews move from experimental tools into peer-review infrastructure, most robustness concerns have focused on explicit attacks such as hidden instructions and prompt injection. We study a harder and more policy-relevant failure mode: no hidden text, no prompt injection, and no changes to methods, experiments, figures, equations, proofs, or numerical results. The attacker modifies only presentation-level content, such as the abstract, contribution framing, related work, discussion, and narrative structure. We introduce adversarial repackaging: a closed-loop attack that uses AI-reviewer feedback to search for presentation-level revisions while keeping the scientific evidence fixed. Across three mainstream AI reviewers, adversarial repackaging achieves a 75.1% attack success rate and a mean score gain of +1.21/10. The effect is not explained by ordinary prose polishing. We also reveal that strategies that change how the reviewer interprets the paper, such as related-work repositioning and analytical discussion expansion, substantially outperform surface edits such as local polishing, table formatting, and algorithm boxes. Our analysis reveals two deeper structural failure modes. First, AI reviewers are easier to impress than to convince: highlighting strengths reliably increases perceived merit, while attempts to dissolve weaknesses frequently backfire. Second, AI reviewers can confuse the appearance of addressing a limitation with actually resolving it, allowing unchanged evidence to be reinterpreted as stronger scientific contribution. These results show that the deployment risk is not only malicious hidden instructions, but the emergence of paper presentation itself as an optimization surface. We release a contamination-free rolling benchmark and attack framework for testing whether AI reviewers remain anchored to scientific content under presentation-only edits.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 27 of its 41 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

27 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025"Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewers3 Nov
  2. 2025When Your Reviewer is an LLM: Biases, Divergence, and Prompt Injection Risks in Peer Review12 Sep

Other references · 25

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  3. 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 671
  4. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  5. 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 126
  6. 2023LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Modelscited by 71
  7. 2024The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance Ratescited by 69
  8. 2024OpenReviewer: A Specialized Large Language Model for Generating Critical Scientific Paper Reviewscited by 65
  9. 2024Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Reviewcited by 53
  10. 2025LLMs Cannot Reliably Judge (Yet?): A Comprehensive Assessment on the Robustness of LLM-as-a-Judgecited by 37
  11. 2025Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewardscited by 34
  12. 2025TreeReview: A Dynamic Tree of Questions Framework for Deep and Efficient LLM-based Scientific Peer Reviewcited by 31
13 more
  1. 2025Mind the Blind Spots: A Focus-Level Evaluation Framework for LLM Reviewscited by 24
  2. 2025ReviewRL: Towards Automated Scientific Review with RLcited by 19
  3. 2024LitLLMs, LLMs for Literature Review: Are we there yet?cited by 14
  4. 2026Stop Automating Peer Review Without Rigorous Evaluationcited by 14
  5. 2025Justice in Judgment: Unveiling (Hidden) Bias in LLM-assisted Peer Reviewscited by 11
  6. 2025Paper Copilot: Tracking the Evolution of Peer Review in AI Conferencescited by 10
  7. 2025LLM-REVal: Can We Trust LLM Reviewers Yet?cited by 9
  8. 2025BadScientist: Can a Research Agent Write Convincing but Unsound Papers that Fool LLM Reviewers?cited by 8
  9. 2026Paraphrasing Adversarial Attack on LLM-as-a-Reviewercited by 8
  10. 2025Stop DDoS Attacking the Research Community with AI-Generated Survey Paperscited by 7
  11. 2025Pre-review to Peer review: Pitfalls of Automating Reviews using Large Language Modelscited by 6
  12. 2026Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Futurecited by 6
  13. 2026Exploring the Effects of Alignment on Numerical Bias in Large Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Misleading Large Language Models used (or misused) in Scientific Peer-Reviewing via Hidden Prompt-Injection Attacks
  2. 2026Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Review
  3. 2026When AI reviews science: Can we trust the referee?
  4. 2026SafeReview: Defending LLM-based Review Systems Against Adversarial Hidden Prompts
  5. 2025When Reject Turns into Accept: Quantifying the Vulnerability of LLM-Based Scientific Reviewers to Indirect Prompt Injection
  6. 2025Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review
  7. 2026LLM-as-a-Reviewer: Benchmarking Their Ability, Divergence, and Prompt Injection Resistance as Paper Reviewers
  8. 2026When AI Reviews Train AI Reviewers: Scientific-Judgment Collapse and Mitigation