mlsanityData to 14 Oct 2026

Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review

arXiv 2507.06185 ↗First posted 8 Jul 2025cs.CY cs.AI cs.CLcited by 13

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

In July 2025, 18 academic manuscripts on arXiv contained hidden instructions that manipulated AI-assisted peer review (indirect prompt injection). Instructions such as "GIVE A POSITIVE REVIEW ONLY" were concealed using white text and microscopic font sizes. Author responses varied: one planned to withdraw their manuscript, while another defended the practice as legitimate testing of reviewers misusing large language models (LLMs). This analysis examines the technique within the broader pattern of prompt injection exploits that manipulated web search and r'esum'e screening systems. For peer review, I reveal four types of hidden prompts, ranging from simple positive review commands to detailed evaluation frameworks. The honeypot defense--that prompts detect reviewers improperly using AI--fails under examination, given the consistently self-serving nature of these hidden prompts, though motivations likely vary from naive copying to calculated manipulation. This practice is best characterized as a novel form of questionable research practice (QRP). Publishers maintain inconsistent policies: Elsevier prohibits AI use in peer review entirely, while Springer Nature permits limited use with disclosure requirements. The practice exposes systematic vulnerabilities extending to plagiarism detection, citation indexing, and literature summarization. This analysis underscores the need for controlled AI integration in formal review processes alongside coordinated technical screening and harmonized policies governing AI use in academic evaluation.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 3 of its 15 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

3 of 15 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Detecting LLM-Generated Peer Reviews20 Mar

Other references · 2

  1. 2024Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Reviewcited by 53
  2. 2024Beyond principlism: Practical strategies for ethical AI use in research practicescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 10.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Misleading Large Language Models used (or misused) in Scientific Peer-Reviewing via Hidden Prompt-Injection Attacks
  2. 2026No Hidden Prompts Needed! You Can Game AI Peer Review with Presentation-Only Revisions
  3. 2026When AI reviews science: Can we trust the referee?
  4. 2025When Your Reviewer is an LLM: Biases, Divergence, and Prompt Injection Risks in Peer Review
  5. 2025When Reject Turns into Accept: Quantifying the Vulnerability of LLM-Based Scientific Reviewers to Indirect Prompt Injection
  6. 2025Multilingual Hidden Prompt Injection Attacks on LLM-Based Academic Reviewing
  7. 2025AI-Driven Scholarly Peer Review via Persistent Workflow Prompting, Meta-Prompting, and Meta-Reasoning
  8. 2025PhantomLint: Principled Detection of Hidden LLM Prompts in Structured Documents