Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
In July 2025, 18 academic manuscripts on arXiv contained hidden instructions that manipulated AI-assisted peer review (indirect prompt injection). Instructions such as "GIVE A POSITIVE REVIEW ONLY" were concealed using white text and microscopic font sizes. Author responses varied: one planned to withdraw their manuscript, while another defended the practice as legitimate testing of reviewers misusing large language models (LLMs). This analysis examines the technique within the broader pattern of prompt injection exploits that manipulated web search and r'esum'e screening systems. For peer review, I reveal four types of hidden prompts, ranging from simple positive review commands to detailed evaluation frameworks. The honeypot defense--that prompts detect reviewers improperly using AI--fails under examination, given the consistently self-serving nature of these hidden prompts, though motivations likely vary from naive copying to calculated manipulation. This practice is best characterized as a novel form of questionable research practice (QRP). Publishers maintain inconsistent policies: Elsevier prohibits AI use in peer review entirely, while Springer Nature permits limited use with disclosure requirements. The practice exposes systematic vulnerabilities extending to plagiarism detection, citation indexing, and literature summarization. This analysis underscores the need for controlled AI integration in formal review processes alongside coordinated technical screening and harmonized policies governing AI use in academic evaluation.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 3 of its 15 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
3 of 15 references.
Closest ancestors · 1
Same direction, newest first
- 2025Detecting LLM-Generated Peer Reviews20 Mar
Other references · 2
Built on by
Citing papers per year: 2025: 3; 2026: 10.
13 papers.
Sort:
By area:
- 2026AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocationscited by 38
- 2025Prompt Injection Attacks on LLM Generated Reviews of Scientific Publicationscited by 13
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2025"Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewerscited by 5
- 2026LLM-as-a-Reviewer: Benchmarking Their Ability, Divergence, and Prompt Injection Resistance as Paper Reviewerscited by 4
- 2026Hidden State Poisoning Attacks against Mamba-based Language Modelscited by 2
- 2026What happens when reviewers receive AI feedback in their reviews?cited by 1
- 2026Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Reviewcited by 1
- 2026AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Qualitycited by 1
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1
- 2025ChatGPT: Excellent Paper! Accept It. Editor: Imposter Found! Review Rejectedcited by 0
- 2026Generative artificial intelligence and the marginalization of minoritized knowledges in higher education: the case of disabilitycited by 0
1 more
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing7 Sep 2026
- 2026AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Quality4 Aug 2026
- 2026Local AI pre-screening for human triple-blind peer review in health sciences18 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Review10 Jun 2026
- 2026Generative artificial intelligence and the marginalization of minoritized knowledges in higher education: the case of disability26 May 2026
- 2026LLM-as-a-Reviewer: Benchmarking Their Ability, Divergence, and Prompt Injection Resistance as Paper Reviewers25 May 2026
- 2026AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocations11 Mar 2026
- 2026What happens when reviewers receive AI feedback in their reviews?14 Feb 2026
- 2026Hidden State Poisoning Attacks against Mamba-based Language Models5 Jan 2026
- 2025ChatGPT: Excellent Paper! Accept It. Editor: Imposter Found! Review Rejected23 Dec 2025
- 2025"Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewers3 Nov 2025
1 more
- 2025Prompt Injection Attacks on LLM Generated Reviews of Scientific Publicationscited by 13
- 2025"Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewerscited by 5
- 2026LLM-as-a-Reviewer: Benchmarking Their Ability, Divergence, and Prompt Injection Resistance as Paper Reviewerscited by 4
- 2026Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Reviewcited by 1
- 2025ChatGPT: Excellent Paper! Accept It. Editor: Imposter Found! Review Rejectedcited by 0
- 2026Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Review10 Jun 2026
- 2026LLM-as-a-Reviewer: Benchmarking Their Ability, Divergence, and Prompt Injection Resistance as Paper Reviewers25 May 2026
- 2025ChatGPT: Excellent Paper! Accept It. Editor: Imposter Found! Review Rejected23 Dec 2025
- 2025"Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewers3 Nov 2025
- 2025Prompt Injection Attacks on LLM Generated Reviews of Scientific Publications12 Sep 2025
- 2026AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocationscited by 38
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing7 Sep 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026AttriGuard: Defeating Indirect Prompt Injection in LLM Agents via Causal Attribution of Tool Invocations11 Mar 2026
- 2026What happens when reviewers receive AI feedback in their reviews?cited by 1
- 2026AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Qualitycited by 1
- 2026Generative artificial intelligence and the marginalization of minoritized knowledges in higher education: the case of disabilitycited by 0
- 2026Local AI pre-screening for human triple-blind peer review in health sciencescited by 0
- 2026AI-Assisted Peer Review Across Research Communities: From Reviewer AI Policies to LLM Review Quality4 Aug 2026
- 2026Local AI pre-screening for human triple-blind peer review in health sciences18 Jul 2026
- 2026Generative artificial intelligence and the marginalization of minoritized knowledges in higher education: the case of disability26 May 2026
- 2026What happens when reviewers receive AI feedback in their reviews?14 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Misleading Large Language Models used (or misused) in Scientific Peer-Reviewing via Hidden Prompt-Injection Attacks
- 2026No Hidden Prompts Needed! You Can Game AI Peer Review with Presentation-Only Revisions
- 2026When AI reviews science: Can we trust the referee?
- 2025When Your Reviewer is an LLM: Biases, Divergence, and Prompt Injection Risks in Peer Review
- 2025When Reject Turns into Accept: Quantifying the Vulnerability of LLM-Based Scientific Reviewers to Indirect Prompt Injection
- 2025Multilingual Hidden Prompt Injection Attacks on LLM-Based Academic Reviewing
- 2025AI-Driven Scholarly Peer Review via Persistent Workflow Prompting, Meta-Prompting, and Meta-Reasoning
- 2025PhantomLint: Principled Detection of Hidden LLM Prompts in Structured Documents