ChatGPT: Excellent Paper! Accept It. Editor: Imposter Found! Review Rejected
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Large Language Models (LLMs) like ChatGPT are now widely used in writing and reviewing scientific papers. While this trend accelerates publication growth and reduces human workload, it also introduces serious risks. Papers written or reviewed by LLMs may lack real novelty, contain fabricated or biased results, or mislead downstream research that others depend on. Such issues can damage reputations, waste resources, and even endanger lives when flawed studies influence medical or safety-critical systems. This research explores both the offensive and defensive sides of this growing threat. On the attack side, we demonstrate how an author can inject hidden prompts inside a PDF that secretly guide or "jailbreak" LLM reviewers into giving overly positive feedback and biased acceptance. On the defense side, we propose an "inject-and-detect" strategy for editors, where invisible trigger prompts are embedded into papers; if a review repeats or reacts to these triggers, it reveals that the review was generated by an LLM, not a human. This method turns prompt injections from vulnerability into a verification tool. We outline our design, expected model behaviors, and ethical safeguards for deployment. The goal is to expose how fragile today's peer-review process becomes under LLM influence and how editorial awareness can help restore trust in scientific evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 10 of its 22 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
10 of 22 references.
Closest ancestors · 5
Same direction, newest first
- 2025"Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewers3 Nov
- 2025Prompt Injection Attacks on LLM Generated Reviews of Scientific Publications12 Sep
- 2025TopicAttack: An Indirect Prompt Injection Attack via Topic Transition18 Jul
- 2025Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review8 Jul
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judge26 Mar
Other references · 5
- 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
- 2024The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance Ratescited by 69
- 2025Investigating the Vulnerability of LLM-as-a-Judge Architectures to Prompt-Injection Attackscited by 10
- 2025PhantomLint: Principled Detection of Hidden LLM Prompts in Structured Documentscited by 3
- 2025Prompt-in-Content Attacks: Exploiting Uploaded Inputs to Hijack LLM Behaviorcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025When Your Reviewer is an LLM: Biases, Divergence, and Prompt Injection Risks in Peer Review
- 2025Misleading Large Language Models used (or misused) in Scientific Peer-Reviewing via Hidden Prompt-Injection Attacks
- 2025Multilingual Hidden Prompt Injection Attacks on LLM-Based Academic Reviewing
- 2025LLMs are Vulnerable to Malicious Prompts Disguised as Scientific Language
- 2026LLM-as-a-Reviewer: Benchmarking Their Ability, Divergence, and Prompt Injection Resistance as Paper Reviewers
- 2025When Reject Turns into Accept: Quantifying the Vulnerability of LLM-Based Scientific Reviewers to Indirect Prompt Injection
- 2025Detecting LLM-Generated Peer Reviews
- 2025Breaking the Prompt Wall (I): A Real-World Case Study of Attacking ChatGPT via Lightweight Prompt Injection