IntraGuard: Committee-Side Defenses Against Review Outsourcing to Commercial Chatbots
Not on the map. Why?
Abstract (arXiv)
LLMs become increasingly capable, editorial boards and program committees are growing concerned about reviewers who fully outsource peer review to commercial chatbots. This concern stems from prior findings that current chatbots lack the independent critical thinking and depth of reasoning required to assess scientific novelty. One promising direction for mitigating this concern is to embed hidden instructions into manuscripts that disrupt or alter chatbot-generated reviews. However, existing methods remain intuitive and fragile, as they typically rely on homogeneous payloads injected in an inter-stream manner, rendering them susceptible to sanitization or neutralization. More broadly, the community still lacks a systematic formulation of this threat and a principled defense framework. In this paper, we identify End-to-End Review Outsourcing as an emerging threat and propose IntraGuard, a black-box, venue-agnostic defense framework grounded in the structural--visual decoupling inherent to the PDF. Designed for committee-side deployment, IntraGuard supports both explicit strategies that trigger refusal or warning signals, and implicit strategies that embed predefined textual markers into the generated review. These strategies can be deployed via any of three intra-stream injection mechanisms, each of which seamlessly embeds heterogeneous defensive text objects within the PDF's underlying structure without altering its visual presentation. Extensive evaluations (over 17,844 cases) across 7 real-world commercial chatbot settings and 12 venues spanning diverse disciplines show that IntraGuard achieves a defense success rate of up to 84%, while preserving peer-review invariance for human reviewers. We further evaluate 11 adaptive attacks spanning manuscript sanitization and instruction interference, and discuss the implications of constructing ensemble defenses.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 60 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
27 of 60 references.
References · 27
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
- 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
- 2025Prompt Injection Attack to Tool Selection in LLM Agentscited by 158
15 more
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judgecited by 143
- 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
- 2024Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Reviewcited by 53
- 2025Can Indirect Prompt Injection Attacks Be Detected and Removed?cited by 52
- 2024Provably Robust Multi-bit Watermarking for AI-generated Textcited by 47
- 2025Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewardscited by 34
- 2024PRSA: Prompt Stealing Attacks against Real-World Prompt Servicescited by 10
- 2025Attention is All You Need to Defend Against Indirect Prompt Injection Attacks in LLMscited by 10
- 2020The Journal Coverage of Web of Science, Scopus and Dimensions: A Comparative Analysiscited by 9
- 2024Robust and Reliable Early-Stage Website Fingerprinting Attacks via Spatial-Temporal Distribution Analysiscited by 8
- 2024SUB-PLAY: Adversarial Policies against Partially Observed Multi-Agent Reinforcement Learning Systemscited by 7
- 2025When Reject Turns into Accept: Quantifying the Vulnerability of LLM-Based Scientific Reviewers to Indirect Prompt Injectioncited by 6
- 2023When Vision Fails: Text Attacks Against ViT and OCRcited by 5
- 2025Analyzing PDFs like Binaries: Adversarially Robust PDF Malware Analysis via Intermediate Representation and Language Modelcited by 2
- 2025Reformulation is All You Need: Addressing Malicious Text Features in DNNscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.