SafeReview: Defending LLM-based Review Systems Against Adversarial Hidden Prompts
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
As Large Language Models (LLMs) are increasingly integrated into academic peer review, their vulnerability to adversarial hidden prompts, i.e., adversarial instructions embedded in submissions to manipulate outcomes, poses a critical threat to scholarly integrity. We propose SafeReview, a co-evolutionary adversarial training framework for defending LLM-based peer review systems against such attacks. SafeReview jointly trains a Generator model to create sophisticated attack prompts and a Defender model to preserve review integrity under adversarial manipulation. The Generator is optimized to produce increasingly effective prompt injections, while the Defender is strengthened through preference-based training to maintain consistent reviews between clean and attacked submissions. Experimental results show that SafeReview improves robustness against adaptive prompt injection attacks, better preserves paper ranking under attack, and generalizes across attacker architectures compared with static defenses. These results demonstrate the potential of co-evolutionary training as a foundation for securing LLM-assisted peer review.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 24 of its 40 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
24 of 40 references.
Closest ancestors · 5
Same direction, newest first
- 2025Prompt Injection Attacks on LLM Generated Reviews of Scientific Publications12 Sep
- 2025AEGIS : Automated Co-Evolutionary Framework for Guarding Prompt Injections Schema27 Aug
- 2024Defense Against Prompt Injection Attack by Leveraging Attack Techniques1 Nov
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimization7 Oct
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions19 Apr
Other references · 19
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 308
- 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 142
- 2018A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applicationscited by 135
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
- 2024MARG: Multi-Agent Review Generation for Scientific Paperscited by 98
- 2025DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Processcited by 97
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
- 2017IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Modelscited by 75
- 2024The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance Ratescited by 66
- 2024Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideascited by 52
- 2024Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Reviewcited by 49
7 more
- 2024Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactionscited by 43
- 2024Automated Statistical Model Discovery with Language Modelscited by 41
- 2023Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languagescited by 36
- 2023Summarizing Multiple Documents with Conversational Structure for Meta-Review Generationcited by 27
- 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
- 2025Breaking the Reviewer: Assessing the Vulnerability of Large Language Models in Automated Peer Review Under Textual Adversarial Attackscited by 14
- 2023CARE: Collaborative AI-Assisted Reading Environmentcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibilitycited by 6
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1
- 2026AiraXiv: An AI-Driven Open-Access Platform for Human and AI Scientistscited by 0
- 2026More Criticism Does Not Make a Better Review: EquiReview-Rcited by 0
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing7 Sep 2026
- 2026More Criticism Does Not Make a Better Review: EquiReview-R3 Sep 2026
- 2026AiraXiv: An AI-Driven Open-Access Platform for Human and AI Scientists20 May 2026
- 2026MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility15 May 2026