In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning
On the map: Retrieval-augmented generation → Privacy and security of RAG
Abstract (arXiv)
Retrieval-augmented generation (RAG) grounds a language model in retrieved documents, which reduces hallucination but creates a new attack surface: if retrieved text is tampered with, the model may repeat the falsehood. We study how much a small quantized model, Llama 3.1 8B, degrades when a fraction of its retrieved context is poisoned. Three corruption strategies are tested, entity swap, number swap, and negation, each applied to zero, one, two, or three of the three retrieved passages, over a factorial sweep of 588 runs on a fact-checking task built from FEVER. Accuracy falls from 77.9% on clean context to 43.5% when all three passages are corrupted. Entity swap flips the largest share of answers that were correct on clean context. Number-based corruption stays flat while poisoned passages are a minority and jumps once they form a majority, a pattern we re-check with query-level bootstrap intervals. The model rarely invents new falsehoods; its dominant reaction is to abstain, and a lexical overlap proxy of unsupported generation falls under attack rather than rising. The study is a small-scale measurement with coarse automated labels; we treat the strategy contrasts as suggestive until decoding is controlled and stronger adjudication is in place.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 10 of its 10 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
10 of 10 references.
Closest ancestors · 1
Same direction, newest first
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb
Other references · 9
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2023Don't Make Your LLM an Evaluation Benchmark Cheatercited by 194
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation
- 2026RAGStress: A controlled benchmark for evaluating retrieval-augmented generation under knowledge-base degradation
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals
- 2026Evaluating RAG Reliability under Clean, Misleading, and Mixed Retrieval
- 2026When Context Misleads: Intent-Guided Decoding for Robust Retrieval-Augmented Generation
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generation
- 2025TrustRAG: Enhancing Robustness and Trustworthiness in Retrieval-Augmented Generation
- 2025RAGPart & RAGMask: Retrieval-Stage Defenses Against Corpus Poisoning in Retrieval-Augmented Generation