Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Privacy and security of RAG
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) integrates external knowledge into large language models to improve response quality. However, recent work has shown that RAG systems are highly vulnerable to poisoning attacks, where malicious texts are inserted into the knowledge database to influence model outputs. While several defenses have been proposed, they are often circumvented by more adaptive or sophisticated attacks. This paper presents RAGOrigin, a black-box responsibility attribution framework designed to identify which texts in the knowledge database are responsible for misleading or incorrect generations. Our method constructs a focused attribution scope tailored to each misgeneration event and assigns a responsibility score to each candidate text by evaluating its retrieval ranking, semantic relevance, and influence on the generated response. The system then isolates poisoned texts using an unsupervised clustering method. We evaluate RAGOrigin across seven datasets and fifteen poisoning attacks, including newly developed adaptive poisoning strategies and multi-attacker scenarios. Our approach outperforms existing baselines in identifying poisoned content and remains robust under dynamic and noisy conditions. These results suggest that RAGOrigin provides a practical and effective solution for tracing the origins of corrupted knowledge in RAG systems. Our code is available at: https://github.com/zhangbl6618/RAG-Responsibility-Attribution
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 58 of its 83 references that are in the map. First posted on arXiv 17 Sep 2025.
Builds on
58 of 83 references.
Closest ancestors · 8
Same direction, newest first
- 2025Traceback of Poisoning Attacks to Retrieval-Augmented Generation30 Apr
- 2024HijackRAG: Hijacking Attacks against Retrieval-Augmented Large Language Models30 Oct
- 2024"Glue pizza and eat rocks" -- Exploiting Vulnerabilities in Retrieval-Augmented Generative Models26 Jun
- 2024Machine Against the RAG: Jamming Retrieval-Augmented Generation with Blocker Documents9 Jun
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models3 Jun
- 2024Certifiably Robust RAG against Retrieval Corruption24 May
- 2024TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Models22 May
- 2024Pandora: Jailbreak GPTs by Retrieval Augmented Generation Poisoning13 Feb
Other references · 50
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Qwen Technical Reportcited by 3,344
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
38 more
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,268
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2023PaLM 2 Technical Reportcited by 1,162
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2019ELI5: Long Form Question Answeringcited by 575
- 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 546
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2023Benchmarking Large Language Models in Retrieval-Augmented Generationcited by 312
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 166
- 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 159
- 2020Backdoor Attacks Against Deep Learning Systems in the Physical Worldcited by 134
- 2023AnglE-optimized Text Embeddingscited by 99
- 2024ContextCite: Attributing Model Generation to Contextcited by 98
- 2023Dense X Retrieval: What Retrieval Granularity Should We Use?cited by 88
- 2024MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Modelscited by 85
- 2023Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-Incited by 71
- 2024SuRe: Summarizing Retrievals using Answer Candidates for Open-domain QA of LLMscited by 67
- 2016Defensive Distillation is Not Robust to Adversarial Examplescited by 60
- 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 51
- 2021Poison Forensics: Traceback of Data Poisoning Attacks in Neural Networkscited by 40
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2024AttriBoT: A Bag of Tricks for Efficiently Approximating Leave-One-Out Context Attributioncited by 23
- 2023BEAGLE: Forensics of Deep Learning Backdoor Attack for Better Defensecited by 15
- 2024From Questions to Insightful Answers: Building an Informed Chatbot for University Resourcescited by 12
- 2024Tracing Back the Malicious Clients in Poisoning Attacks to Federated Learningcited by 6
- 2024UTrace: Poisoning Forensics for Private Collaborative Learningcited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025Secure Retrieval-Augmented Generation against Poisoning Attackscited by 19
- 2026The Why Behind the Action: Unveiling Internal Drivers via Agentic Attributioncited by 11
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agentscited by 7
- 2025SafeSearch: Automated Red-Teaming of LLM-Based Search Agentscited by 4
- 2026Beware What You Autocomplete: Forensic Attribution of Backdoored Code Completionscited by 4
- 2026In-Context Credit Assignment via the Corecited by 2
- 2026Patcher: Post-Hoc Patching of Backdoored Large Language Modelscited by 2
- 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systemscited by 2
- 2026Needle-in-RAG: Prompt-Conditioned Character-Level Traceback of Poisoned Spans in Retrieved Evidencecited by 1
- 2026MemCatalyst: Amplifying Data Auditing on Vision-Language Models via Data Poisoningcited by 0
- 2026ToxicRAG: Compromising Retrieval-Augmented Generation Systems via Single-Shot Knowledge Poisoning Attackscited by 0
- 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectivescited by 0
- 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives15 Sep 2026
- 2026ToxicRAG: Compromising Retrieval-Augmented Generation Systems via Single-Shot Knowledge Poisoning Attacks10 Sep 2026
- 2026MemCatalyst: Amplifying Data Auditing on Vision-Language Models via Data Poisoning18 Aug 2026
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agents16 Jul 2026
- 2026Beware What You Autocomplete: Forensic Attribution of Backdoored Code Completions9 Jul 2026
- 2026Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems8 Jul 2026
- 2026Patcher: Post-Hoc Patching of Backdoored Large Language Models2 Jun 2026
- 2026In-Context Credit Assignment via the Core7 May 2026
- 2026Needle-in-RAG: Prompt-Conditioned Character-Level Traceback of Poisoned Spans in Retrieved Evidence3 May 2026
- 2026The Why Behind the Action: Unveiling Internal Drivers via Agentic Attribution21 Jan 2026
- 2025Secure Retrieval-Augmented Generation against Poisoning Attacks28 Oct 2025
- 2025SafeSearch: Automated Red-Teaming of LLM-Based Search Agents28 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025RAG Safety: Exploring Knowledge Poisoning Attacks to Retrieval-Augmented Generation
- 2026Confundo: Learning to Generate Robust Poison for Practical RAG Systems
- 2026Influence Factors on RAG Poisoning
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generation
- 2026Cordon-MAS: Defending RAG against Knowledge Poisoning via Information-Flow Control
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
- 2025Rescuing the Unpoisoned: Efficient Defense against Knowledge Corruption Attacks on RAG Systems
- 2025RAGPart & RAGMask: Retrieval-Stage Defenses Against Corpus Poisoning in Retrieval-Augmented Generation