ADMIT: Few-shot Knowledge Poisoning Attacks on RAG-based Fact Checking
On the map: Retrieval-augmented generation → Privacy and security of RAG
Abstract (arXiv)
Knowledge poisoning poses a critical threat to Retrieval-Augmented Generation (RAG) systems by injecting adversarial content into knowledge bases, tricking Large Language Models (LLMs) into producing attacker-controlled outputs grounded in manipulated context. Prior work highlights LLMs' susceptibility to misleading or malicious retrieved content. However, real-world fact-checking scenarios are more challenging, as credible evidence typically dominates the retrieval pool. To investigate this problem, we extend knowledge poisoning to the fact-checking setting, where retrieved context includes authentic supporting or refuting evidence. We propose ADMIT (ADversarial Multi-Injection Technique), a few-shot, semantically aligned poisoning attack that flips fact-checking decisions and induces deceptive justifications, all without access to the target LLMs, retrievers, or token-level control. Extensive experiments show that ADMIT transfers effectively across 4 retrievers, 11 LLMs, and 4 cross-domain benchmarks, achieving an average attack success rate (ASR) of 86% at an extremely low poisoning rate of 0.93 × 10-6, and remaining robust even in the presence of strong counter-evidence. Compared with prior state-of-the-art attacks, ADMIT improves ASR by 11.2% across all settings, exposing significant vulnerabilities in real-world RAG-based fact-checking systems.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 46 of its 65 references that are in the map. First posted on arXiv 11 Oct 2025.
Builds on
46 of 65 references.
Closest ancestors · 3
Same direction, newest first
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generation4 Apr
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models3 Jun
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb
Other references · 43
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
31 more
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 573
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2023Detecting Language Model Attacks with Perplexitycited by 431
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 336
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
- 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 285
- 2024Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?cited by 232
- 2022Demystifying Prompts in Language Models via Perplexity Estimationcited by 216
- 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 196
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 186
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2022Learning by Distilling Contextcited by 138
- 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 128
- 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 127
- 2020COVID-Twitter-BERT: A Natural Language Processing Model to Analyse COVID-19 Content on Twittercited by 96
- 2024Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Modelscited by 58
- 2023Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Modelscited by 37
- 2023Making LLMs Worth Every Penny: Resource-Limited Text Classification in Bankingcited by 37
- 2024Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMscited by 34
- 2024Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuningcited by 31
- 2023Prompt Fuzzing for Fuzz Driver Generationcited by 27
- 2024Exploring Context Window of Large Language Models via Decomposed Positional Vectorscited by 18
- 2024Loki: An Open-Source Tool for Fact Verificationcited by 16
- 2024Automated Justification Production for Claim Veracity in Fact Checking: A Survey on Architectures and Approachescited by 15
- 2024OpenFactCheck: Building, Benchmarking Customized Fact-Checking Systems and Evaluating the Factuality of Claims and LLMscited by 13
- 2024Zero-Shot Fact Verification via Natural Logic and Large Language Modelscited by 5
- 2024FakeWatch: A Framework for Detecting Fake News to Ensure Credible Electionscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 9.
10 papers.
- 2026Safety in Self-Evolving LLM Agent Systems: Threats, Amplification, and Case Studiescited by 8
- 2025PaperAsk: A Benchmark for Reliability Evaluation of LLMs in Paper Search and Readingcited by 3
- 2026Needle-in-RAG: Prompt-Conditioned Character-Level Traceback of Poisoned Spans in Retrieved Evidencecited by 1
- 2026HarmProfile: Characterizing Harmful Distributions in Frontier LLMscited by 1
- 2026Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generationcited by 1
- 2026Evaluating RAG Reliability under Clean, Misleading, and Mixed Retrievalcited by 0
- 2026Tracing Target Answers in Poisoned Retrieval Corpora via Token Influence Attributioncited by 0
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerabilitycited by 0
- 2026InceptionRAG: Stealthy Poisoning Attack Against Retrieval-Augmented Generationcited by 0
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformationcited by 0
- 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation28 Sep 2026
- 2026InceptionRAG: Stealthy Poisoning Attack Against Retrieval-Augmented Generation15 Sep 2026
- 2026Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation25 Aug 2026
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerability11 Jul 2026
- 2026Tracing Target Answers in Poisoned Retrieval Corpora via Token Influence Attribution24 Jun 2026
- 2026Safety in Self-Evolving LLM Agent Systems: Threats, Amplification, and Case Studies22 Jun 2026
- 2026HarmProfile: Characterizing Harmful Distributions in Frontier LLMs11 Jun 2026
- 2026Evaluating RAG Reliability under Clean, Misleading, and Mixed Retrieval5 Jun 2026
- 2026Needle-in-RAG: Prompt-Conditioned Character-Level Traceback of Poisoned Spans in Retrieved Evidence3 May 2026
- 2025PaperAsk: A Benchmark for Reliability Evaluation of LLMs in Paper Search and Reading25 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Cordon-MAS: Defending RAG against Knowledge Poisoning via Information-Flow Control
- 2025MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks
- 2026RAGuard: A Layered Defense Framework for Retrieval-Augmented Generation Systems Against Data Poisoning
- 2026RAG-NAROK: Retrieval-Aware Knowledge Corpus Poisoning in RAG with Source-specific Refutation
- 2026Architecture Matters: Comparing RAG Systems under Knowledge Base Poisoning
- 2026ToxicRAG: Compromising Retrieval-Augmented Generation Systems via Single-Shot Knowledge Poisoning Attacks
- 2025Defending Against Knowledge Poisoning Attacks During Retrieval-Augmented Generation
- 2025RAG Safety: Exploring Knowledge Poisoning Attacks to Retrieval-Augmented Generation