NeuroGenPoisoning: Neuron-Guided Attacks on Retrieval-Augmented Generation of LLM via Genetic Optimization of External Knowledge
On the map: Retrieval-augmented generation → Privacy and security of RAG
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) empowers Large Language Models (LLMs) to dynamically integrate external knowledge during inference, improving their factual accuracy and adaptability. However, adversaries can inject poisoned external knowledge to override the model's internal memory. While existing attacks iteratively manipulate retrieval content or prompt structure of RAG, they largely ignore the model's internal representation dynamics and neuron-level sensitivities. The underlying mechanism of RAG poisoning has not been fully studied and the effect of knowledge conflict with strong parametric knowledge in RAG is not considered. In this work, we propose NeuroGenPoisoning, a novel attack framework that generates adversarial external knowledge in RAG guided by LLM internal neuron attribution and genetic optimization. Our method first identifies a set of Poison-Responsive Neurons whose activation strongly correlates with contextual poisoning knowledge. We then employ a genetic algorithm to evolve adversarial passages that maximally activate these neurons. Crucially, our framework enables massive-scale generation of effective poisoned RAG knowledge by identifying and reusing promising but initially unsuccessful external knowledge variants via observed attribution signals. At the same time, Poison-Responsive Neurons guided poisoning can effectively resolves knowledge conflict. Experimental results across models and datasets demonstrate consistently achieving high Population Overwrite Success Rate (POSR) of over 90% while preserving fluency. Empirical evidence shows that our method effectively resolves knowledge conflict.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 46 of its 53 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
46 of 53 references.
Closest ancestors · 6
Same direction, newest first
- 2025Traceback of Poisoning Attacks to Retrieval-Augmented Generation30 Apr
- 2025RAG LLMs are Not Safer: A Safety Analysis of Retrieval-Augmented Generation for Large Language Models25 Apr
- 2024Machine Against the RAG: Jamming Retrieval-Augmented Generation with Blocker Documents9 Jun
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models3 Jun
- 2024Pandora: Jailbreak GPTs by Retrieval Augmented Generation Poisoning13 Feb
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb
Other references · 40
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
28 more
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 738
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 619
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 402
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 333
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 153
- 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 150
- 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 124
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 112
- 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 109
- 2024Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Trainingcited by 88
- 2024Searching for Best Practices in Retrieval-Augmented Generationcited by 83
- 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Surveycited by 83
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Modelscited by 77
- 2024What Evidence Do Language Models Find Convincing?cited by 74
- 2023Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attackscited by 69
- 2022FiD-Light: Efficient and Effective Retrieval-Augmented Text Generationcited by 63
- 2024Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?cited by 47
- 2023Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generatorscited by 42
- 2024IRCAN: Mitigating Knowledge Conflicts in LLM Generation via Identifying and Reweighting Context-Aware Neuronscited by 36
- 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Modelscited by 35
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2024KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Modelscited by 20
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoningcited by 4
- 2026Trust Me, Import This: Dependency Steering Attacks via Malicious Agent Skillscited by 4
- 2026Addressing Corpus Knowledge Poisoning Attacks on RAG Using Sparse Attentioncited by 3
- 2026Needle-in-RAG: Prompt-Conditioned Character-Level Traceback of Poisoned Spans in Retrieved Evidencecited by 1
- 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapsecited by 1
- 2026RAGSieve: Self-Referenced Local Contrast for Knowledge-Poison Detection in Retrieval-Augmented Generationcited by 0
- 2026InceptionRAG: Stealthy Poisoning Attack Against Retrieval-Augmented Generationcited by 0
- 2026InceptionRAG: Stealthy Poisoning Attack Against Retrieval-Augmented Generation15 Sep 2026
- 2026RAGSieve: Self-Referenced Local Contrast for Knowledge-Poison Detection in Retrieval-Augmented Generation13 Aug 2026
- 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapse7 Aug 2026
- 2026Trust Me, Import This: Dependency Steering Attacks via Malicious Agent Skills10 May 2026
- 2026Needle-in-RAG: Prompt-Conditioned Character-Level Traceback of Poisoned Spans in Retrieved Evidence3 May 2026
- 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoning18 Apr 2026
- 2026Addressing Corpus Knowledge Poisoning Attacks on RAG Using Sparse Attention4 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generation
- 2024Towards More Robust Retrieval-Augmented Generation: Evaluating RAG Under Adversarial Poisoning Attacks
- 2025Tricking Retrievers with Influential Tokens: An Efficient Black-Box Corpus Poisoning Attack
- 2026RAG-NAROK: Retrieval-Aware Knowledge Corpus Poisoning in RAG with Source-specific Refutation
- 2025Unveiling Knowledge Utilization Mechanisms in LLM-based Retrieval-Augmented Generation
- 2025MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks
- 2025Benchmarking Poisoning Attacks against Retrieval-Augmented Generation
- 2025Chain-of-Thought Poisoning Attacks against R1-based Retrieval-Augmented Generation Systems