PIDP-Attack: Combining Prompt Injection with Database Poisoning Attacks on Retrieval-Augmented Generation Systems
On the map: Retrieval-augmented generation → Privacy and security of RAG
also in 1 more
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of applications. However, their practical deployment is often hindered by issues such as outdated knowledge and the tendency to generate hallucinations. To address these limitations, Retrieval-Augmented Generation (RAG) systems have been introduced, enhancing LLMs with external, up-to-date knowledge sources. Despite their advantages, RAG systems remain vulnerable to adversarial attacks, with data poisoning emerging as a prominent threat. Existing poisoning-based attacks typically require prior knowledge of the user's specific queries, limiting their flexibility and real-world applicability. In this work, we propose PIDP-Attack, a novel compound attack that integrates prompt injection with database poisoning in RAG. By appending malicious characters to queries at inference time and injecting a limited number of poisoned passages into the retrieval database, our method can effectively manipulate LLM response to arbitrary query without prior knowledge of the user's actual query. Experimental evaluations across three benchmark datasets (Natural Questions, HotpotQA, MS-MARCO) and eight LLMs demonstrate that PIDP-Attack consistently outperforms the original PoisonedRAG. Specifically, our method improves attack success rates by 4% to 16% on open-domain QA tasks while maintaining high retrieval precision, proving that the compound attack strategy is both necessary and highly effective.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 39 of its 54 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
39 of 54 references.
Closest ancestors · 1
Same direction, newest first
Other references · 38
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024Qwen2 Technical Reportcited by 2,120
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
26 more
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 328
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
- 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 281
- 2023Poisoning Language Models During Instruction Tuningcited by 269
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 159
- 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 128
- 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learningcited by 123
- 2024Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstructioncited by 107
- 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Modelscited by 106
- 2024CRAG -- Comprehensive RAG Benchmarkcited by 97
- 2024LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigationcited by 93
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
- 2024Instruction Backdoor Attacks Against Customized LLMscited by 62
- 2023Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injectioncited by 59
- 2023A Comprehensive Overview of Backdoor Attacks in Large Language Models within Communication Networkscited by 42
- 2024HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systemscited by 37
- 2023Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attackscited by 33
- 2023PromptCARE: Prompt Copyright Protection by Watermark Injection and Verificationcited by 32
- 2023RLHFPoison: Reward Poisoning Attack for Reinforcement Learning with Human Feedback in Large Language Modelscited by 32
- 2023Training-free Lexical Backdoor Attacks on Language Modelscited by 31
- 2024PAPILLON: Efficient and Stealthy Fuzz Testing-Powered Jailbreaks for LLMscited by 21
- 2024Prompt Perturbation in Retrieval-Augmented Generation based Large Language Modelscited by 18
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Practical Poisoning Attacks against Retrieval-Augmented Generation
- 2025CPA-RAG:Covert Poisoning Attacks on Retrieval-Augmented Generation in Large Language Models
- 2024On the Vulnerability of Applying Retrieval-Augmented Generation within Knowledge-Intensive Application Domains
- 2025Benchmarking Poisoning Attacks against Retrieval-Augmented Generation
- 2025POISONCRAFT: Practical Poisoning of Retrieval-Augmented Generation for Large Language Models
- 2025One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems
- 2025Uncovering Competing Poisoning Attacks in Retrieval-Augmented Generation
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models