SD-RAG: A Prompt-Injection-Resilient Framework for Selective Disclosure in Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Privacy and security of RAG
also in 1 more
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has attracted significant attention due to its ability to combine the generative capabilities of Large Language Models (LLMs) with knowledge obtained through efficient retrieval mechanisms over large-scale data collections. Currently, the majority of existing approaches overlook the risks associated with exposing sensitive or access-controlled information directly to the generation model. Only a few approaches propose techniques to instruct the generative model to refrain from disclosing sensitive information; however, recent studies have also demonstrated that LLMs remain vulnerable to prompt injection attacks that can override intended behavioral constraints. For these reasons, we propose a novel approach to Selective Disclosure in Retrieval-Augmented Generation, called SD-RAG, which decouples the enforcement of security and privacy constraints from the generation process itself. Rather than relying on prompt-level safeguards, SD-RAG applies sanitization and disclosure controls during the retrieval phase, prior to augmenting the language model's input. Moreover, we introduce a semantic mechanism to allow the ingestion of human-readable dynamic security and privacy constraints together with an optimized graph-based data model that supports fine-grained, policy-aware retrieval. Our experimental evaluation demonstrates the superiority of SD-RAG over baseline existing approaches, achieving up to a 58% improvement in the privacy score, while also showing a strong resilience to prompt injection attacks targeting the generative model.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 15 of its 23 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
15 of 23 references.
Closest ancestors · 3
Same direction, newest first
- 2025GraphRAG under Fire23 Jan
- 2024ConfusedPilot: Confused Deputy Risks in RAG-based LLMs9 Aug
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb
Other references · 12
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 88
- 2024Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?cited by 81
- 2024Truthful Text Sanitization Guided by Inference Attackscited by 8
- 2024HyQE: Ranking Contexts with Hypothetical Query Embeddingscited by 6
- 2025Improving Privacy Benefits of Redactioncited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Securing Retrieval-Augmented Generation: A Taxonomy of Attacks, Defenses, and Future Directionscited by 2
- 2026Discourse-Role Labels as Presentation-Time Variables for Context Use in Language Modelscited by 1
- 2026MIRROR: Novelty-Constrained Memory-Guided MCTS Red-Teaming for Agentic RAGcited by 0
- 2026The Right Memory in the Wrong Context: Verifying Retrieval Admissibility in Long-Term Agent Memorycited by 0
- 2026The Right Memory in the Wrong Context: Verifying Retrieval Admissibility in Long-Term Agent Memory5 Oct 2026
- 2026MIRROR: Novelty-Constrained Memory-Guided MCTS Red-Teaming for Agentic RAG25 Jun 2026
- 2026Discourse-Role Labels as Presentation-Time Variables for Context Use in Language Models2 Jun 2026
- 2026Securing Retrieval-Augmented Generation: A Taxonomy of Attacks, Defenses, and Future Directions9 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Security and Privacy in Retrieval-Augmented Generation: Architectures, Threats, Defenses, and Future Directions for Building Trustworthy Systems
- 2026Towards Secure Retrieval-Augmented Generation: A Comprehensive Review of Threats, Defenses and Benchmarks
- 2025RAG Security and Privacy: Formalizing the Threat Model and Attack Surface
- 2026SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems
- 2024"Glue pizza and eat rocks" -- Exploiting Vulnerabilities in Retrieval-Augmented Generative Models
- 2026Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation
- 2025Privacy-Aware RAG: Secure and Isolated Knowledge Retrieval
- 2026RAG-CT: Mitigating Privacy Risks on Retrieval-Augmented Generation Systems via Scanning Prompt Distribution