Rent-a-RAG: Embedding-Space Watermarks for Auditing Third-Party RAG
On the map: Retrieval-augmented generation → Privacy and security of RAG
Abstract (arXiv)
Third-party retrieval-augmented generation (RAG) marketplaces create a new auditing problem: data providers may license corpora to a RAG operator, yet later have no visibility into whether their documents are being reused without compensation. Auditing this misuse is difficult because the operator is non-cooperative, answers are paraphrased by the generator, and one response may combine evidence from many providers. We propose DirBucket, a provider-side semantic watermarking and black-box auditing framework for document-level reuse in multi-provider RAG. DirBucket watermarks documents by meaning-preserving paraphrases whose embeddings are biased toward provider-bucket secret directions, enabling detection from black-box answers while preserving retrieval utility. On a challenging benchmark that reflects mixed-provider reuse under black-box access, DirBucket is the only method that consistently achieves strong target detection with no non-target activation, detecting non-compliance in every audit within 23 audited answers on our primary benchmark. The watermark survives adversarial post-answer laundering, and none of the evaluated evasion strategies simultaneously defeats detection while preserving user-perceived answer quality. Detection transfers unchanged to a second benchmark built from real clinical, cyber-threat-intelligence, and legal provider corpora. These results suggest that embedding-space watermarking can make document reuse in third-party RAG statistically auditable.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 25 of its 44 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
25 of 44 references.
Closest ancestors · 4
Same direction, newest first
- 2025Dataset Protection via Watermarked Canaries in Retrieval-Augmented LLMs15 Feb
- 2024Data Extraction Attacks in Retrieval-Augmented Generation via Backdoors3 Nov
- 2024Rag and Roll: An End-to-End Evaluation of Indirect Prompt Manipulations in LLM-based Application Frameworks9 Aug
- 2024Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems27 Feb
Other references · 21
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2018A Marketplace for Data: An Algorithmic Solutioncited by 75
- 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasingcited by 71
9 more
- 2024RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Contentcited by 26
- 2022Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluationcited by 23
- 2024Black-Box Detection of Language Model Watermarkscited by 22
- 2024Ward: Provable RAG Dataset Inference via LLM Watermarkscited by 15
- 2019Adversarial attacks on Copyright Detection Systemscited by 11
- 2019Revenue Maximization for Query Pricingcited by 11
- 2025Fair Document Valuation in LLM Summaries via Shapley Valuescited by 6
- 2024A Systematic Review of NeurIPS Dataset Management Practicescited by 2
- 2025Data Auctions for Retrieval Augmented Generationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Who Stole Your Data? A Method for Detecting Unauthorized RAG Theft
- 2026Re:CAP - Auditing Retrieval Coverage in Production RAG Pipelines
- 2026SentinelRAG: Synthetic Sentinel Knowledge for RAG Database Copyright Protection
- 2025RAG-WM: An Efficient Black-Box Watermarking Approach for Retrieval-Augmented Generation of Large Language Models
- 2026In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning
- 2025Towards Copyright Protection for Knowledge Bases of Retrieval-augmented Language Models via Reasoning
- 2026Mind the Hook: Source-Level Auditing of Privacy Defenses in Retrieval-Augmented Generation
- 2026RAGStress: A controlled benchmark for evaluating retrieval-augmented generation under knowledge-base degradation