mlsanityData to 7 Oct 2026

Rent-a-RAG: Embedding-Space Watermarks for Auditing Third-Party RAG

arXiv 2609.03749 ↗First posted 3 Sep 2026cs.CR cs.CLcited by 0

On the map: Retrieval-augmented generation → Privacy and security of RAG

Abstract (arXiv)

Third-party retrieval-augmented generation (RAG) marketplaces create a new auditing problem: data providers may license corpora to a RAG operator, yet later have no visibility into whether their documents are being reused without compensation. Auditing this misuse is difficult because the operator is non-cooperative, answers are paraphrased by the generator, and one response may combine evidence from many providers. We propose DirBucket, a provider-side semantic watermarking and black-box auditing framework for document-level reuse in multi-provider RAG. DirBucket watermarks documents by meaning-preserving paraphrases whose embeddings are biased toward provider-bucket secret directions, enabling detection from black-box answers while preserving retrieval utility. On a challenging benchmark that reflects mixed-provider reuse under black-box access, DirBucket is the only method that consistently achieves strong target detection with no non-target activation, detecting non-compliance in every audit within 23 audited answers on our primary benchmark. The watermark survives adversarial post-answer laundering, and none of the evaluated evasion strategies simultaneously defeats detection while preserving user-perceived answer quality. Detection transfers unchanged to a second benchmark built from real clinical, cyber-threat-intelligence, and legal provider corpora. These results suggest that embedding-space watermarking can make document reuse in third-party RAG statistically auditable.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 25 of its 44 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

25 of 44 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Dataset Protection via Watermarked Canaries in Retrieval-Augmented LLMs15 Feb
  2. 2024Data Extraction Attacks in Retrieval-Augmented Generation via Backdoors3 Nov
  3. 2024Rag and Roll: An End-to-End Evaluation of Indirect Prompt Manipulations in LLM-based Application Frameworks9 Aug
  4. 2024Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems27 Feb

Other references · 21

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  5. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  6. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  7. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  8. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
  9. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
  10. 2022A Survey on Retrieval-Augmented Text Generationcited by 157
  11. 2018A Marketplace for Data: An Algorithmic Solutioncited by 75
  12. 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasingcited by 71
9 more
  1. 2024RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Contentcited by 26
  2. 2022Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluationcited by 23
  3. 2024Black-Box Detection of Language Model Watermarkscited by 22
  4. 2024Ward: Provable RAG Dataset Inference via LLM Watermarkscited by 15
  5. 2019Adversarial attacks on Copyright Detection Systemscited by 11
  6. 2019Revenue Maximization for Query Pricingcited by 11
  7. 2025Fair Document Valuation in LLM Summaries via Shapley Valuescited by 6
  8. 2024A Systematic Review of NeurIPS Dataset Management Practicescited by 2
  9. 2025Data Auctions for Retrieval Augmented Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Who Stole Your Data? A Method for Detecting Unauthorized RAG Theft
  2. 2026Re:CAP - Auditing Retrieval Coverage in Production RAG Pipelines
  3. 2026SentinelRAG: Synthetic Sentinel Knowledge for RAG Database Copyright Protection
  4. 2025RAG-WM: An Efficient Black-Box Watermarking Approach for Retrieval-Augmented Generation of Large Language Models
  5. 2026In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning
  6. 2025Towards Copyright Protection for Knowledge Bases of Retrieval-augmented Language Models via Reasoning
  7. 2026Mind the Hook: Source-Level Auditing of Privacy Defenses in Retrieval-Augmented Generation
  8. 2026RAGStress: A controlled benchmark for evaluating retrieval-augmented generation under knowledge-base degradation