cs.CRSep 3, 2026

Rent-a-RAG: Embedding-Space Watermarks for Auditing Third-Party RAG

Authors: Alexandr Goultiaev TolstokorovKyriakos MouratidisJavad DoganiNikolaos Laoutaris

Organizations: IMDEA Networks Institute, Madrid, Spain · Universidad Carlos III de Madrid, Madrid, Spain · Singapore Management University, Singapore

Abstract

Third-party retrieval-augmented generation (RAG) marketplaces create a new auditing problem: data providers may license corpora to a RAG operator, yet later have no visibility into whether their documents are being reused without compensation. Auditing this misuse is difficult because the operator is non-cooperative, answers are paraphrased by the generator, and one response may combine evidence from many providers. We propose DirBucket, a provider-side semantic watermarking and black-box auditing framework for document-level reuse in multi-provider RAG. DirBucket watermarks documents by meaning-preserving paraphrases whose embeddings are biased toward provider-bucket secret directions, enabling detection from black-box answers while preserving retrieval utility. On a challenging benchmark that reflects mixed-provider reuse under black-box access, DirBucket is the only method that consistently achieves strong target detection with no non-target activation, detecting non-compliance in every audit within 23 audited answers on our primary benchmark. The watermark survives adversarial post-answer laundering, and none of the evaluated evasion strategies simultaneously defeats detection while preserving user-perceived answer quality. Detection transfers unchanged to a second benchmark built from real clinical, cyber-threat-intelligence, and legal provider corpora. These results suggest that embedding-space watermarking can make document reuse in third-party RAG statistically auditable.

Explore similar work

CardsList
  1. Re:CAP - Auditing Retrieval Coverage in Production RAG Pipelines

    Sep 21, 2026Aviral Joshi, Hanoz Bhathena, Max Nelson +1