mlsanityData to 7 Oct 2026

Zero2Text: Zero-Training Cross-Domain Inversion Attacks on Textual Embeddings

arXiv 2602.01757 ↗First posted 2 Feb 2026cs.CL cs.LGcited by 4

On the map: Retrieval-augmented generation → Privacy and security of RAG

Abstract (arXiv)

The proliferation of retrieval-augmented generation (RAG) has established vector databases as critical infrastructure, yet they introduce severe privacy risks via embedding inversion attacks. Existing paradigms face a fundamental trade-off: optimization-based methods require computationally prohibitive queries, while alignment-based approaches hinge on the unrealistic assumption of accessible in-domain training data. These constraints render them ineffective in strict black-box and cross-domain settings. To dismantle these barriers, we introduce Zero2Text, a novel training-free framework based on recursive online alignment. Unlike methods relying on static datasets, Zero2Text synergizes LLM priors with a dynamic ridge regression mechanism to iteratively align generation to the target embedding on-the-fly. We further demonstrate that standard defenses, such as differential privacy, fail to effectively mitigate this adaptive threat. Extensive experiments across diverse benchmarks validate Zero2Text; notably, on MS MARCO against the OpenAI victim model, it achieves 1.8x higher ROUGE-L and 6.4x higher BLEU-2 scores compared to baselines, recovering sentences from unknown domains without a single leaked data pair.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 20 of its 30 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

20 of 30 references.

References · 20

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2017Billion-scale similarity search with GPUscited by 2,477
  5. 2020Extracting Training Data from Large Language Modelscited by 2,144
  6. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  7. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  8. 2019Deep Leakage from Gradientscited by 1,004
  9. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
  10. 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
  11. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
  12. 2020Information Leakage in Embedding Modelscited by 199
8 more
  1. 2023Text Embeddings Reveal (Almost) As Much As Textcited by 189
  2. 2023Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentencecited by 81
  3. 2022Recovering Private Text in Federated Learning of Language Modelscited by 67
  4. 2020Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairnesscited by 66
  5. 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
  6. 2024Text Embedding Inversion Security for Multilingual Language Modelscited by 26
  7. 2024Transferable Embedding Inversion Attack: Uncovering Privacy Risks in Text Embeddings without Model Queriescited by 25
  8. 2024Against All Odds: Overcoming Typology, Script, and Language Confusion in Multilingual Embedding Inversion Attackscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation
  2. 2026VectorSmuggle: Steganographic Exfiltration in Embedding Stores and a Cryptographic Provenance Defense
  3. 2024GASLITEing the Retrieval: Exploring Vulnerabilities in Dense Embedding-based Search
  4. 2025Adapting General-Purpose Embedding Models to Private Datasets Using Keyword-based Retrieval
  5. 2026DSPrompt: Dynamic Soft Prompt Defense Against M-RAG Corruption
  6. 2026Shadow Queries for Private Retrieval in Vector Databases
  7. 2026RAGuard: A Layered Defense Framework for Retrieval-Augmented Generation Systems Against Data Poisoning
  8. 2025Embedding Poisoning: Bypassing Safety Alignment via Embedding Semantic Shift