Zero2Text: Zero-Training Cross-Domain Inversion Attacks on Textual Embeddings
On the map: Retrieval-augmented generation → Privacy and security of RAG
Abstract (arXiv)
The proliferation of retrieval-augmented generation (RAG) has established vector databases as critical infrastructure, yet they introduce severe privacy risks via embedding inversion attacks. Existing paradigms face a fundamental trade-off: optimization-based methods require computationally prohibitive queries, while alignment-based approaches hinge on the unrealistic assumption of accessible in-domain training data. These constraints render them ineffective in strict black-box and cross-domain settings. To dismantle these barriers, we introduce Zero2Text, a novel training-free framework based on recursive online alignment. Unlike methods relying on static datasets, Zero2Text synergizes LLM priors with a dynamic ridge regression mechanism to iteratively align generation to the target embedding on-the-fly. We further demonstrate that standard defenses, such as differential privacy, fail to effectively mitigate this adaptive threat. Extensive experiments across diverse benchmarks validate Zero2Text; notably, on MS MARCO against the OpenAI victim model, it achieves 1.8x higher ROUGE-L and 6.4x higher BLEU-2 scores compared to baselines, recovering sentences from unknown domains without a single leaked data pair.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 20 of its 30 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
20 of 30 references.
References · 20
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2025Qwen3 Technical Reportcited by 8,195
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2019Deep Leakage from Gradientscited by 1,004
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
- 2020Information Leakage in Embedding Modelscited by 199
8 more
- 2023Text Embeddings Reveal (Almost) As Much As Textcited by 189
- 2023Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentencecited by 81
- 2022Recovering Private Text in Federated Learning of Language Modelscited by 67
- 2020Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairnesscited by 66
- 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
- 2024Text Embedding Inversion Security for Multilingual Language Modelscited by 26
- 2024Transferable Embedding Inversion Attack: Uncovering Privacy Risks in Text Embeddings without Model Queriescited by 25
- 2024Against All Odds: Overcoming Typology, Script, and Language Confusion in Multilingual Embedding Inversion Attackscited by 10
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Hybrid privacy-aware semantic search: SVD-truncated document geometry and CKKS-encrypted query reranking under a restricted threat modelcited by 1
- 2026Embedding Inversion via Conditional Masked Diffusion Language Modelscited by 0
- 2026Embedding Inference Attackcited by 0
- 2026Inverting Multi-Vector Visual Document Indicescited by 0
- 2026Inverting Multi-Vector Visual Document Indices7 Oct 2026
- 2026Embedding Inference Attack1 Jul 2026
- 2026Hybrid privacy-aware semantic search: SVD-truncated document geometry and CKKS-encrypted query reranking under a restricted threat model24 Jun 2026
- 2026Embedding Inversion via Conditional Masked Diffusion Language Models11 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation
- 2026VectorSmuggle: Steganographic Exfiltration in Embedding Stores and a Cryptographic Provenance Defense
- 2024GASLITEing the Retrieval: Exploring Vulnerabilities in Dense Embedding-based Search
- 2025Adapting General-Purpose Embedding Models to Private Datasets Using Keyword-based Retrieval
- 2026DSPrompt: Dynamic Soft Prompt Defense Against M-RAG Corruption
- 2026Shadow Queries for Private Retrieval in Vector Databases
- 2026RAGuard: A Layered Defense Framework for Retrieval-Augmented Generation Systems Against Data Poisoning
- 2025Embedding Poisoning: Bypassing Safety Alignment via Embedding Semantic Shift