Denoising-Aware Inversion: Revealing Privacy Risks in Noise-Protected Text Embeddings
Not on the map. Why?
Abstract (arXiv)
Dense text embeddings are widely used in data mining, retrieval, and downstream machine learning systems due to their compact and semantically rich representations, but recent embedding inversion attacks have shown that they can expose substantial information about the original text, leading to serious privacy leakage risks. A common defense is to release perturbed embeddings by adding Gaussian noise, which is simple yet effective against standard inversion attacks and does not significantly degrade embedding utility for downstream tasks. However, it remains unclear whether such noise-protected embeddings are sufficiently safe against adaptive attackers that explicitly account for the perturbation process. In this paper, we study text embedding inversion in a noise-protected setting, where the attacker can observe only noisy embeddings and has no access to clean embedding targets. We first analyze why existing generative inversion methods fail under this setting and identify a "Double Noise Trap", which fundamentally prevents standard generative inversion models from achieving high-quality reconstruction. To address this challenge, we propose DAEI, a denoising-aware embedding inversion pipeline that combines a residual denoising autoencoder with generative text inversion where the denoiser is trained in an unsupervised manner using Stein's unbiased risk estimate to enable denoising from noisy observations alone. Extensive experiments show that DAEI achieves approximately 154% relative improvement in BLEU over the existing generative inversion baseline, while also improving token-level F1 and ROUGE-L by 32--60%. The promising inversion performance of DAEI challenges the prevailing assumption that simple Gaussian perturbation is sufficient to prevent sensitive information leakage from embedding representations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
25 of 40 references.
References · 25
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 533
- 2020Information Leakage in Embedding Modelscited by 203
13 more
- 2020CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claimscited by 196
- 2023Text Embeddings Reveal (Almost) As Much As Textcited by 192
- 2022Dense Text Retrieval based on Pretrained Language Models: A Surveycited by 136
- 2019Privacy- and Utility-Preserving Textual Analysis via Calibrated Multivariate Perturbationscited by 119
- 2023Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentencecited by 81
- 2018Training Deep Learning Based Denoisers without Ground Truth Datacited by 43
- 2020A Differentially Private Text Perturbation Method Using a Regularized Mahalanobis Metriccited by 42
- 2024Transferable Embedding Inversion Attack: Uncovering Privacy Risks in Text Embeddings without Model Queriescited by 25
- 2025Prompt Inference Attack on Distributed Large Language Model Inference Frameworkscited by 14
- 2024Understanding and Mitigating the Threat of Vec2Text to Dense Retrieval Systemscited by 9
- 2025Universal Zero-shot Embedding Inversioncited by 8
- 2025Rethinking the Privacy of Text Embeddings: A Reproducibility Study of "Text Embeddings Reveal (Almost) As Much As Text"cited by 6
- 2025Privacy Risks of LLM-Empowered Recommender Systems: An Inversion Attack Perspectivecited by 6
Built on by
Not cited yet.