Differentially-Private Text Rewriting reshapes Linguistic Style
Not on the map. Why?
Abstract (arXiv)
Differential Privacy (DP) for text matured from disjointed word-level substitutions to contiguous sentence-level rewriting by leveraging the generative capacity of language models. While this form of text privatization is best suited for balancing formal privacy guarantees with grammatical coherence, its impact on the register identity of text remains largely unexplored. By conducting a multidimensional stylistic profiling of differentially-private rewriting, we demonstrate that the cost of privacy extends far beyond lexical variation. Specifically, we find that rewriting under privacy constraints induces a systematic functional mutation of the text's communicative signature. This shift is characterized by the severe attrition of interactive markers, contextual references, and complex subordination. By comparing autoregressive paraphrasing against bidirectional substitution across a spectrum of privacy budgets, we observe that both architectures force convergence toward a non-involved and non-persuasive register. This register-blind sanitization effectively preserves semantic content but structurally homogenizes the nuanced stylistic markers that define human-authored discourse.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
17 of 34 references.
References · 17
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
- 2019Privacy- and Utility-Preserving Textual Analysis via Calibrated Multivariate Perturbationscited by 115
- 2021Differential Privacy for Text Analytics via Natural Text Sanitizationcited by 74
- 2022The Limits of Word Level Differential Privacycited by 63
- 2023Locally Differentially Private Document Generation Using Zero Shot Promptingcited by 63
- 2022A Customized Text Sanitization Mechanism with Differential Privacycited by 51
5 more
- 2021TEM: High Utility Metric Differential Privacy on Textcited by 43
- 2024Can Large Language Models Identify Authorship?cited by 40
- 2023Learning Interpretable Style Embeddings via Prompting LLMscited by 29
- 2023Guiding Text-to-Text Privatization by Syntaxcited by 14
- 2026STAMP: Selective Task-Aware Mechanism for Text Privacycited by 2
Built on by
Not cited yet.