Demystifying the Privacy-Utility Trade-off in LLM Interactions
Not on the map. Why?
Abstract (arXiv)
The integration of Large Language Models into daily tasks relies on context-rich instructions, inevitably exposing sensitive user information. Current privacy-preserving methods typically employ context-agnostic static rules, causing severe utility degradation. However, the specific mechanisms governing how sanitization impacts downstream performance remain largely underexplored. To address this, we conduct a systematic analysis to deconstruct the privacy-utility trade-off, uncovering three underlying mechanisms: (1) Context-Dependent Utility, which first establishes when to sanitize by revealing that data value shifts from critical constraints to dispensable noise based on user intent; (2) Strategic Adaptation, which subsequently determines how to sanitize by dictating that the choice between removal and replacement depends on the task's reliance on factual integrity versus structural coherence; and (3) Combinatorial Interplay, which finally extends the protection scope by demonstrating that attributes form a semantic web of synergistic dependencies or antagonistic redundancies. Guided by these insights, we introduce an intent-driven local protection framework. By distilling a lightweight model Veilmind-4B to drive a dynamic extraction-sanitization-restoration pipeline, our approach reaches a low-leakage privacy point while preserving substantially higher response utility than existing privacy-oriented baselines, advancing the privacy-utility trade-off toward the Pareto frontier.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
28 of 37 references.
References · 28
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 412
- 2021Differentially Private Fine-tuning of Language Modelscited by 400
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 314
16 more
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 230
- 2020Information Leakage in Embedding Modelscited by 203
- 2019Privacy- and Utility-Preserving Textual Analysis via Calibrated Multivariate Perturbationscited by 119
- 2023Privacy Issues in Large Language Models: A Surveycited by 60
- 2024PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensemblescited by 57
- 2023Hide and Seek (HaS): A Lightweight Framework for Prompt Privacy Protectioncited by 38
- 2024PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restorationcited by 28
- 2024Privacy Preserving Prompt Engineering: A Surveycited by 25
- 2024Probing Language Models for Pre-training Data Detectioncited by 25
- 2024Learning to Refuse: Towards Mitigating Privacy Risks in LLMscited by 23
- 2021CAPE: Context-Aware Private Embeddings for Private Language Learningcited by 22
- 2022Sentence-level Privacy for Document Embeddingscited by 16
- 2025VaultGemma: A Differentially Private Gemma Modelcited by 16
- 2024The Fire Thief Is Also the Keeper: Balancing Usability and Privacy in Promptscited by 13
- 2025Prεεmpt: Sanitizing Sensitive Prompts for LLMscited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.