mlsanityData to 14 Oct 2026

Demystifying the Privacy-Utility Trade-off in LLM Interactions

arXiv 2609.10992 ↗First posted 10 Sep 2026cs.AI cs.CRcited by 1

Not on the map. Why?

Abstract (arXiv)

The integration of Large Language Models into daily tasks relies on context-rich instructions, inevitably exposing sensitive user information. Current privacy-preserving methods typically employ context-agnostic static rules, causing severe utility degradation. However, the specific mechanisms governing how sanitization impacts downstream performance remain largely underexplored. To address this, we conduct a systematic analysis to deconstruct the privacy-utility trade-off, uncovering three underlying mechanisms: (1) Context-Dependent Utility, which first establishes when to sanitize by revealing that data value shifts from critical constraints to dispensable noise based on user intent; (2) Strategic Adaptation, which subsequently determines how to sanitize by dictating that the choice between removal and replacement depends on the task's reliance on factual integrity versus structural coherence; and (3) Combinatorial Interplay, which finally extends the protection scope by demonstrating that attributes form a semantic web of synergistic dependencies or antagonistic redundancies. Guided by these insights, we introduce an intent-driven local protection framework. By distilling a lightweight model Veilmind-4B to drive a dynamic extraction-sanitization-restoration pipeline, our approach reaches a low-leakage privacy point while preserving substantially higher response utility than existing privacy-oriented baselines, advancing the privacy-utility trade-off toward the Pareto frontier.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

28 of 37 references.

References · 28

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2020Extracting Training Data from Large Language Modelscited by 2,189
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  5. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
  6. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
  7. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
  8. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  9. 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 412
  10. 2021Differentially Private Fine-tuning of Language Modelscited by 400
  11. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  12. 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 314
16 more
  1. 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
  2. 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 230
  3. 2020Information Leakage in Embedding Modelscited by 203
  4. 2019Privacy- and Utility-Preserving Textual Analysis via Calibrated Multivariate Perturbationscited by 119
  5. 2023Privacy Issues in Large Language Models: A Surveycited by 60
  6. 2024PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensemblescited by 57
  7. 2023Hide and Seek (HaS): A Lightweight Framework for Prompt Privacy Protectioncited by 38
  8. 2024PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restorationcited by 28
  9. 2024Privacy Preserving Prompt Engineering: A Surveycited by 25
  10. 2024Probing Language Models for Pre-training Data Detectioncited by 25
  11. 2024Learning to Refuse: Towards Mitigating Privacy Risks in LLMscited by 23
  12. 2021CAPE: Context-Aware Private Embeddings for Private Language Learningcited by 22
  13. 2022Sentence-level Privacy for Document Embeddingscited by 16
  14. 2025VaultGemma: A Differentially Private Gemma Modelcited by 16
  15. 2024The Fire Thief Is Also the Keeper: Balancing Usability and Privacy in Promptscited by 13
  16. 2025Prεεmpt: Sanitizing Sensitive Prompts for LLMscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.