Privacy-Preserving Generation of Clinical Narratives from Medical Terminologies
Not on the map. Why?
Abstract (arXiv)
In high-stakes domains such as healthcare, privacy concerns severely limit the use of real-world training data. Differentially private (DP) synthetic data offers a promising alternative with formal privacy guarantees, but achieving strong utility remains challenging for clinical note generation due to domain specificity and long-form text complexity. We present Term2Note, a method for synthesising full-length clinical notes under DP constraints. By structurally separating content and form, Term2Note generates section-wise note content conditioned on medical terms, with terms and notes privatised under separate DP constraints, and applies a DP quality maximiser to improve outputs. Experiments demonstrate that Term2Note produces synthetic notes with statistical properties closely aligned with real clinical notes, and that downstream models trained on these notes achieve performance comparable to those trained on real clinical data. Compared to existing DP text generation baselines, Term2Note substantially improves both fidelity and utility, without relying on label distribution assumptions, highlighting its effectiveness as a practical privacy-preserving alternative to real clinical notes.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 53 references that are in the map. First posted on arXiv 13 Sep 2025.
Builds on
28 of 53 references.
References · 28
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2016Deep Learning with Differential Privacycited by 2,728
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
- 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 383
- 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
- 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
- 2022Unlocking High-Accuracy Differentially Private Image Classification through Scalecited by 224
- 2021Generating Datasets with Pretrained Language Modelscited by 193
- 2022Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipecited by 108
- 2021Do Not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private Learningcited by 86
- 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Textcited by 76
- 2022Differentially Private Language Models for Secure Data Sharingcited by 68
16 more
- 2022Differentially Private Optimization on Large Model at Small Costcited by 65
- 2023Harnessing large-language models to generate private synthetic textcited by 65
- 2023Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notescited by 51
- 2020Scaling up Differentially Private Deep Learning with Fast Per-Example Gradient Clippingcited by 47
- 2023A Comparative Study of Pretrained Language Models for Long Clinical Textcited by 35
- 2024EHRNoteQA: An LLM Benchmark for Real-World Clinical Practice Using Discharge Summariescited by 35
- 2022Summarizing Patients Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Modelscited by 30
- 2025MIRA: Medical Time Series Foundation Model for Real-World Health Datacited by 22
- 2025BRIDGE: Bootstrapping Text to Control Time-Series Generation via Multi-Agent Iterative Optimization and Diffusion Modelingcited by 19
- 2024Differentially Private Knowledge Distillation via Synthetic Text Generationcited by 18
- 2025The Canary's Echo: Auditing Privacy Risks of LLM-Generated Synthetic Textcited by 18
- 2024Can GPT-3.5 Generate and Code Discharge Summaries?cited by 13
- 2024Evaluating Differentially Private Synthetic Data Generation in High-Stakes Domainscited by 12
- 2023PULSAR at MEDIQA-Sum 2023: Large Language Models Augmented by Synthetic Dialogue Convert Patient Dialogues to Medical Recordscited by 11
- 2025Evaluating Differentially Private Generation of Domain-Specific Textcited by 5
- 2024Controllable Synthetic Clinical Note Generation with Privacy Guaranteescited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.