mlsanityData to 14 Oct 2026

Guided Discrete Diffusion for Electronic Health Record Generation

arXiv 2404.12314 ↗First posted 18 Apr 2024cs.LGcited by 5

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Electronic health records (EHRs) are a pivotal data source that enables numerous applications in computational medicine, e.g., disease progression prediction, clinical trial design, and health economics and outcomes research. Despite wide usability, their sensitive nature raises privacy and confidentially concerns, which limit potential use cases. To tackle these challenges, we explore the use of generative models to synthesize artificial, yet realistic EHRs. While diffusion-based methods have recently demonstrated state-of-the-art performance in generating other data modalities and overcome the training instability and mode collapse issues that plague previous GAN-based approaches, their applications in EHR generation remain underexplored. The discrete nature of tabular medical code data in EHRs poses challenges for high-quality data generation, especially for continuous diffusion models. To this end, we introduce a novel tabular EHR generation method, EHR-D3PM, which enables both unconditional and conditional generation using the discrete diffusion model. Our experiments demonstrate that EHR-D3PM significantly outperforms existing generative baselines on comprehensive fidelity and utility metrics while maintaining less attribute and membership vulnerability risks. Furthermore, we show EHR-D3PM is effective as a data augmentation method and enhances performance on downstream tasks when combined with real data.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 46 of its 67 references that are in the map. First posted on arXiv 18 Apr 2024.

Builds on

46 of 67 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Models10 Mar
  2. 2023Synthesizing Mixed-type Electronic Health Records using Diffusion Models28 Feb
  3. 2023MedDiff: Generating Electronic Health Records using Accelerated Denoising Diffusion Model8 Feb
  4. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions10 Feb

Other references · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  7. 2017Improved Training of Wasserstein GANscited by 2,235
  8. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  9. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  10. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  11. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  12. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
30 more
  1. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
  2. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  3. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
  4. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 507
  5. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
  6. 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
  7. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  8. 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 305
  9. 2018Scalable and accurate deep learning for electronic health recordscited by 280
  10. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  11. 2017MMD GAN: Towards Deeper Understanding of Moment Matching Networkcited by 254
  12. 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 219
  13. 2021Autoregressive Diffusion Modelscited by 210
  14. 2017Generating Multi-label Discrete Patient Records using Generative Adversarial Networkscited by 197
  15. 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Spacecited by 186
  16. 2022Score-based Continuous-time Discrete Diffusion Modelscited by 169
  17. 2023Protein Design with Guided Discrete Diffusioncited by 157
  18. 2023Are Diffusion Models Vulnerable to Membership Inference Attacks?cited by 136
  19. 2022STaSy: Score-based Tabular data Synthesiscited by 86
  20. 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesiscited by 78
  21. 2023Generating and Imputing Tabular Data via Diffusion and Flow-based Gradient-Boosted Treescited by 62
  22. 2022A Multifaceted Benchmarking of Synthetic Electronic Health Record Generation Modelscited by 43
  23. 2022DiffusER: Discrete Diffusion via Edit-based Reconstructioncited by 41
  24. 2023Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuningcited by 39
  25. 2020CorGAN: Correlation-Capturing Convolutional Generative Adversarial Networks for Generating Synthetic Healthcare Recordscited by 37
  26. 2020EVA: Generating Longitudinal Electronic Health Records Using Conditional Variational Autoencoderscited by 28
  27. 2017Boundary-Seeking Generative Adversarial Networkscited by 27
  28. 2022PromptEHR: Conditional Electronic Healthcare Records Generation with Prompt Learningcited by 22
  29. 2018On Catastrophic Forgetting and Mode Collapse in Generative Adversarial Networkscited by 17
  30. 2018Stein Variational Gradient Descent Without Gradientcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Synthesizing Multimodal Electronic Health Records via Predictive Diffusion Models
  2. 2025An Integrated Approach to AI-Generated Content in e-health
  3. 2023Reliable Generation of Privacy-preserving Synthetic Electronic Health Record Time Series via Diffusion Models
  4. 2026Efficient Generative Prediction for EHR Foundation Models: The SCOPE and REACH Estimators
  5. 2023Synthetic Health-related Longitudinal Data with Mixed-type Variables Generated using Diffusion Models
  6. 2025Diffmv: A Unified Diffusion Framework for Healthcare Predictions with Random Missing Views and View Laziness
  7. 2026Generating Benchmark Health Data Using a Tabular Diffusion Transformer
  8. 2025A Comprehensive Survey of Synthetic Tabular Data Generation