mlsanityData to 14 Oct 2026

A Comprehensive Survey on Generative Diffusion Models for Structured Data

arXiv 2306.04139 ↗First posted 7 Jun 2023cs.LG cs.AIcited by 8

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

In recent years, generative diffusion models have achieved a rapid paradigm shift in deep generative models by showing groundbreaking performance across various applications. Meanwhile, structured data, encompassing tabular and time series data, has been received comparatively limited attention from the deep learning research community, despite its omnipresence and extensive applications. Thus, there is still a lack of literature and its reviews on structured data modelling via diffusion models, compared to other data modalities such as visual and textual data. To address this gap, we present a comprehensive review of recently proposed diffusion models in the field of structured data. First, this survey provides a concise overview of the score-based diffusion model theory, subsequently proceeding to the technical descriptions of the majority of pioneering works that used structured data in both data-driven general tasks and domain-specific applications. Thereafter, we analyse and discuss the limitations and challenges shown in existing works and suggest potential research directions. We hope this review serves as a catalyst for the research community, promoting developments in generative diffusion models for structured data.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 81 of its 116 references that are in the map. First posted on arXiv 7 Jun 2023.

Builds on

81 of 116 references.

Closest ancestors · 11

Same direction, newest first

  1. 2023Regular Time-series Generation using SGM20 Jan
  2. 2022Diffusion Models in Vision: A Survey10 Sep
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
  4. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning8 Aug
  5. 2022SOS: Score-based Oversampling for Tabular Data17 Jun
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  7. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANs15 Dec
  8. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesis29 Nov
  9. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 70

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  7. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  8. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  9. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  10. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  11. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  12. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
38 more
  1. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  2. 2019Modeling Tabular data using Conditional GANcited by 699
  3. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  4. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 637
  5. 2018Disentangling by Factorisingcited by 616
  6. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
  7. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 574
  8. 2021Tabular Data: Deep Learning is Not All You Needcited by 535
  9. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  10. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
  11. 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 384
  12. 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
  13. 2018GAIN: Missing Data Imputation using Generative Adversarial Netscited by 352
  14. 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
  15. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
  16. 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 333
  17. 2018Variational Autoencoders for Collaborative Filteringcited by 310
  18. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 290
  19. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  20. 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
  21. 2023Geometric Latent Diffusion Models for 3D Molecule Generationcited by 186
  22. 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
  23. 2021Well-tuned Simple Nets Excel on Tabular Datasetscited by 151
  24. 2019Quant GANs: Deep Generation of Financial Time Seriescited by 108
  25. 2017Fast Matrix Factorization for Online Recommendation with Implicit Feedbackcited by 101
  26. 2023DiffuRec: A Diffusion Model for Sequential Recommendationcited by 93
  27. 2023Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglementcited by 90
  28. 2023Diffusion Recommender Modelcited by 88
  29. 2022STaSy: Score-based Tabular data Synthesiscited by 86
  30. 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesiscited by 78
  31. 2022Diffusion models for missing value imputation in tabular datacited by 77
  32. 2023Diffusion Models for Time Series Applications: A Surveycited by 72
  33. 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
  34. 2022MDM: Molecular Diffusion Model for 3D Molecule Generationcited by 58
  35. 2017Table-to-text Generation by Structure-aware Seq2seq Learningcited by 54
  36. 2019Neural Empirical Bayescited by 46
  37. 2021Do We Really Need Deep Learning Models for Time Series Forecasting?cited by 45
  38. 2021ScoreGrad: Multivariate Probabilistic Time Series Forecasting with Continuous Energy-based Generative Modelscited by 43

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 0; 2026: 2.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Improving Discrete Diffusion Models via Structured Preferential Generation
  2. 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models
  3. 2022How Much is Enough? A Study on Diffusion Times in Score-based Generative Models
  4. 2024Generative Diffusion Modeling: A Practical Handbook
  5. 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization
  6. 2024A Score-Based Density Formula, with Applications in Diffusion Generative Models
  7. 2022Graphically Structured Diffusion Models
  8. 2021Conditional Image Generation with Score-Based Diffusion Models