mlsanityData to 14 Oct 2026

Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations

arXiv 2406.04916 ↗First posted 7 Jun 2024cs.LG cs.SI math.ATcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have excelled in generating various objects, generating graphs remains challenging. This thesis explores the potential of score-based generative models in generating such objects through a modelization as combinatorial complexes, which are powerful topological structures that encompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic differential equations. We not only generalize the generation of complex objects such as graphs and hypergraphs, but we also unify existing generative modelling approaches such as Score Matching with Langevin dynamics and Denoising Diffusion Probabilistic Models. This innovation overcomes limitations in existing frameworks that focus solely on graph generation, opening up new possibilities in generative AI. The experiment results showed that our framework could generate these complex objects, and could also compete against state-of-the-art approaches for mere graph and molecule generation tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 54 of its 104 references that are in the map. First posted on arXiv 7 Jun 2024.

Builds on

54 of 104 references.

Closest ancestors · 9

Same direction, newest first

  1. 2023Autoregressive Diffusion Model for Graph Generation17 Jul
  2. 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material4 Apr
  3. 2022Fast Graph Generation via Spectral Diffusion16 Nov
  4. 2022Diffusion Models for Graphs Benefit From Discrete State Spaces4 Oct
  5. 2022TabDDPM: Modelling Tabular Data with Diffusion Models30 Sep
  6. 2022DiGress: Discrete Denoising diffusion for graph generation29 Sep
  7. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation6 Mar
  8. 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations5 Feb
  9. 2020Permutation Invariant Graph Generation via Score-Based Generative Modeling2 Mar

Other references · 45

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2017Graph Attention Networkscited by 8,923
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  11. 2013Auto-Encoding Variational Bayescited by 4,053
  12. 2018Neural Ordinary Differential Equationscited by 3,779
33 more
  1. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  2. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  3. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
  4. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
  5. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
  6. 2018MolGAN: An implicit generative model for small molecular graphscited by 393
  7. 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 383
  8. 2022Understanding Diffusion Models: A Unified Perspectivecited by 340
  9. 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 305
  10. 2021How to Train Your Energy-Based Modelscited by 274
  11. 2022Torsional Diffusion for Molecular Conformer Generationcited by 263
  12. 2020Learning Gradient Fields for Shape Generationcited by 245
  13. 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 234
  14. 2018Learning Deep Generative Models of Graphscited by 229
  15. 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
  16. 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 194
  17. 2019Universal Invariant and Equivariant Graph Neural Networkscited by 183
  18. 2021GraphDF: A Discrete Flow Model for Molecular Graph Generationcited by 180
  19. 2021Learning Gradient Fields for Molecular Conformation Generationcited by 163
  20. 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
  21. 2021Geometric Deep Learning on Molecular Representationscited by 113
  22. 2020On Linear Identifiability of Learned Representationscited by 105
  23. 2018Multi-Objective De Novo Drug Design with Conditional Graph Generative Modelcited by 101
  24. 2021GraphEBM: Molecular Graph Generation with Energy-Based Modelscited by 85
  25. 2023Everything is Connected: Graph Neural Networkscited by 85
  26. 2019MolecularRNN: Generating realistic molecular graphs with optimized propertiescited by 82
  27. 2020Efficient Learning of Generative Models via Finite-Difference Score Matchingcited by 49
  28. 2022GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generationcited by 43
  29. 2023Architectures of Topological Deep Learning: A Survey of Message-Passing Topological Neural Networkscited by 43
  30. 2021Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutionscited by 39
  31. 2017Variational Walkback: Learning a Transition Operator as a Stochastic Recurrent Netcited by 30
  32. 2017Learning to Generate Samples from Noise through Infusion Trainingcited by 15
  33. 2023On the Mathematics of Diffusion Modelscited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Graph Generation with Diffusion Mixture
  2. 2024Diffusion-based Graph Generative Methods
  3. 2023Generative Diffusion Models on Graphs: Methods and Applications
  4. 2023Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph Generation
  5. 2025A Non-Asymptotic Convergent Analysis for Scored-Based Graph Generative Model via a System of Stochastic Differential Equations
  6. 2024Discrete-state Continuous-time Diffusion for Graph Generation
  7. 2024ComboStoc: Combinatorial Stochasticity for Diffusion Generative Models
  8. 2023Diffusion Models for Generative Artificial Intelligence: An Introduction for Applied Mathematicians