Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have excelled in generating various objects, generating graphs remains challenging. This thesis explores the potential of score-based generative models in generating such objects through a modelization as combinatorial complexes, which are powerful topological structures that encompass higher-order relationships. In this thesis, we propose a unified framework by employing stochastic differential equations. We not only generalize the generation of complex objects such as graphs and hypergraphs, but we also unify existing generative modelling approaches such as Score Matching with Langevin dynamics and Denoising Diffusion Probabilistic Models. This innovation overcomes limitations in existing frameworks that focus solely on graph generation, opening up new possibilities in generative AI. The experiment results showed that our framework could generate these complex objects, and could also compete against state-of-the-art approaches for mere graph and molecule generation tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 54 of its 104 references that are in the map. First posted on arXiv 7 Jun 2024.
Builds on
54 of 104 references.
Closest ancestors · 9
Same direction, newest first
- 2023Autoregressive Diffusion Model for Graph Generation17 Jul
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material4 Apr
- 2022Fast Graph Generation via Spectral Diffusion16 Nov
- 2022Diffusion Models for Graphs Benefit From Discrete State Spaces4 Oct
- 2022TabDDPM: Modelling Tabular Data with Diffusion Models30 Sep
- 2022DiGress: Discrete Denoising diffusion for graph generation29 Sep
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation6 Mar
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations5 Feb
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modeling2 Mar
Other references · 45
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2017Graph Attention Networkscited by 8,923
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2018Neural Ordinary Differential Equationscited by 3,779
33 more
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
- 2018MolGAN: An implicit generative model for small molecular graphscited by 393
- 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 383
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 340
- 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 305
- 2021How to Train Your Energy-Based Modelscited by 274
- 2022Torsional Diffusion for Molecular Conformer Generationcited by 263
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 234
- 2018Learning Deep Generative Models of Graphscited by 229
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
- 2018Fr'echet ChemNet Distance: A metric for generative models for molecules in drug discoverycited by 194
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 183
- 2021GraphDF: A Discrete Flow Model for Molecular Graph Generationcited by 180
- 2021Learning Gradient Fields for Molecular Conformation Generationcited by 163
- 2021Accurate Learning of Graph Representations with Graph Multiset Poolingcited by 120
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2020On Linear Identifiability of Learned Representationscited by 105
- 2018Multi-Objective De Novo Drug Design with Conditional Graph Generative Modelcited by 101
- 2021GraphEBM: Molecular Graph Generation with Energy-Based Modelscited by 85
- 2023Everything is Connected: Graph Neural Networkscited by 85
- 2019MolecularRNN: Generating realistic molecular graphs with optimized propertiescited by 82
- 2020Efficient Learning of Generative Models via Finite-Difference Score Matchingcited by 49
- 2022GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generationcited by 43
- 2023Architectures of Topological Deep Learning: A Survey of Message-Passing Topological Neural Networkscited by 43
- 2021Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutionscited by 39
- 2017Variational Walkback: Learning a Transition Operator as a Stochastic Recurrent Netcited by 30
- 2017Learning to Generate Samples from Noise through Infusion Trainingcited by 15
- 2023On the Mathematics of Diffusion Modelscited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Graph Generation with Diffusion Mixture
- 2024Diffusion-based Graph Generative Methods
- 2023Generative Diffusion Models on Graphs: Methods and Applications
- 2023Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph Generation
- 2025A Non-Asymptotic Convergent Analysis for Scored-Based Graph Generative Model via a System of Stochastic Differential Equations
- 2024Discrete-state Continuous-time Diffusion for Graph Generation
- 2024ComboStoc: Combinatorial Stochasticity for Diffusion Generative Models
- 2023Diffusion Models for Generative Artificial Intelligence: An Introduction for Applied Mathematicians