Scalable Deep Generative Modeling for Sparse Graphs
Not on the map. Why?
Abstract (arXiv)
Learning graph generative models is a challenging task for deep learning and has wide applicability to a range of domains like chemistry, biology and social science. However current deep neural methods suffer from limited scalability: for a graph with n nodes and m edges, existing deep neural methods require Omega(n2) complexity by building up the adjacency matrix. On the other hand, many real world graphs are actually sparse in the sense that mll n2. Based on this, we develop a novel autoregressive model, named BiGG, that utilizes this sparsity to avoid generating the full adjacency matrix, and importantly reduces the graph generation time complexity to O((n + m)log n). Furthermore, during training this autoregressive model can be parallelized with O(log n) synchronization stages, which makes it much more efficient than other autoregressive models that require Omega(n). Experiments on several benchmarks show that the proposed approach not only scales to orders of magnitude larger graphs than previously possible with deep autoregressive graph generative models, but also yields better graph generation quality.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 13; 2023: 19; 2024: 6; 2025: 10; 2026: 6.
63 papers.
Sort:
By area:
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 273
- 2022SPECTRE: Spectral Conditioning Helps to Overcome the Expressivity Limits of One-shot Graph Generatorscited by 96
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2023Autoregressive Diffusion Model for Graph Generationcited by 82
- 2023Efficient and Degree-Guided Graph Generation via Discrete Diffusion Modelingcited by 75
- 2022A Survey on Deep Graph Generation: Methods and Applicationscited by 69
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generationcited by 57
- 2022On Evaluation Metrics for Graph Generative Modelscited by 44
- 2022GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generationcited by 43
- 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
- 2021Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutionscited by 38
- 2023Efficient and Scalable Graph Generation through Iterative Local Expansioncited by 35
38 more
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Materialcited by 34
- 2021Order Matters: Probabilistic Modeling of Node Sequence for Graph Generationcited by 32
- 2023Sparse Training of Discrete Diffusion Models for Graph Generationcited by 26
- 2021Graph Transformer Networks: Learning Meta-path Graphs to Improve GNNscited by 22
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2022NVDiff: Graph Generation through the Diffusion of Node Vectorscited by 18
- 2023Curvature Filtrations for Graph Generative Model Evaluationcited by 18
- 2024Generative Modelling of Structurally Constrained Graphscited by 17
- 2023Metric Space Magnitude for Evaluating the Diversity of Latent Representationscited by 16
- 2025Graph Generative Pre-trained Transformercited by 16
- 2023Improving Graph Generation by Restricting Graph Bandwidthcited by 15
- 2023A Simple and Scalable Representation for Graph Generationcited by 15
- 2025Flatten Graphs as Sequences: Transformers are Scalable Graph Generatorscited by 12
- 2024Continual Learning on Graphs: A Surveycited by 11
- 2024LLM-Based Multi-Agent Systems are Scalable Graph Generative Modelscited by 11
- 2021Partition and Code: learning how to compress graphscited by 10
- 2023Node-Aligned Graph-to-Graph (NAG2G): Elevating Template-Free Deep Learning Approaches in Single-Step Retrosynthesiscited by 9
- 2023D4Explainer: In-Distribution GNN Explanations via Discrete Denoising Diffusioncited by 9
- 2022Micro and Macro Level Graph Modeling for Graph Variational Auto-Encoderscited by 8
- 2025Bures-Wasserstein Flow Matching for Graph Generationcited by 7
- 2022Evaluating Graph Generative Models with Contrastively Learned Featurescited by 5
- 2023HiGen: Hierarchical Graph Generative Networkscited by 5
- 2021Learning Graphon Autoencoders for Generative Graph Modelingcited by 4
- 2023ARTree: A Deep Autoregressive Model for Phylogenetic Inferencecited by 4
- 2021TD-GEN: Graph Generation With Tree Decompositioncited by 3
- 2022AgraSSt: Approximate Graph Stein Statistics for Interpretable Assessment of Implicit Graph Generatorscited by 3
- 2022GEMS: Scene Expansion using Generative Models of Graphscited by 3
- 2023W2SAT: Learning to generate SAT instances from Weighted Literal Incidence Graphscited by 3
- 2023EDGE++: Improved Training and Sampling of EDGEcited by 3
- 2024Towards Realistic Synthetic User-Generated Content: A Scaffolding Approach to Generating Online Discussionscited by 3
- 2025Backdoor Attacks on Discrete Graph Diffusion Modelscited by 3
- 2021In-game Residential Home Planning via Visual Context-aware Global Relation Learningcited by 2
- 2022Large-Scale Auto-Regressive Modeling Of Street Networkscited by 2
- 2023Modeling and design of heterogeneous hierarchical bioinspired spider web structures using generative deep learning and additive manufacturingcited by 2
- 2024Random Walk Diffusion for Efficient Large-Scale Graph Generationcited by 2
- 2025GDGB: A Benchmark for Generative Dynamic Text-Attributed Graph Learningcited by 2
- 2025Scalable Generative Modeling of Weighted Graphscited by 2
- 2026Flowette: Flow Matching with Graphette Priors for Graph Generationcited by 2
50 most cited of 63 All 63 (JSON)
- 2026Stable Transformers for Graph Generation30 Sep 2026
- 2026GraphK: Variable-Size Graph Generation with Efficient Edge Construction19 Aug 2026
- 2026Scaling Novel Graph Generation via Lightweight Structure-Guided Autoregressive Models2 Jun 2026
- 2026Graph-GRPO: Training Graph Flow Models with Reinforcement Learning11 Mar 2026
- 2026Flowette: Flow Matching with Graphette Priors for Graph Generation27 Feb 2026
- 2026Variational Bayesian Flow Network for Graph Generation30 Jan 2026
- 2025LGDC: Latent Graph Diffusion via Spectrum-Preserving Coarsening1 Dec 2025
- 2025Scalable Generative Modeling of Weighted Graphs30 Jul 2025
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation24 Jul 2025
- 2025NGTM: Substructure-based Neural Graph Topic Model for Interpretable Graph Generation17 Jul 2025
- 2025GDGB: A Benchmark for Generative Dynamic Text-Attributed Graph Learning4 Jul 2025
- 2025Bures-Wasserstein Flow Matching for Graph Generation16 Jun 2025
38 more
- 2025A collaborative constrained graph diffusion model for the generation of realistic synthetic molecules22 May 2025
- 2025Backdoor Attacks on Discrete Graph Diffusion Models8 Mar 2025
- 2025Flatten Graphs as Sequences: Transformers are Scalable Graph Generators4 Feb 2025
- 2025Graph Generative Pre-trained Transformer2 Jan 2025
- 2024LLM-Based Multi-Agent Systems are Scalable Graph Generative Models13 Oct 2024
- 2024IFH: a Diffusion Framework for Flexible Design of Graph Generative Models23 Aug 2024
- 2024Towards Realistic Synthetic User-Generated Content: A Scaffolding Approach to Generating Online Discussions15 Aug 2024
- 2024Random Walk Diffusion for Efficient Large-Scale Graph Generation8 Aug 2024
- 2024Generative Modelling of Structurally Constrained Graphs25 Jun 2024
- 2024Continual Learning on Graphs: A Survey9 Feb 2024
- 2023Efficient and Scalable Graph Generation through Iterative Local Expansion14 Dec 2023
- 2023A Simple and Scalable Representation for Graph Generation4 Dec 2023
- 2023Metric Space Magnitude for Evaluating the Diversity of Latent Representations27 Nov 2023
- 2023Sparse Training of Discrete Diffusion Models for Graph Generation3 Nov 2023
- 2023D4Explainer: In-Distribution GNN Explanations via Discrete Denoising Diffusion30 Oct 2023
- 2023EDGE++: Improved Training and Sampling of EDGE22 Oct 2023
- 2023ARTree: A Deep Autoregressive Model for Phylogenetic Inference14 Oct 2023
- 2023Node-Aligned Graph-to-Graph (NAG2G): Elevating Template-Free Deep Learning Approaches in Single-Step Retrosynthesis27 Sep 2023
- 2023SANGEA: Scalable and Attributed Network Generation27 Sep 2023
- 2023Autoregressive Diffusion Model for Graph Generation17 Jul 2023
- 2023HiGen: Hierarchical Graph Generative Networks30 May 2023
- 2023Efficient and Degree-Guided Graph Generation via Discrete Diffusion Modeling6 May 2023
- 2023Modeling and design of heterogeneous hierarchical bioinspired spider web structures using generative deep learning and additive manufacturing11 Apr 2023
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material4 Apr 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023On Hierarchical Multi-Resolution Graph Generative Models6 Mar 2023
- 2023W2SAT: Learning to generate SAT instances from Weighted Literal Incidence Graphs1 Feb 2023
- 2023Curvature Filtrations for Graph Generative Model Evaluation30 Jan 2023
- 2023Improving Graph Generation by Restricting Graph Bandwidth25 Jan 2023
- 2022GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generation4 Dec 2022
- 2022NVDiff: Graph Generation through the Diffusion of Node Vectors19 Nov 2022
- 2022Micro and Macro Level Graph Modeling for Graph Variational Auto-Encoders30 Oct 2022
- 2022Large-Scale Auto-Regressive Modeling Of Street Networks1 Sep 2022
- 2022GEMS: Scene Expansion using Generative Models of Graphs8 Jul 2022
- 2022Evaluating Graph Generative Models with Contrastively Learned Features13 Jun 2022
- 2022SPECTRE: Spectral Conditioning Helps to Overcome the Expressivity Limits of One-shot Graph Generators4 Apr 2022
- 2022DAMNETS: A Deep Autoregressive Model for Generating Markovian Network Time Series28 Mar 2022
- 2022Gransformer: Transformer-based Graph Generation25 Mar 2022
50 newest of 63 All 63 (JSON)
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 273
- 2023Autoregressive Diffusion Model for Graph Generationcited by 82
- 2023Efficient and Degree-Guided Graph Generation via Discrete Diffusion Modelingcited by 75
- 2023A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Materialcited by 34
- 2023Sparse Training of Discrete Diffusion Models for Graph Generationcited by 26
- 2022NVDiff: Graph Generation through the Diffusion of Node Vectorscited by 18
- 2024Generative Modelling of Structurally Constrained Graphscited by 17
- 2023D4Explainer: In-Distribution GNN Explanations via Discrete Denoising Diffusioncited by 9
- 2025Bures-Wasserstein Flow Matching for Graph Generationcited by 7
- 2025Backdoor Attacks on Discrete Graph Diffusion Modelscited by 3
- 2023Modeling and design of heterogeneous hierarchical bioinspired spider web structures using generative deep learning and additive manufacturingcited by 2
- 2026Flowette: Flow Matching with Graphette Priors for Graph Generationcited by 2
12 most cited of 15 All 15 (JSON)
- 2026Flowette: Flow Matching with Graphette Priors for Graph Generation27 Feb 2026
- 2026Variational Bayesian Flow Network for Graph Generation30 Jan 2026
- 2025Bures-Wasserstein Flow Matching for Graph Generation16 Jun 2025
- 2025A collaborative constrained graph diffusion model for the generation of realistic synthetic molecules22 May 2025
- 2025Backdoor Attacks on Discrete Graph Diffusion Models8 Mar 2025
- 2024IFH: a Diffusion Framework for Flexible Design of Graph Generative Models23 Aug 2024
- 2024Generative Modelling of Structurally Constrained Graphs25 Jun 2024
- 2023Sparse Training of Discrete Diffusion Models for Graph Generation3 Nov 2023
- 2023D4Explainer: In-Distribution GNN Explanations via Discrete Denoising Diffusion30 Oct 2023
- 2023Autoregressive Diffusion Model for Graph Generation17 Jul 2023
- 2023Efficient and Degree-Guided Graph Generation via Discrete Diffusion Modeling6 May 2023
- 2023Modeling and design of heterogeneous hierarchical bioinspired spider web structures using generative deep learning and additive manufacturing11 Apr 2023
12 newest of 15 All 15 (JSON)
- 2022SPECTRE: Spectral Conditioning Helps to Overcome the Expressivity Limits of One-shot Graph Generatorscited by 96
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2022A Survey on Deep Graph Generation: Methods and Applicationscited by 69
- 2022On Evaluation Metrics for Graph Generative Modelscited by 44
- 2022GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generationcited by 43
- 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
- 2021Evaluation Metrics for Graph Generative Models: Problems, Pitfalls, and Practical Solutionscited by 38
- 2023Efficient and Scalable Graph Generation through Iterative Local Expansioncited by 35
- 2021Order Matters: Probabilistic Modeling of Node Sequence for Graph Generationcited by 32
- 2021Graph Transformer Networks: Learning Meta-path Graphs to Improve GNNscited by 22
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2023Curvature Filtrations for Graph Generative Model Evaluationcited by 18
12 most cited of 45 All 45 (JSON)
- 2026Stable Transformers for Graph Generation30 Sep 2026
- 2026GraphK: Variable-Size Graph Generation with Efficient Edge Construction19 Aug 2026
- 2026Scaling Novel Graph Generation via Lightweight Structure-Guided Autoregressive Models2 Jun 2026
- 2025LGDC: Latent Graph Diffusion via Spectrum-Preserving Coarsening1 Dec 2025
- 2025Scalable Generative Modeling of Weighted Graphs30 Jul 2025
- 2025NGTM: Substructure-based Neural Graph Topic Model for Interpretable Graph Generation17 Jul 2025
- 2025GDGB: A Benchmark for Generative Dynamic Text-Attributed Graph Learning4 Jul 2025
- 2025Flatten Graphs as Sequences: Transformers are Scalable Graph Generators4 Feb 2025
- 2025Graph Generative Pre-trained Transformer2 Jan 2025
- 2024Towards Realistic Synthetic User-Generated Content: A Scaffolding Approach to Generating Online Discussions15 Aug 2024
- 2024Random Walk Diffusion for Efficient Large-Scale Graph Generation8 Aug 2024
- 2024Continual Learning on Graphs: A Survey9 Feb 2024
12 newest of 45 All 45 (JSON)