mlsanityData to 7 Oct 2026

Improving Graph Generation by Restricting Graph Bandwidth

arXiv 2301.10857 ↗First posted 25 Jan 2023cs.LG cs.SIcited by 15

Not on the map. Why?

Abstract (arXiv)

Deep graph generative modeling has proven capable of learning the distribution of complex, multi-scale structures characterizing real-world graphs. However, one of the main limitations of existing methods is their large output space, which limits generation scalability and hinders accurate modeling of the underlying distribution. To overcome these limitations, we propose a novel approach that significantly reduces the output space of existing graph generative models. Specifically, starting from the observation that many real-world graphs have low graph bandwidth, we restrict graph bandwidth during training and generation. Our strategy improves both generation scalability and quality without increasing architectural complexity or reducing expressiveness. Our approach is compatible with existing graph generative methods, and we describe its application to both autoregressive and one-shot models. We extensively validate our strategy on synthetic and real datasets, including molecular graphs. Our experiments show that, in addition to improving generation efficiency, our approach consistently improves generation quality and reconstruction accuracy. The implementation is made available.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 25 Jan 2023.

Builds on

33 of 61 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  7. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  8. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  9. 2016Variational Graph Auto-Encoderscited by 1,373
  10. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  11. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  12. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
21 more
  1. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  2. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
  3. 2017Representation Learning on Graphs: Methods and Applicationscited by 456
  4. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
  5. 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 375
  6. 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 301
  7. 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 263
  8. 2022Long Range Graph Benchmarkcited by 258
  9. 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 231
  10. 2018Learning Deep Generative Models of Graphscited by 227
  11. 2018Constrained Graph Variational Autoencoders for Molecule Designcited by 182
  12. 2018Graphite: Iterative Generative Modeling of Graphscited by 112
  13. 2020A Systematic Survey on Deep Generative Models for Graph Generationcited by 94
  14. 2021Graph Representation Learning in Biomedicinecited by 79
  15. 2018Constrained Generation of Semantically Valid Graphs via Regularizing Variational Autoencoderscited by 74
  16. 2020GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph Generationcited by 65
  17. 2020Scalable Deep Generative Modeling for Sparse Graphscited by 63
  18. 2022On Evaluation Metrics for Graph Generative Modelscited by 44
  19. 2021Order Matters: Probabilistic Modeling of Node Sequence for Graph Generationcited by 32
  20. 2021Permutation-Invariant Variational Autoencoder for Graph-Level Representation Learningcited by 23
  21. 2019Fast Training of Sparse Graph Neural Networks on Dense Hardwarecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 4; 2025: 5; 2026: 4.

15 papers.

Sort:

By area: