mlsanityData to 14 Oct 2026

Diffusion-Free Graph Generation with Next-Scale Prediction

arXiv 2503.23612 ↗First posted 30 Mar 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Autoregressive models excel in efficiency and plug directly into the transformer ecosystem, delivering robust generalization, predictable scalability, and seamless workflows such as fine-tuning and parallelized training. However, they require an explicit sequence order, which contradicts the unordered nature of graphs. In contrast, diffusion models maintain permutation invariance and enable one-shot generation but require up to thousands of denoising steps and additional features for expressivity, leading to high computational costs. Inspired by recent breakthroughs in image generation, especially the success of visual autoregressive methods, we propose MAG, a novel diffusion-free graph generation framework based on next-scale prediction. By leveraging a hierarchy of latent representations, the model progressively generates scales of the entire graph without the need for explicit node ordering. Experiments on both generic and molecular graph datasets demonstrated the potential of this method, achieving inference speedups of up to three orders of magnitude over state-of-the-art methods, while preserving high-quality generation.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 24 of its 30 references that are in the map. First posted on arXiv 30 Mar 2025.

Builds on

24 of 30 references.

References · 24

  1. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  2. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  3. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 765
  4. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 652
  5. 2020Scaling Laws for Autoregressive Generative Modelingcited by 522
  6. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
  7. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
  8. 2018MolGAN: An implicit generative model for small molecular graphscited by 393
  9. 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 383
  10. 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 305
  11. 2017Grammar Variational Autoencodercited by 285
  12. 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 283
12 more
  1. 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 270
  2. 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 234
  3. 2018Learning Deep Generative Models of Graphscited by 229
  4. 2020Hierarchical Generation of Molecular Graphs using Structural Motifscited by 208
  5. 2021GraphDF: A Discrete Flow Model for Molecular Graph Generationcited by 180
  6. 2023Autoregressive Diffusion Model for Graph Generationcited by 83
  7. 2025Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generationcited by 71
  8. 2023Efficient and Scalable Graph Generation through Iterative Local Expansioncited by 36
  9. 2021Order Matters: Probabilistic Modeling of Node Sequence for Graph Generationcited by 33
  10. 2023SwinGNN: Rethinking Permutation Invariance in Diffusion Models for Graph Generationcited by 28
  11. 2024Pard: Permutation-Invariant Autoregressive Diffusion for Graph Generationcited by 25
  12. 2025FlexVAR: Flexible Visual Autoregressive Modeling without Residual Predictioncited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Generative Diffusion Models on Graphs: Methods and Applications
  2. 2025Fast Graph Generation via Autoregressive Noisy Filtration Modeling
  3. 2023Efficient and Degree-Guided Graph Generation via Discrete Diffusion Modeling
  4. 2025LGDC: Latent Graph Diffusion via Spectrum-Preserving Coarsening
  5. 2026Principled Latent Diffusion for Graphs via Laplacian Autoencoders
  6. 2026Discrete Diffusion for Large Graph Generation via Structural Candidate Restriction
  7. 2024Diffusion-based Graph Generative Methods
  8. 2023Graph Generation with Diffusion Mixture