Scaling Novel Graph Generation via Lightweight Structure-Guided Autoregressive Models
Not on the map. Why?
Abstract (arXiv)
Generating realistic and diverse graphs is a key problem in machine learning, with applications in molecular discovery, circuit design, cybersecurity, and beyond. However, current graph generative models remain limited by scalability and novelty. Diffusion-based methods often require costly full-adjacency operations and long denoising chains, while many autoregressive and hybrid models have at least quadratic complexity. In addition, these models often imitate training graphs rather than generalize beyond them. We propose a lightweight autoregressive framework to address these issues. It uses a structure-guided topological ordering to serialize graphs into regular edge sequences, enabling near log-linear generation, and a two-phase training strategy that combines exploration-oriented augmentation with iterative refinement to reduce overfitting and promote controlled novelty. Experiments on molecular and non-molecular benchmarks show that our approach improves novelty while preserving high validity and uniqueness. The framework also supports both LSTM and Mamba-style causal sequence backbones, with large-memory accelerators enabling longer graph-sequence experiments beyond typical GPU limits.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 30 of its 32 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
30 of 32 references.
References · 30
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,658
- 2020Graph Contrastive Learning with Augmentationscited by 1,207
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 913
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
- 2023RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignmentcited by 680
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 509
- 2023Reinforced Self-Training (ReST) for Language Modelingcited by 492
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 410
- 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 378
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 276
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 266
- 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 233
18 more
- 2018Learning Deep Generative Models of Graphscited by 228
- 2017struc2vec: Learning Node Representations from Structural Identitycited by 214
- 2017Learning Structural Node Embeddings Via Diffusion Waveletscited by 97
- 2023Autoregressive Diffusion Model for Graph Generationcited by 82
- 2024DeFoG: Discrete Flow Matching for Graph Generationcited by 78
- 2024Discrete-state Continuous-time Diffusion for Graph Generationcited by 75
- 2020Scalable Deep Generative Modeling for Sparse Graphscited by 64
- 2022GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generationcited by 43
- 2021Order Matters: Probabilistic Modeling of Node Sequence for Graph Generationcited by 32
- 2024Cometh: A continuous-time discrete-state graph diffusion modelcited by 30
- 2025Learning-Order Autoregressive Models with Application to Molecular Graph Generationcited by 29
- 2024Pard: Permutation-Invariant Autoregressive Diffusion for Graph Generationcited by 25
- 2025Graph Generative Pre-trained Transformercited by 16
- 2023A Simple and Scalable Representation for Graph Generationcited by 15
- 2025Flatten Graphs as Sequences: Transformers are Scalable Graph Generatorscited by 12
- 2023Let There Be Order: Rethinking Ordering in Autoregressive Graph Generationcited by 7
- 2024Overcoming Order in Autoregressive Graph Generationcited by 3
- 2025Diffusion-Free Graph Generation with Next-Scale Predictioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Fast Graph Generation via Autoregressive Noisy Filtration Modeling
- 2024SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation
- 2023Graph Generation with Diffusion Mixture
- 2026Discrete Diffusion for Large Graph Generation via Structural Candidate Restriction
- 2024Generative Modelling of Structurally Constrained Graphs
- 2023Efficient and Scalable Graph Generation through Iterative Local Expansion
- 2023Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph Generation
- 2023Efficient and Degree-Guided Graph Generation via Discrete Diffusion Modeling