SNACK: A Sequential Notation Framework for Probabilistic Graph Generation
Not on the map. Why?
Abstract (arXiv)
We introduce SNACK, a string representation for probabilistic graph generation that enables sequence models to generate and model graphs with discrete node and edge features. SNACK linearizes graphs by encoding the nonzero entries of the lower-triangular adjacency matrix, establishing a bijective correspondence between valid sequences and ordered adjacency matrices. This design enables invalid logit masking to enforce structural constraints--such as chemical valence and ordering rules--guaranteeing 100% valid generated sequences. SNACK also enables principled string-based GFlowNet training by explicitly accounting for node-ordering symmetries. Across standard graph-generation tasks and molecular distribution-learning benchmarks, SNACK achieves competitive sample quality, while substantially improving the throughput of GFlowNet training relative to graph-based generation. Probing analyses further show that models trained on SNACK encode meaningful local and global graph structure despite receiving only sequential supervision. These results position SNACK as a practical framework for probabilistic graph generation with deep sequence models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 70 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
50 of 70 references.
References · 50
- 2017Attention Is All You Needcited by 60,361
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2018Deep contextualized word representationscited by 2,290
- 2020GLU Variants Improve Transformercited by 1,804
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 652
- 2015Sequence Level Training with Recurrent Neural Networkscited by 576
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 413
- 2021Flow Network based Generative Models for Non-Iterative Diverse Candidate Generationcited by 392
38 more
- 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 383
- 2018Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generationcited by 364
- 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 305
- 2018On the Optimization of Deep Networks: Implicit Acceleration by Overparameterizationcited by 284
- 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 283
- 2018Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Modelscited by 275
- 2020Permutation Invariant Graph Generation via Score-Based Generative Modelingcited by 270
- 2022Long Range Graph Benchmarkcited by 263
- 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 251
- 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 234
- 2018Learning Deep Generative Models of Graphscited by 229
- 2018Constrained Graph Variational Autoencoders for Molecule Designcited by 185
- 2021GraphDF: A Discrete Flow Model for Molecular Graph Generationcited by 180
- 2022Biological Sequence Design with GFlowNetscited by 174
- 2022GFlowNets and variational inferencecited by 106
- 2022Multi-Objective GFlowNetscited by 101
- 2023Amortizing intractable inference in large language modelscited by 97
- 2019MolecularRNN: Generating realistic molecular graphs with optimized propertiescited by 82
- 2020VarGrad: A Low-Variance Gradient Estimator for Variational Inferencecited by 75
- 2023Robust Scheduling with GFlowNetscited by 69
- 2020GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph Generationcited by 66
- 2020Scalable Deep Generative Modeling for Sparse Graphscited by 65
- 2023Gotta be SAFE: A New Framework for Molecular Designcited by 48
- 2020Molecular Mechanics-Driven Graph Neural Network with Multiplex Graph for Molecular Structurescited by 45
- 2025TxGemma: Efficient and Agentic LLMs for Therapeuticscited by 41
- 2024Genetic-guided GFlowNets for Sample Efficient Molecular Optimizationcited by 39
- 2021Order Matters: Probabilistic Modeling of Node Sequence for Graph Generationcited by 33
- 2025Graph Generative Pre-trained Transformercited by 17
- 2023Improving Graph Generation by Restricting Graph Bandwidthcited by 16
- 2023A Simple and Scalable Representation for Graph Generationcited by 16
- 2025Flatten Graphs as Sequences: Transformers are Scalable Graph Generatorscited by 13
- 2021GraphGen-Redux: a Fast and Lightweight Recurrent Model for labeled Graph Generationcited by 10
- 2025Symmetry-Aware GFlowNetscited by 7
- 2025Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generationcited by 4
- 2026Rooted Absorbed Prefix Trajectory Balance with Submodular Replay for GFlowNet Trainingcited by 3
- 2026Synthesizable Molecular Generation via Soft-constrained GFlowNets with Rich Chemical Priorscited by 1
- 2026Beyond Normalization: Rethinking the Partition Function as a Difficulty Scheduler for RLVRcited by 1
- 2026Stable-GFlowNet: Toward Diverse and Robust LLM Red-Teaming via Contrastive Trajectory Balancecited by 1
Built on by
Not cited yet.