SATURN: Autoregressive Image Generation Guided by Scene Graphs
Not on the map. Why?
Abstract (arXiv)
State-of-the-art text-to-image models excel at photorealistic rendering but often struggle to capture the layout and object relationships implied by complex prompts. Scene graphs provide a natural structural prior, yet previous graph-guided approaches have typically relied on heavy GAN or diffusion pipelines, which lag behind modern autoregressive architectures in both speed and fidelity. We introduce SATURN (Structured Arrangement of Triplets for Unified Rendering Networks), a lightweight extension to VAR-CLIP that translates a scene graph into a salience-ordered token sequence, enabling a frozen CLIP-VQ-VAE backbone to interpret graph structure while fine-tuning only the VAR transformer. On the Visual Genome dataset, SATURN reduces FID from 56.45% to 21.62% and increases the Inception Score from 16.03 to 24.78, outperforming prior methods such as SG2IM and SGDiff without requiring extra modules or multi-stage training. Qualitative results further confirm improvements in object count fidelity and spatial relation accuracy, showing that SATURN effectively combines structural awareness with state-of-the-art autoregressive fidelity.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 24 of its 26 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
24 of 26 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Improved Techniques for Training GANscited by 2,970
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2016Pixel Recurrent Neural Networkscited by 816
12 more
- 2018Image Transformercited by 772
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2018Image Generation from Scene Graphscited by 324
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2022Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Trainingcited by 56
- 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 47
- 2024VAR-CLIP: Text-to-Image Generator with Visual Auto-Regressive Modelingcited by 42
- 2021In Defense of Scene Graphs for Image Captioningcited by 31
- 2020Image-to-Image Retrieval by Learning Similarity between Scene Graphscited by 23
- 2019Visual-Relation Conscious Image Generation from Structured-Textcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.