mlsanityData to 14 Oct 2026

SATURN: Autoregressive Image Generation Guided by Scene Graphs

arXiv 2508.14502 ↗First posted 20 Aug 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

State-of-the-art text-to-image models excel at photorealistic rendering but often struggle to capture the layout and object relationships implied by complex prompts. Scene graphs provide a natural structural prior, yet previous graph-guided approaches have typically relied on heavy GAN or diffusion pipelines, which lag behind modern autoregressive architectures in both speed and fidelity. We introduce SATURN (Structured Arrangement of Triplets for Unified Rendering Networks), a lightweight extension to VAR-CLIP that translates a scene graph into a salience-ordered token sequence, enabling a frozen CLIP-VQ-VAE backbone to interpret graph structure while fine-tuning only the VAR transformer. On the Visual Genome dataset, SATURN reduces FID from 56.45% to 21.62% and increases the Inception Score from 16.03 to 24.78, outperforming prior methods such as SG2IM and SGDiff without requiring extra modules or multi-stage training. Qualitative results further confirm improvements in object count fidelity and spatial relation accuracy, showing that SATURN effectively combines structural awareness with state-of-the-art autoregressive fidelity.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 24 of its 26 references that are in the map. First posted on arXiv 20 Aug 2025.

Builds on

24 of 26 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2016Improved Techniques for Training GANscited by 2,970
  7. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  8. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  9. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  10. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  11. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  12. 2016Pixel Recurrent Neural Networkscited by 816
12 more
  1. 2018Image Transformercited by 772
  2. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  3. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  4. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  5. 2018Image Generation from Scene Graphscited by 324
  6. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  7. 2022Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Trainingcited by 56
  8. 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 47
  9. 2024VAR-CLIP: Text-to-Image Generator with Visual Auto-Regressive Modelingcited by 42
  10. 2021In Defense of Scene Graphs for Image Captioningcited by 31
  11. 2020Image-to-Image Retrieval by Learning Similarity between Scene Graphscited by 23
  12. 2019Visual-Relation Conscious Image Generation from Structured-Textcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.