mlsanityData to 14 Oct 2026

ALR-GAN: Adaptive Layout Refinement for Text-to-Image Synthesis

arXiv 2304.06297 ↗First posted 13 Apr 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

We propose a novel Text-to-Image Generation Network, Adaptive Layout Refinement Generative Adversarial Network (ALR-GAN), to adaptively refine the layout of synthesized images without any auxiliary information. The ALR-GAN includes an Adaptive Layout Refinement (ALR) module and a Layout Visual Refinement (LVR) loss. The ALR module aligns the layout structure (which refers to locations of objects and background) of a synthesized image with that of its corresponding real image. In ALR module, we proposed an Adaptive Layout Refinement (ALR) loss to balance the matching of hard and easy features, for more efficient layout structure matching. Based on the refined layout structure, the LVR loss further refines the visual representation within the layout area. Experimental results on two widely-used datasets show that ALR-GAN performs competitively at the Text-to-Image generation task.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 13 Apr 2023.

Builds on

33 of 52 references.

References · 33

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2016Improved Techniques for Training GANscited by 2,970
  3. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  4. 2016Generative Adversarial Text to Image Synthesiscited by 735
  5. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  6. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  7. 2018Image Generation from Scene Graphscited by 324
  8. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  9. 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
  10. 2017StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 229
  11. 2019Controllable Text-to-Image Generationcited by 187
  12. 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
21 more
  1. 2017Dual-Path Convolutional Image-Text Embeddings with Instance Losscited by 145
  2. 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 138
  3. 2019Object-driven Text-to-Image Synthesis via Adversarial Trainingcited by 117
  4. 2018Image Generation from Layoutcited by 105
  5. 2018Inferring Semantic Layout for Hierarchical Text-to-Image Synthesiscited by 101
  6. 2019Semantic Object Accuracy for Generative Text-to-Image Synthesiscited by 89
  7. 2019Image Synthesis From Reconfigurable Layout and Stylecited by 85
  8. 2018Photographic Text-to-Image Synthesis with a Hierarchically-nested Adversarial Networkcited by 64
  9. 2019Semantics Disentangling for Text-to-Image Generationcited by 61
  10. 2020Object-Centric Image Generation from Layoutscited by 57
  11. 2017Look, Imagine and Match: Improving Textual-Visual Cross-Modal Retrieval with Generative Modelscited by 53
  12. 2020Learning Layout and Style Reconfigurable GANs for Controllable Image Synthesiscited by 49
  13. 2021DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesiscited by 45
  14. 2019PasteGAN: A Semi-Parametric Method to Generate Image from Scene Graphcited by 44
  15. 2019Generating Multiple Objects at Spatially Distinct Locationscited by 41
  16. 2020Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approachcited by 29
  17. 2017VSE++: Improving Visual-Semantic Embeddings with Hard Negativescited by 21
  18. 2018ChatPainter: Improving Text to Image Generation using Dialoguecited by 18
  19. 2022DR-GAN: Distribution Regularization for Text-to-Image Generationcited by 10
  20. 2019Visual-Relation Conscious Image Generation from Structured-Textcited by 8
  21. 2020Leveraging Visual Question Answering to Improve Text-to-Image Synthesiscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 1.

4 papers.