mlsanityData to 7 Oct 2026

LayoutTransformer: Layout Generation and Completion with Self-attention

arXiv 2006.14615 ↗First posted 25 Jun 2020cs.CV cs.LGcited by 122

Not on the map. Why?

Cited by 24 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We address the problem of scene layout generation for diverse domains such as images, mobile applications, documents, and 3D objects. Most complex scenes, natural or human-designed, can be expressed as a meaningful arrangement of simpler compositional graphical primitives. Generating a new layout or extending an existing layout requires understanding the relationships between these primitives. To do this, we propose LayoutTransformer, a novel framework that leverages self-attention to learn contextual relationships between layout elements and generate novel layouts in a given domain. Our framework allows us to generate a new layout either from an empty set or from an initial seed set of primitives, and can easily scale to support an arbitrary of primitives per layout. Furthermore, our analyses show that the model is able to automatically capture the semantic properties of the primitives. We propose simple improvements in both representation of layout primitives, as well as training methods to demonstrate competitive performance in very diverse data domains such as object bounding boxes in natural images(COCO bounding box), documents (PubLayNet), mobile applications (RICO dataset) as well as 3D shapes (Part-Net). Code and other materials will be made available at https://kampta.github.io/layout.

Key facts. Cited by 122 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 11; 2023: 28; 2024: 34; 2025: 29; 2026: 17.

122 papers.

Sort:

By area:

  1. 2022Multimodal Learning with Transformers: A Surveycited by 399
  2. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  3. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
  4. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
  5. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
  6. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  7. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
  8. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
  9. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  10. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  11. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
  12. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generationcited by 57
38 more
  1. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 47
  2. 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
  3. 2023Unifying Layout Generation with a Decoupled Diffusion Modelcited by 41
  4. 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Modelscited by 40
  5. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 39
  6. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
  7. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 34
  8. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 34
  9. 2022Geometry Aligned Variational Transformer for Image-conditioned Layout Generationcited by 33
  10. 2023Towards Flexible Multi-modal Document Modelscited by 30
  11. 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
  12. 2023NAP: Neural 3D Articulation Priorcited by 25
  13. 20223D VSG: Long-term Semantic Scene Change Prediction through 3D Variable Scene Graphscited by 24
  14. 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusioncited by 24
  15. 2023Dolfin: Diffusion Layout Transformers without Autoencodercited by 23
  16. 2023LANS: A Layout-Aware Neural Solver for Plane Geometry Problemcited by 23
  17. 2023Diffusion-based Document Layout Generationcited by 21
  18. 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
  19. 2022Aesthetic Text Logo Synthesis via Content-aware Layout Inferringcited by 19
  20. 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
  21. 2023SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Controlcited by 18
  22. 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
  23. 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blendingcited by 16
  24. 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
  25. 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
  26. 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptionscited by 15
  27. 2023UI Layout Generation with LLMs Guided by UI Grammarcited by 15
  28. 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 15
  29. 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 15
  30. 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posterscited by 14
  31. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 14
  32. 2023Unsupervised Domain Adaption with Pixel-level Discriminator for Image-aware Layout Generationcited by 13
  33. 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generationcited by 13
  34. 2024UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Modelcited by 13
  35. 2023Towards Diverse and Consistent Typography Generationcited by 11
  36. 2024Discriminative Probing and Tuning for Text-to-Image Generationcited by 11
  37. 2024COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generationcited by 10
  38. 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10

50 most cited of 122 All 122 (JSON)