mlsanityData to 7 Oct 2026

LayoutDM: Discrete Diffusion Model for Controllable Layout Generation

arXiv 2303.08137 ↗First posted 14 Mar 2023cs.CV cs.GRcited by 141

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Controllable layout generation aims at synthesizing plausible arrangement of element bounding boxes with optional constraints, such as type or position of a specific element. In this work, we try to solve a broad range of layout generation tasks in a single model that is based on discrete state-space diffusion models. Our model, named LayoutDM, naturally handles the structured layout data in the discrete representation and learns to progressively infer a noiseless layout from the initial input, where we model the layout corruption process by modality-wise discrete diffusion. For conditional generation, we propose to inject layout constraints in the form of masking or logit adjustment during inference. We show in the experiments that our LayoutDM successfully generates high-quality layouts and outperforms both task-specific and task-agnostic baselines on several layout tasks.

Key facts. Cited by 141 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 34 of its 53 references that are in the map. First posted on arXiv 14 Mar 2023.

Builds on

34 of 53 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Compositional Visual Generation with Composable Diffusion Models3 Jun

Other references · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  9. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  10. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  12. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
21 more
  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  2. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  3. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  4. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  5. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  6. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  7. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  8. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  9. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
  10. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
  11. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  12. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
  13. 2021Variational Transformer Networks for Layout Generationcited by 88
  14. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  15. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  16. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  17. 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 68
  18. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 67
  19. 2019READ: Recursive Autoencoders for Document Layout Generationcited by 51
  20. 2020Retrieve-Then-Adapt: Example-based Automatic Generation for Proportion-related Infographicscited by 14
  21. 2022Generative Colorization of Structured Mobile Web Pagescited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 17; 2024: 56; 2025: 39; 2026: 29.

141 papers.

Sort:

By area:

  1. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  2. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  3. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
  4. 2024Variational Flow Matching for Graph Generationcited by 78
  5. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
  6. 2024How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Frameworkcited by 48
  7. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 47
  8. 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithmscited by 47
  9. 2024Infinite-ID: Identity-preserved Personalization via ID-semantics Decoupling Paradigmcited by 38
  10. 2024Graphic Design with Large Multimodal Modelcited by 38
  11. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  12. 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 36
38 more
  1. 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 36
  2. 2023DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusioncited by 36
  3. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
  4. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
  5. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 34
  6. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 34
  7. 2023Towards Flexible Multi-modal Document Modelscited by 30
  8. 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
  9. 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
  10. 2024CityCraft: A Real Crafter for 3D City Generationcited by 25
  11. 2024Both Ears Wide Open: Towards Language-Driven Spatial Audio Generationcited by 25
  12. 2023Dolfin: Diffusion Layout Transformers without Autoencodercited by 23
  13. 2024UrbanWorld: An Urban World Model for 3D City Generationcited by 23
  14. 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
  15. 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
  16. 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Datasetcited by 21
  17. 2024Alfie: Democratising RGBA Image Generation With No cited by 20
  18. 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 17
  19. 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
  20. 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 15
  21. 2024Multimodal Markup Document Models for Graphic Design Completioncited by 15
  22. 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 15
  23. 2025LLM/Agent-as-Data-Analyst: A Surveycited by 15
  24. 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posterscited by 14
  25. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 14
  26. 2025PreGenie: An Agentic Framework for High-quality Visual Presentation Generationcited by 14
  27. 2025Uni-Layout: Integrating Human Feedback in Unified Layout Generation and Evaluationcited by 13
  28. 2023VisorGPT: Learning Visual Prior via Generative Pre-Trainingcited by 11
  29. 2023Towards Diverse and Consistent Typography Generationcited by 11
  30. 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
  31. 2024TKG-DM: Training-free Chroma Key Content Generation Diffusion Modelcited by 11
  32. 2024[MASK] is All You Needcited by 11
  33. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 11
  34. 2025BannerAgency: Advertising Banner Design with Multimodal LLM Agentscited by 11
  35. 2023Boosting GUI Prototyping with Diffusion Modelscited by 10
  36. 2024COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generationcited by 10
  37. 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
  38. 2024Towards Better Text-to-Image Generation Alignment via Attention Modulationcited by 9

50 most cited of 141 All 141 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models
  2. 2025DiffPattern-Flex: Efficient Layout Pattern Generation via Discrete Diffusion
  3. 2023DiffPattern: Layout Pattern Generation via Discrete Diffusion
  4. 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
  5. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generation
  6. 2023Unifying Layout Generation with a Decoupled Diffusion Model
  7. 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusion
  8. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation