mlsanityData to 14 Oct 2026

LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models

arXiv 2303.11589 ↗First posted 21 Mar 2023cs.CVcited by 41

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Creating graphic layouts is a fundamental step in graphic designs. In this work, we present a novel generative model named LayoutDiffusion for automatic layout generation. As layout is typically represented as a sequence of discrete tokens, LayoutDiffusion models layout generation as a discrete denoising diffusion process. It learns to reverse a mild forward process, in which layouts become increasingly chaotic with the growth of forward steps and layouts in the neighboring steps do not differ too much. Designing such a mild forward process is however very challenging as layout has both categorical attributes and ordinal attributes. To tackle the challenge, we summarize three critical factors for achieving a mild forward process for the layout, i.e., legality, coordinate proximity and type disruption. Based on the factors, we propose a block-wise transition matrix coupled with a piece-wise linear noise schedule. Experiments on RICO and PubLayNet datasets show that LayoutDiffusion outperforms state-of-the-art approaches significantly. Moreover, it enables two conditional layout generation tasks in a plug-and-play manner without re-training and achieves better performance than existing methods.

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 42 of its 54 references that are in the map. First posted on arXiv 21 Mar 2023.

Builds on

42 of 54 references.

Closest ancestors · 4

Same direction, newest first

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  4. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  9. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  11. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  12. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
26 more
  1. 2018Hierarchical Neural Story Generationcited by 1,193
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  3. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  4. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  5. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  6. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
  7. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
  8. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  9. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 373
  10. 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
  11. 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 276
  12. 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 253
  13. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
  14. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
  15. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  16. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
  17. 2021Variational Transformer Networks for Layout Generationcited by 88
  18. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  19. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  20. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  21. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 68
  22. 2022Improved Vector Quantized Diffusion Modelscited by 62
  23. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  24. 2018Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speechcited by 55
  25. 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
  26. 2023Diverse Multimedia Layout Generation with Multi Choice Learningcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 18; 2025: 10; 2026: 8.

41 papers.

Sort:

By area:

  1. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 82
  2. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
  3. 2024How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Frameworkcited by 48
  4. 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithmscited by 47
  5. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  6. 2024Graphic Design with Large Multimodal Modelcited by 40
  7. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
  8. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 35
  9. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
  10. 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
  11. 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
  12. 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 19
29 more
  1. 2024Spatial-Aware Latent Initialization for Controllable Image Generationcited by 15
  2. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 13
  3. 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
  4. 2025Rethinking Layered Graphic Design Generation with a Top-Down Approachcited by 10
  5. 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 9
  6. 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Modelcited by 7
  7. 2025Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformerscited by 7
  8. 2023DDRF: Denoising Diffusion Model for Remote Sensing Image Fusioncited by 6
  9. 2025SEGA: A Stepwise Evolution Paradigm for Content-Aware Layout Generation with Design Priorcited by 6
  10. 2024Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locatorcited by 5
  11. 2024DocSynthv2: A Practical Autoregressive Modeling for Document Generationcited by 5
  12. 2024Joint Generative Modeling of Grounded Scene Graphs and Images via Diffusion Modelscited by 4
  13. 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustrationcited by 4
  14. 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layoutscited by 3
  15. 2025LayoutRAG: Retrieval-Augmented Model for Content-agnostic Conditional Layout Generationcited by 3
  16. 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospectscited by 2
  17. 2024SLayR: Scene Layout Generation with Rectified Flowcited by 2
  18. 2025From Fragment to One Piece: A Survey on AI-Driven Graphic Designcited by 2
  19. 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 2
  20. 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformercited by 1
  21. 2025Interleaved Gibbs Diffusion: Generating Discrete-Continuous Data with Implicit Constraintscited by 1
  22. 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generationcited by 1
  23. 2026MemSlides: A Hierarchical Memory Driven Agent Framework for Personalized Slide Generation with Multi-turn Local Revisioncited by 1
  24. 2026DesignSense: A Human Preference Dataset and Reward Modeling Framework for Graphic Layout Generationcited by 0
  25. 2026GAN-based Domain Adaptation for Image-aware Layout Generation in Advertising Poster Designcited by 0
  26. 2026Computer-Aided Design Generation by Cascaded Discrete Diffusion Modelcited by 0
  27. 2026Dependency-Aware Discrete Diffusion for Scene Graph Generationcited by 0
  28. 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generationcited by 0
  29. 2026COMPASS: Grounding Composition-Intent Guidance in Unified Multimodal Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Unifying Layout Generation with a Decoupled Diffusion Model
  2. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generation
  3. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generation
  4. 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
  5. 2023DiffPattern: Layout Pattern Generation via Discrete Diffusion
  6. 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusion
  7. 2025DiffPattern-Flex: Efficient Layout Pattern Generation via Discrete Diffusion
  8. 2024DogLayout: Denoising Diffusion GAN for Discrete and Continuous Layout Generation