mlsanityData to 7 Oct 2026

PLay: Parametrically Conditioned Layout Generation using Latent Diffusion

arXiv 2301.11529 ↗First posted 27 Jan 2023cs.LG cs.AI cs.HCcited by 24

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Layout design is an important task in various design fields, including user interface, document, and graphic design. As this task requires tedious manual effort by designers, prior works have attempted to automate this process using generative models, but commonly fell short of providing intuitive user controls and achieving design objectives. In this paper, we build a conditional latent diffusion model, PLay, that generates parametrically conditioned layouts in vector graphic space from user-specified guidelines, which are commonly used by designers for representing their design intents in current practices. Our method outperforms prior works across three datasets on metrics including FID and FD-VG, and in user study. Moreover, it brings a novel and interactive experience to professional layout design processes.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 43 of its 59 references that are in the map. First posted on arXiv 27 Jan 2023.

Builds on

43 of 59 references.

Closest ancestors · 4

Same direction, newest first

  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
  4. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2020End-to-End Object Detection with Transformerscited by 7,384
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  10. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
27 more
  1. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  2. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  3. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  4. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  5. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  6. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 158
  7. 2021Symbolic Music Generation with Diffusion Modelscited by 152
  8. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
  9. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
  10. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 121
  11. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  12. 2022Self-conditioned Embedding Diffusion for Text Generationcited by 114
  13. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
  14. 2021Variational Transformer Networks for Layout Generationcited by 88
  15. 2020House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generationcited by 86
  16. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  17. 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
  18. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  19. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 67
  20. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  21. 2019READ: Recursive Autoencoders for Document Layout Generationcited by 51
  22. 2021Inferring CAD Modeling Sequences Using Zone Graphscited by 50
  23. 2022Geometry Aligned Variational Transformer for Image-conditioned Layout Generationcited by 33
  24. 2022Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scalecited by 30
  25. 2021Building-GAN: Graph-Conditioned Architectural Volumetric Design Generationcited by 20
  26. 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
  27. 2023Diverse Multimedia Layout Generation with Multi Choice Learningcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 10; 2025: 7; 2026: 2.

24 papers.

Sort:

By area:

  1. 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 84
  2. 2024Graphic Design with Large Multimodal Modelcited by 38
  3. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  4. 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
  5. 2024UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedbackcited by 26
  6. 2023Dolfin: Diffusion Layout Transformers without Autoencodercited by 23
  7. 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
  8. 2024UICrit: Enhancing Automated Design Evaluation with a UICritique Datasetcited by 21
  9. 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 17
  10. 2023UI Layout Generation with LLMs Guided by UI Grammarcited by 15
  11. 2023Boosting GUI Prototyping with Diffusion Modelscited by 10
  12. 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
12 more
  1. 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 8
  2. 2024What's Next? Exploring Utilization, Challenges, and Future Directions of AI-Generated Image Tools in Graphic Designcited by 5
  3. 2025SketchDNN: Joint Continuous-Discrete Diffusion for CAD Sketch Generationcited by 5
  4. 2024Revision Matters: Generative Design Guided by Revision Editscited by 4
  5. 2024WebRPG: Automatic Web Rendering Parameters Generation for Visual Presentationcited by 4
  6. 2025CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Designcited by 2
  7. 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformercited by 1
  8. 2025ControlGUI: Guiding Generative GUI Exploration through Perceptual Visual Flowcited by 0
  9. 2025Sketch-to-Layout: Sketch-Guided Multimodal Layout Generationcited by 0
  10. 2025Step-by-step Layered Design Generationcited by 0
  11. 2026DesignSense: A Human Preference Dataset and Reward Modeling Framework for Graphic Layout Generationcited by 0
  12. 2026Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templatescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion
  2. 2023Unifying Layout Generation with a Decoupled Diffusion Model
  3. 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models
  4. 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
  5. 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model
  6. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generation
  7. 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation
  8. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generation