mlsanityData to 13 Oct 2026

Constrained Graphic Layout Generation via Latent Optimization

arXiv 2108.00871 ↗First posted 2 Aug 2021cs.CV cs.MMcited by 83

Not on the map. Why?

Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

It is common in graphic design humans visually arrange various elements according to their design intent and semantics. For example, a title text almost always appears on top of other elements in a document. In this work, we generate graphic layouts that can flexibly incorporate such design semantics, either specified implicitly or explicitly by a user. We optimize using the latent space of an off-the-shelf layout generation model, allowing our approach to be complementary to and used with existing layout generation models. Our approach builds on a generative layout model based on a Transformer architecture, and formulates the layout generation as a constrained optimization problem where design constraints are used for element alignment, overlap avoidance, or any other user-specified relationship. We show in the experiments that our approach is capable of generating realistic layouts in both constrained and unconstrained generation tasks with a single model. The code is available at https://github.com/ktrk115/const_layout .

Key facts. Cited by 83 papers in the map (data through 13 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 2 Aug 2021.

Builds on

25 of 42 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,106
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,975
  6. 2017Non-local Neural Networkscited by 2,291
  7. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  8. 2016The CMA Evolution Strategy: A Tutorialcited by 368
  9. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  10. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  11. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  12. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
13 more
  1. 2020Semantic Photo Manipulation with a Generative Image Priorcited by 178
  2. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 158
  3. 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
  4. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  5. 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 105
  6. 2021Variational Transformer Networks for Layout Generationcited by 88
  7. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  8. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 67
  9. 2018Deep Generative Modeling for Scene Synthesis via Hybrid Representationscited by 63
  10. 2019READ: Recursive Autoencoders for Document Layout Generationcited by 51
  11. 2017Learning Visual Importance for Graphic Designs and Data Visualizationscited by 22
  12. 2020Interactive Evolution and Exploration Within Latent Level-Design Space of Generative Adversarial Networkscited by 22
  13. 2017Automatic Generation of Constrained Furniture Layoutscited by 8

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 20; 2024: 31; 2025: 18; 2026: 8.

83 papers.

Sort:

By area:

  1. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 142
  2. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  3. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 81
  4. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  5. 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 60
  6. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  7. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generationcited by 57
  8. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
  9. 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
  10. 2023Unifying Layout Generation with a Decoupled Diffusion Modelcited by 41
  11. 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Modelscited by 41
  12. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 39
38 more
  1. 2024Graphic Design with Large Multimodal Modelcited by 38
  2. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
  3. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 34
  4. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 34
  5. 2023Towards Flexible Multi-modal Document Modelscited by 30
  6. 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraintscited by 26
  7. 2023Dolfin: Diffusion Layout Transformers without Autoencodercited by 23
  8. 2023Diffusion-based Document Layout Generationcited by 21
  9. 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
  10. 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformercited by 20
  11. 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 19
  12. 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
  13. 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
  14. 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
  15. 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptionscited by 15
  16. 2023UI Layout Generation with LLMs Guided by UI Grammarcited by 15
  17. 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 15
  18. 2024Multimodal Markup Document Models for Graphic Design Completioncited by 15
  19. 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 15
  20. 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posterscited by 14
  21. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 14
  22. 2025Uni-Layout: Integrating Human Feedback in Unified Layout Generation and Evaluationcited by 14
  23. 2023Unsupervised Domain Adaption with Pixel-level Discriminator for Image-aware Layout Generationcited by 13
  24. 2023Towards Diverse and Consistent Typography Generationcited by 11
  25. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 11
  26. 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
  27. 2024TextLap: Customizing Language Models for Text-to-Layout Planningcited by 8
  28. 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 8
  29. 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Modelcited by 7
  30. 2024Constrained Layout Generation with Factor Graphscited by 6
  31. 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Priorcited by 6
  32. 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generationcited by 6
  33. 2023Text2Poster: Laying out Stylized Texts on Retrieved Imagescited by 5
  34. 2024Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locatorcited by 5
  35. 2024Spatial Diffusion for Cell Layout Generationcited by 5
  36. 2025Smaller But Better: Unifying Layout Generation with Smaller Large Language Modelscited by 5
  37. 2024Joint Generative Modeling of Grounded Scene Graphs and Images via Diffusion Modelscited by 4
  38. 2024Revision Matters: Generative Design Guided by Revision Editscited by 4

50 most cited of 83 All 83 (JSON)