LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators
Not on the map. Why?
Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Layout is important for graphic design and scene generation. We propose a novel Generative Adversarial Network, called LayoutGAN, that synthesizes layouts by modeling geometric relations of different types of 2D elements. The generator of LayoutGAN takes as input a set of randomly-placed 2D graphic elements and uses self-attention modules to refine their labels and geometric parameters jointly to produce a realistic layout. Accurate alignment is critical for good layouts. We thus propose a novel differentiable wireframe rendering layer that maps the generated layout to a wireframe image, upon which a CNN-based discriminator is used to optimize the layouts in image space. We validate the effectiveness of LayoutGAN in various experiments including MNIST digit generation, document layout generation, clipart abstract scene generation and tangram graphic design.
Key facts. Cited by 130 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 11; 2023: 31; 2024: 23; 2025: 25; 2026: 18.
130 papers.
Sort:
By area:
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 119
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
- 2021Variational Transformer Networks for Layout Generationcited by 88
- 2021Learning to Compose Visual Relationscited by 72
- 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
- 2021SketchGen: Generating Constrained CAD Sketchescited by 68
- 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
- 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
38 more
- 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
- 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
- 2023Unifying Layout Generation with a Decoupled Diffusion Modelcited by 41
- 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Modelscited by 40
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 39
- 2024Graphic Design with Large Multimodal Modelcited by 38
- 2021VINS: Visual Search for Mobile User Interface Designcited by 37
- 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 36
- 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
- 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 34
- 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 34
- 2022Geometry Aligned Variational Transformer for Image-conditioned Layout Generationcited by 33
- 2023Towards Flexible Multi-modal Document Modelscited by 30
- 2024UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedbackcited by 26
- 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusioncited by 24
- 2023Dolfin: Diffusion Layout Transformers without Autoencodercited by 23
- 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
- 2023Diffusion-based Document Layout Generationcited by 21
- 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
- 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformercited by 20
- 2022Aesthetic Text Logo Synthesis via Content-aware Layout Inferringcited by 19
- 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
- 2021DocSynth: A Layout Guided Approach for Controllable Document Image Synthesiscited by 17
- 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 17
- 2025Generative AI for Cel-Animation: A Surveycited by 17
- 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generationcited by 17
- 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
- 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
- 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptionscited by 15
- 2023UI Layout Generation with LLMs Guided by UI Grammarcited by 15
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 15
- 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posterscited by 14
- 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 14
- 2021House-GAN++: Generative Adversarial Layout Refinement Networkscited by 13
- 2023Unsupervised Domain Adaption with Pixel-level Discriminator for Image-aware Layout Generationcited by 13
- 2021Automated Urban Planning for Reimagining City Configuration via Adversarial Learning: Quantification, Generation, and Evaluationcited by 11
50 most cited of 130 All 130 (JSON)
- 2026Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates10 Sep 2026
- 2026Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models27 Aug 2026
- 2026Mise-en-Sc`ene: Implicit Layout Emergence in Diffusion Transformers for Human-AI Design Co-Creation19 Aug 2026
- 2026FRAGMENT: Factorized Graph Representations for Document Generation and Editing via Entity-Aware Transformations19 Aug 2026
- 2026PosterMELD: Multi-Agent Paper-to-Poster Generation for Controllable Design Diversity with Editable Print-Ready Outputs3 Aug 2026
- 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs2 Aug 2026
- 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generation15 May 2026
- 2026Evolving Thematic Map Design in Academic Cartography: A Thirty-Year Study Based on Multilingual Journals24 Apr 2026
- 2026GAN-based Domain Adaptation for Image-aware Layout Generation in Advertising Poster Design8 Apr 2026
- 2026CPT: Controllable and Editable Design Variations with Language Models6 Apr 2026
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026A3: Towards Advertising Aesthetic Assessment25 Mar 2026
38 more
- 2026Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers11 Mar 2026
- 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design14 Feb 2026
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
- 2026Bridging Gulfs in UI Generation through Semantic Guidance27 Jan 2026
- 2026AlignUI: A Method for Designing LLM-Generated UIs Aligned with User Preferences24 Jan 2026
- 2026AnchoredDream: Zero-Shot 360deg Indoor Scene Generation from a Single View via Geometric Grounding23 Jan 2026
- 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation9 Dec 2025
- 2025SciPostGen: Bridging the Gap between Scientific Papers and Poster Layouts27 Nov 2025
- 2025CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Design25 Nov 2025
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Design18 Nov 2025
- 2025A Two-Stage System for Layout-Controlled Image Generation using Large Language Models and Diffusion Models10 Nov 2025
- 2025StructLayoutFormer:Conditional Structured Layout Generation via Structure Serialization and Disentanglement30 Oct 2025
- 2025SEGA: A Stepwise Evolution Paradigm for Content-Aware Layout Generation with Design Prior17 Oct 2025
- 2025Automatic Text Box Placement for Supporting Typographic Design9 Oct 2025
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generation21 Sep 2025
- 2025Generating Synthetic Invoices via Layout-Preserving Content Replacement4 Aug 2025
- 2025SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integrity30 Jul 2025
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approach8 Jul 2025
- 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models8 Jul 2025
- 2025CAL-RAG: Retrieval-Augmented Multi-Agent Generation for Content-Aware Layout Design27 Jun 2025
- 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generation12 Jun 2025
- 2025LayoutRAG: Retrieval-Augmented Model for Content-agnostic Conditional Layout Generation3 Jun 2025
- 2025Aggregated Structural Representation with Large Language Models for Human-Centric Layout Generation26 May 2025
- 2025Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformers7 May 2025
- 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agents15 Apr 2025
- 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation15 Apr 2025
- 2025Relation-Rich Visual Document Generator for Visual Information Extraction14 Apr 2025
- 2025From Fragment to One Piece: A Survey on AI-Driven Graphic Design24 Mar 2025
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models1 Mar 2025
- 2025Spatial Information Integration in Small Language Models for Document Layout Generation and Classification9 Jan 2025
- 2025Generative AI for Cel-Animation: A Survey8 Jan 2025
- 2024SLayR: Scene Layout Generation with Rectified Flow6 Dec 2024
- 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correction5 Dec 2024
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts18 Nov 2024
- 2024From Geometric Mimicry to Comprehensive Generation: A Context-Informed Multimodal Diffusion Model for Urban Morphology Synthesis25 Sep 2024
- 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model25 Sep 2024
- 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects14 Sep 2024
- 2024SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters29 Jul 2024
50 newest of 130 All 130 (JSON)
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2023Unifying Layout Generation with a Decoupled Diffusion Modelcited by 41
- 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Modelscited by 40
- 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 36
- 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusioncited by 24
- 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
- 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformercited by 20
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 15
- 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Modelcited by 7
- 2025Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformerscited by 6
12 most cited of 20 All 20 (JSON)
- 2026Mise-en-Sc`ene: Implicit Layout Emergence in Diffusion Transformers for Human-AI Design Co-Creation19 Aug 2026
- 2026Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers11 Mar 2026
- 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation9 Dec 2025
- 2025A Two-Stage System for Layout-Controlled Image Generation using Large Language Models and Diffusion Models10 Nov 2025
- 2025Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformers7 May 2025
- 2024SLayR: Scene Layout Generation with Rectified Flow6 Dec 2024
- 2024From Geometric Mimicry to Comprehensive Generation: A Context-Informed Multimodal Diffusion Model for Urban Morphology Synthesis25 Sep 2024
- 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model25 Sep 2024
- 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer21 Jul 2024
- 2024CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion18 May 2024
- 2024LayoutFlow: Flow Matching for Layout Generation27 Mar 2024
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Models14 Dec 2023
12 newest of 20 All 20 (JSON)
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 8
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layoutscited by 3
- 2025Relation-Rich Visual Document Generator for Visual Information Extractioncited by 2
- 2025CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Designcited by 2
- 2026Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Modelscited by 0
- 2026Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models27 Aug 2026
- 2025CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Design25 Nov 2025
- 2025Relation-Rich Visual Document Generator for Visual Information Extraction14 Apr 2025
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models1 Mar 2025
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts18 Nov 2024
- 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generationcited by 6
- 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Modelscited by 2
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generationcited by 1
- 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Designcited by 1
- 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design14 Feb 2026
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generation21 Sep 2025
- 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models8 Jul 2025
- 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation15 Apr 2025
- 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agentscited by 3
- 2026PosterMELD: Multi-Agent Paper-to-Poster Generation for Controllable Design Diversity with Editable Print-Ready Outputscited by 1
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Designcited by 0
- 2026PosterMELD: Multi-Agent Paper-to-Poster Generation for Controllable Design Diversity with Editable Print-Ready Outputs3 Aug 2026
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Design18 Nov 2025
- 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agents15 Apr 2025
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2021Screen2Words: Automatic Mobile UI Summarization with Multimodal Learningcited by 119
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
- 2021Variational Transformer Networks for Layout Generationcited by 88
- 2021Learning to Compose Visual Relationscited by 72
- 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
- 2021SketchGen: Generating Constrained CAD Sketchescited by 68
- 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
- 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
- 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
12 most cited of 93 All 93 (JSON)
- 2026Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates10 Sep 2026
- 2026FRAGMENT: Factorized Graph Representations for Document Generation and Editing via Entity-Aware Transformations19 Aug 2026
- 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs2 Aug 2026
- 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generation15 May 2026
- 2026Evolving Thematic Map Design in Academic Cartography: A Thirty-Year Study Based on Multilingual Journals24 Apr 2026
- 2026GAN-based Domain Adaptation for Image-aware Layout Generation in Advertising Poster Design8 Apr 2026
- 2026CPT: Controllable and Editable Design Variations with Language Models6 Apr 2026
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026A3: Towards Advertising Aesthetic Assessment25 Mar 2026
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
- 2026Bridging Gulfs in UI Generation through Semantic Guidance27 Jan 2026
- 2026AnchoredDream: Zero-Shot 360deg Indoor Scene Generation from a Single View via Geometric Grounding23 Jan 2026
12 newest of 93 All 93 (JSON)