Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs
Not on the map. Why?
Abstract (arXiv)
In this paper, we study the graphic layout generation problem of producing high-quality visual-textual presentation designs for given images. We note that image compositions, which contain not only global semantics but also spatial information, would largely affect layout results. Hence, we propose a deep generative model, dubbed as composition-aware graphic layout GAN (CGL-GAN), to synthesize layouts based on the global and spatial visual contents of input images. To obtain training images from images that already contain manually designed graphic layout data, previous work suggests masking design elements (e.g., texts and embellishments) as model inputs, which inevitably leaves hint of the ground truth. We study the misalignment between the training inputs (with hint masks) and test inputs (without masks), and design a novel domain alignment module (DAM) to narrow this gap. For training, we built a large-scale layout dataset which consists of 60,548 advertising posters with annotated layout information. To evaluate the generated layouts, we propose three novel metrics according to aesthetic intuitions. Through both quantitative and qualitative evaluations, we demonstrate that the proposed model can synthesize high-quality graphic layouts according to image compositions.
Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 30 Apr 2022.
Builds on
17 of 31 references.
References · 17
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 320
- 2017Geometric GANcited by 233
- 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
- 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
5 more
- 2021Variational Transformer Networks for Layout Generationcited by 88
- 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
- 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
- 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 68
- 2019Progressive Feature Polishing Network for Salient Object Detectioncited by 34
Built on by
Citing papers per year: 2022: 1; 2023: 11; 2024: 16; 2025: 20; 2026: 11.
59 papers.
Sort:
By area:
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
- 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
- 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Modelscited by 41
- 2023AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generationcited by 41
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
- 2024Graphic Design with Large Multimodal Modelcited by 40
- 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 37
- 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 35
- 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
- 2024A New Creative Generation Pipeline for Click-Through Rate with Stable Diffusion Modelcited by 27
- 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusioncited by 24
- 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
38 more
- 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generationcited by 19
- 2023TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Designcited by 18
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 16
- 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 16
- 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
- 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 15
- 2025Uni-Layout: Integrating Human Feedback in Unified Layout Generation and Evaluationcited by 14
- 2023Unsupervised Domain Adaption with Pixel-level Discriminator for Image-aware Layout Generationcited by 13
- 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 13
- 2023Towards Diverse and Consistent Typography Generationcited by 11
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approachcited by 10
- 2026PosterVerse: A Full-Workflow Framework for Commercial-Grade Poster Generation with HTML-Based Scalable Typographycited by 10
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 9
- 2025ProCrop: Learning Aesthetic Image Cropping from Professional Compositionscited by 8
- 2025IGD: Instructional Graphic Design with Multimodal Layer Generationcited by 8
- 2025AutoPP: Towards Automated Product Poster Generation and Optimizationcited by 8
- 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Modelcited by 7
- 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generationcited by 7
- 2025CAL-RAG: Retrieval-Augmented Multi-Agent Generation for Content-Aware Layout Designcited by 7
- 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Priorcited by 6
- 2025SEGA: A Stepwise Evolution Paradigm for Content-Aware Layout Generation with Design Priorcited by 6
- 2024Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locatorcited by 5
- 2025T-Stars-Poster: A Framework for Product-Centric Advertising Image Designcited by 5
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 5
- 2024WebRPG: Automatic Web Rendering Parameters Generation for Visual Presentationcited by 4
- 2026Seeing is Improving: Visual Feedback for Iterative Text Layout Refinementcited by 4
- 2024TextCenGen: Attention-Guided Text-Centric Background Adaptation for Text-to-Image Generationcited by 3
- 2024CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusioncited by 3
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layoutscited by 3
- 2025Scan-and-Print: Patch-level Data Summarization and Augmentation for Content-aware Layout Generation in Poster Designcited by 2
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learningcited by 2
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 2
- 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformercited by 1
- 2025SceneVTG++: Controllable Multilingual Visual Text Generation in the Wildcited by 1
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generationcited by 1
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
- 2024Neural Contrast: Leveraging Generative Editing for Graphic Design Recommendationscited by 0
- 2025Generating Animated Layouts as Structured Text Representationscited by 0
50 most cited of 59 All 59 (JSON)
- 2026Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates10 Sep 2026
- 2026Evaluating Design Video Generation: Metrics for Compositional Fidelity15 May 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026ReContraster: Making Your Posters Stand Out with Regional Contrast12 Apr 2026
- 2026GAN-based Domain Adaptation for Image-aware Layout Generation in Advertising Poster Design8 Apr 2026
- 2026iPoster: Content-Aware Layout Generation for Interactive Poster Design via Graph-Enhanced Diffusion Models31 Mar 2026
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026Seeing is Improving: Visual Feedback for Iterative Text Layout Refinement23 Mar 2026
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
- 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvement16 Jan 2026
- 2026PosterVerse: A Full-Workflow Framework for Commercial-Grade Poster Generation with HTML-Based Scalable Typography7 Jan 2026
- 2025AutoPP: Towards Automated Product Poster Generation and Optimization26 Dec 2025
38 more
- 2025Content-Aware Ad Banner Layout Generation with Two-Stage Chain-of-Thought in Vision Language Models14 Dec 2025
- 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation9 Dec 2025
- 2025Sketch-to-Layout: Sketch-Guided Multimodal Layout Generation31 Oct 2025
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning30 Oct 2025
- 2025SEGA: A Stepwise Evolution Paradigm for Content-Aware Layout Generation with Design Prior17 Oct 2025
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generation21 Sep 2025
- 2025Uni-Layout: Integrating Human Feedback in Unified Layout Generation and Evaluation4 Aug 2025
- 2025IGD: Instructional Graphic Design with Multimodal Layer Generation14 Jul 2025
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approach8 Jul 2025
- 2025CAL-RAG: Retrieval-Augmented Multi-Agent Generation for Content-Aware Layout Design27 Jun 2025
- 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generation12 Jun 2025
- 2025ProCrop: Learning Aesthetic Image Cropping from Professional Compositions28 May 2025
- 2025Scan-and-Print: Patch-level Data Summarization and Augmentation for Content-aware Layout Generation in Poster Design27 May 2025
- 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generation6 May 2025
- 2025Generating Animated Layouts as Structured Text Representations2 May 2025
- 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation15 Apr 2025
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models1 Mar 2025
- 2025T-Stars-Poster: A Framework for Product-Centric Advertising Image Design24 Jan 2025
- 2025SceneVTG++: Controllable Multilingual Visual Text Generation in the Wild6 Jan 2025
- 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Composition27 Dec 2024
- 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correction5 Dec 2024
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts18 Nov 2024
- 2024Neural Contrast: Leveraging Generative Editing for Graphic Design Recommendations26 Sep 2024
- 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model25 Sep 2024
- 2024WebRPG: Automatic Web Rendering Parameters Generation for Visual Presentation22 Jul 2024
- 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer21 Jul 2024
- 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Prior10 Jul 2024
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM5 Jun 2024
- 2024CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion18 May 2024
- 2024Graphic Design with Large Multimodal Model22 Apr 2024
- 2024TextCenGen: Attention-Guided Text-Centric Background Adaptation for Text-to-Image Generation18 Apr 2024
- 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation1 Apr 2024
- 2024Desigen: A Pipeline for Controllable Design Template Generation14 Mar 2024
- 2024Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator29 Jan 2024
- 2024A New Creative Generation Pipeline for Click-Through Rate with Stable Diffusion Model17 Jan 2024
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Models14 Dec 2023
- 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation22 Nov 2023
- 2023LayoutPrompter: Awaken the Design Ability of Large Language Models11 Nov 2023
50 newest of 59 All 59 (JSON)
- 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Modelscited by 41
- 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 37
- 2024A New Creative Generation Pipeline for Click-Through Rate with Stable Diffusion Modelcited by 27
- 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusioncited by 24
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 16
- 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Modelcited by 7
- 2024CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusioncited by 3
- 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformercited by 1
- 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generationcited by 0
- 2026iPoster: Content-Aware Layout Generation for Interactive Poster Design via Graph-Enhanced Diffusion Modelscited by 0
- 2026iPoster: Content-Aware Layout Generation for Interactive Poster Design via Graph-Enhanced Diffusion Models31 Mar 2026
- 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generation9 Dec 2025
- 2024Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model25 Sep 2024
- 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer21 Jul 2024
- 2024CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion18 May 2024
- 2024A New Creative Generation Pipeline for Click-Through Rate with Stable Diffusion Model17 Jan 2024
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Models14 Dec 2023
- 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generation15 Jun 2023
- 2023LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models21 Mar 2023
- 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusion27 Jan 2023
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 9
- 2026Seeing is Improving: Visual Feedback for Iterative Text Layout Refinementcited by 4
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layoutscited by 3
- 2025Content-Aware Ad Banner Layout Generation with Two-Stage Chain-of-Thought in Vision Language Modelscited by 0
- 2026Seeing is Improving: Visual Feedback for Iterative Text Layout Refinement23 Mar 2026
- 2025Content-Aware Ad Banner Layout Generation with Two-Stage Chain-of-Thought in Vision Language Models14 Dec 2025
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models1 Mar 2025
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts18 Nov 2024
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
- 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
- 2023AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generationcited by 41
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
- 2024Graphic Design with Large Multimodal Modelcited by 40
- 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
- 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
- 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generationcited by 19
- 2023TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Designcited by 18
- 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 16
- 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
- 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 15
12 most cited of 40 All 40 (JSON)
- 2026Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates10 Sep 2026
- 2026Evaluating Design Video Generation: Metrics for Compositional Fidelity15 May 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026ReContraster: Making Your Posters Stand Out with Regional Contrast12 Apr 2026
- 2026GAN-based Domain Adaptation for Image-aware Layout Generation in Advertising Poster Design8 Apr 2026
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
- 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvement16 Jan 2026
- 2026PosterVerse: A Full-Workflow Framework for Commercial-Grade Poster Generation with HTML-Based Scalable Typography7 Jan 2026
- 2025AutoPP: Towards Automated Product Poster Generation and Optimization26 Dec 2025
- 2025Sketch-to-Layout: Sketch-Guided Multimodal Layout Generation31 Oct 2025
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning30 Oct 2025
12 newest of 40 All 40 (JSON)