mlsanityData to 7 Oct 2026

Relation-Aware Diffusion Model for Controllable Poster Layout Generation

arXiv 2306.09086 ↗First posted 15 Jun 2023cs.CVcited by 36

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Poster layout is a crucial aspect of poster design. Prior methods primarily focus on the correlation between visual content and graphic elements. However, a pleasant layout should also consider the relationship between visual and textual contents and the relationship between elements. In this study, we introduce a relation-aware diffusion model for poster layout generation that incorporates these two relationships in the generation process. Firstly, we devise a visual-textual relation-aware module that aligns the visual and textual representations across modalities, thereby enhancing the layout's efficacy in conveying textual information. Subsequently, we propose a geometry relation-aware module that learns the geometry relationship between elements by comprehensively considering contextual information. Additionally, the proposed method can generate diverse layouts based on user constraints. To advance research in this field, we have constructed a poster layout dataset named CGL-Dataset V2. Our proposed method outperforms state-of-the-art methods on CGL-Dataset V2. The data and code will be available at https://github.com/liuan0803/RADM.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 23 of its 35 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

23 of 35 references.

Closest ancestors · 5

Same direction, newest first

  1. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generation14 Mar
  2. 2023Unifying Layout Generation with a Decoupled Diffusion Model9 Mar
  3. 2022Inversion-Based Style Transfer with Diffusion Models23 Nov
  4. 2022DiffusionDet: Diffusion Model for Object Detection17 Nov
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2015Fast R-CNNcited by 2,930
  8. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  10. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  11. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  12. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
6 more
  1. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  2. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  3. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  4. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  5. 2022Geometry Aligned Variational Transformer for Image-conditioned Layout Generationcited by 33
  6. 2020Retrieve-Then-Adapt: Example-based Automatic Generation for Proportion-related Infographicscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 8; 2025: 19; 2026: 6.

36 papers.

Sort:

By area:

  1. 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 56
  2. 2024Graphic Design with Large Multimodal Modelcited by 38
  3. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  4. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 34
  5. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 34
  6. 2024Alfie: Democratising RGBA Image Generation With No cited by 20
  7. 2024Desigen: A Pipeline for Controllable Design Template Generationcited by 19
  8. 2025RelaCtrl: Relevance-Guided Efficient Control for Diffusion Transformerscited by 18
  9. 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 17
  10. 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generationcited by 17
  11. 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 15
  12. 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 15
24 more
  1. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 14
  2. 2025CTR-Driven Advertising Image Generation with Multimodal Large Language Modelscited by 14
  3. 2025Uni-Layout: Integrating Human Feedback in Unified Layout Generation and Evaluationcited by 13
  4. 2025PosterMate: Audience-driven Collaborative Persona Agents for Poster Designcited by 9
  5. 2026PosterVerse: A Full-Workflow Framework for Commercial-Grade Poster Generation with HTML-Based Scalable Typographycited by 8
  6. 2025AutoPP: Towards Automated Product Poster Generation and Optimizationcited by 7
  7. 2025SEGA: A Stepwise Evolution Paradigm for Content-Aware Layout Generation with Design Priorcited by 6
  8. 2025UTDesign: A Unified Framework for Stylized Text Editing and Generation in Graphic Design Imagescited by 6
  9. 2025T-Stars-Poster: A Framework for Product-Centric Advertising Image Designcited by 5
  10. 2026Any2Poster: Any-Source Poster Generation Across Modalities and Domainscited by 5
  11. 2024TextCenGen: Attention-Guided Text-Centric Background Adaptation for Text-to-Image Generationcited by 3
  12. 2025Relation-Rich Visual Document Generator for Visual Information Extractioncited by 2
  13. 2024Assessing Image Inpainting via Re-Inpainting Self-Consistency Evaluationcited by 1
  14. 2024LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformercited by 1
  15. 2025SceneVTG++: Controllable Multilingual Visual Text Generation in the Wildcited by 1
  16. 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generationcited by 1
  17. 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 1
  18. 2026Design Your Ad: Personalized Advertising Image and Text Generation with Unified Autoregressive Modelscited by 1
  19. 2025Aggregated Structural Representation with Large Language Models for Human-Centric Layout Generationcited by 0
  20. 2025Automatic Text Box Placement for Supporting Typographic Designcited by 0
  21. 2025UniLayDiff: A Unified Diffusion Transformer for Content-Aware Layout Generationcited by 0
  22. 2025Text-Conditioned Background Generation for Editable Multi-Layer Documentscited by 0
  23. 2026DesignSense: A Human Preference Dataset and Reward Modeling Framework for Graphic Layout Generationcited by 0
  24. 2026iPoster: Content-Aware Layout Generation for Interactive Poster Design via Graph-Enhanced Diffusion Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints
  2. 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer
  3. 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
  4. 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models
  5. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM
  6. 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
  7. 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models
  8. 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusion