mlsanityData to 14 Oct 2026

CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generation

arXiv 2506.10890 ↗First posted 12 Jun 2025cs.CVcited by 19

Not on the map. Why?

Abstract (arXiv)

Graphic design plays a crucial role in both commercial and personal contexts, yet creating high-quality, editable, and aesthetically pleasing graphic compositions remains a time-consuming and skill-intensive task, especially for beginners. Current AI tools automate parts of the workflow, but struggle to accurately incorporate user-supplied assets, maintain editability, and achieve professional visual appeal. Commercial systems, like Canva Magic Design, rely on vast template libraries, which are impractical for replicate. In this paper, we introduce CreatiPoster, a framework that generates editable, multi-layer compositions from optional natural-language instructions or assets. A protocol model, an RGBA large multimodal model, first produces a JSON specification detailing every layer (text or asset) with precise layout, hierarchy, content and style, plus a concise background prompt. A conditional background model then synthesizes a coherent background conditioned on this rendered foreground layers. We construct a benchmark with automated metrics for graphic-design generation and show that CreatiPoster surpasses leading open-source approaches and proprietary commercial systems. To catalyze further research, we release a copyright-free corpus of 100,000 multi-layer designs. CreatiPoster supports diverse applications such as canvas editing, text overlay, responsive resizing, multilingual adaptation, and animated posters, advancing the democratization of AI-assisted graphic design. Project homepage: https://github.com/graphic-design-ai/creatiposter

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 39 of its 64 references that are in the map. First posted on arXiv 12 Jun 2025.

Builds on

39 of 64 references.

References · 39

  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  3. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  4. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  5. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  6. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  7. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  8. 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
  9. 2024InternLM2 Technical Reportcited by 397
  10. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  11. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
  12. 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
27 more
  1. 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 279
  2. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
  3. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  4. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  5. 2023Video Understanding with Large Language Models: A Surveycited by 206
  6. 2025Seedream 3.0 Technical Reportcited by 154
  7. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
  8. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  9. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
  10. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
  11. 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
  12. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
  13. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  14. 2019Artistic Glyph Image Synthesis via One-Stage Few-Shot Learningcited by 53
  15. 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 46
  16. 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
  17. 2024Graphic Design with Large Multimodal Modelcited by 40
  18. 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 37
  19. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
  20. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  21. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  22. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 35
  23. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
  24. 2023Towards Flexible Multi-modal Document Modelscited by 31
  25. 2022Aesthetic Text Logo Synthesis via Content-aware Layout Inferringcited by 19
  26. 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
  27. 2025BannerAgency: Advertising Banner Design with Multimodal LLM Agentscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 15.

19 papers.

Sort:

By area:

  1. 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 9
  2. 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Taskscited by 8
  3. 2026WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editingcited by 7
  4. 2025PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Designcited by 6
  5. 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 5
  6. 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 2
  7. 2025DesignLab: Designing Slides Through Iterative Detection and Correctioncited by 1
  8. 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
  9. 2026Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classificationcited by 1
  10. 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decompositioncited by 1
  11. 2026Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Designcited by 1
  12. 2025SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integritycited by 0
7 more
  1. 2025Text-Conditioned Background Generation for Editable Multi-Layer Documentscited by 0
  2. 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvementcited by 0
  3. 2026Trajectory-Guided Diffusion for Foreground-Preserving Background Generation in Multi-Layer Documentscited by 0
  4. 2026CPT: Controllable and Editable Design Variations with Language Modelscited by 0
  5. 2026Mise-en-Sc`ene: Implicit Layout Emergence in Diffusion Transformers for Human-AI Design Co-Creationcited by 0
  6. 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generationcited by 0
  7. 2026PLAYGROUND: Progressive Layout Generation with Render-Grounded Planningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Design
  2. 2025Rethinking Layered Graphic Design Generation with a Top-Down Approach
  3. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Design
  4. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Composition
  5. 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
  6. 2026LICA: Layered Image Composition Annotations for Graphic Design Research
  7. 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
  8. 2024Multimodal Markup Document Models for Graphic Design Completion