CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generation
Not on the map. Why?
Abstract (arXiv)
Graphic design plays a crucial role in both commercial and personal contexts, yet creating high-quality, editable, and aesthetically pleasing graphic compositions remains a time-consuming and skill-intensive task, especially for beginners. Current AI tools automate parts of the workflow, but struggle to accurately incorporate user-supplied assets, maintain editability, and achieve professional visual appeal. Commercial systems, like Canva Magic Design, rely on vast template libraries, which are impractical for replicate. In this paper, we introduce CreatiPoster, a framework that generates editable, multi-layer compositions from optional natural-language instructions or assets. A protocol model, an RGBA large multimodal model, first produces a JSON specification detailing every layer (text or asset) with precise layout, hierarchy, content and style, plus a concise background prompt. A conditional background model then synthesizes a coherent background conditioned on this rendered foreground layers. We construct a benchmark with automated metrics for graphic-design generation and show that CreatiPoster surpasses leading open-source approaches and proprietary commercial systems. To catalyze further research, we release a copyright-free corpus of 100,000 multi-layer designs. CreatiPoster supports diverse applications such as canvas editing, text overlay, responsive resizing, multilingual adaptation, and animated posters, advancing the democratization of AI-assisted graphic design. Project homepage: https://github.com/graphic-design-ai/creatiposter
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 39 of its 64 references that are in the map. First posted on arXiv 12 Jun 2025.
Builds on
39 of 64 references.
References · 39
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2024InternLM2 Technical Reportcited by 397
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
27 more
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 279
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2025Seedream 3.0 Technical Reportcited by 154
- 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
- 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
- 2019Artistic Glyph Image Synthesis via One-Stage Few-Shot Learningcited by 53
- 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 46
- 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
- 2024Graphic Design with Large Multimodal Modelcited by 40
- 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 37
- 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
- 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 35
- 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
- 2023Towards Flexible Multi-modal Document Modelscited by 31
- 2022Aesthetic Text Logo Synthesis via Content-aware Layout Inferringcited by 19
- 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
- 2025BannerAgency: Advertising Banner Design with Multimodal LLM Agentscited by 11
Built on by
Citing papers per year: 2025: 4; 2026: 15.
19 papers.
Sort:
By area:
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 9
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Taskscited by 8
- 2026WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editingcited by 7
- 2025PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Designcited by 6
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 5
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 2
- 2025DesignLab: Designing Slides Through Iterative Detection and Correctioncited by 1
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
- 2026Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classificationcited by 1
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decompositioncited by 1
- 2026Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Designcited by 1
- 2025SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integritycited by 0
7 more
- 2025Text-Conditioned Background Generation for Editable Multi-Layer Documentscited by 0
- 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvementcited by 0
- 2026Trajectory-Guided Diffusion for Foreground-Preserving Background Generation in Multi-Layer Documentscited by 0
- 2026CPT: Controllable and Editable Design Variations with Language Modelscited by 0
- 2026Mise-en-Sc`ene: Implicit Layout Emergence in Diffusion Transformers for Human-AI Design Co-Creationcited by 0
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generationcited by 0
- 2026PLAYGROUND: Progressive Layout Generation with Render-Grounded Planningcited by 0
- 2026PLAYGROUND: Progressive Layout Generation with Render-Grounded Planning13 Oct 2026
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generation8 Oct 2026
- 2026Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design18 Sep 2026
- 2026Mise-en-Sc`ene: Implicit Layout Emergence in Diffusion Transformers for Human-AI Design Co-Creation19 Aug 2026
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition28 Jul 2026
- 2026Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classification11 Jul 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layers21 Apr 2026
- 2026CPT: Controllable and Editable Design Variations with Language Models6 Apr 2026
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks5 Apr 2026
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editing12 Mar 2026
7 more
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
- 2026Trajectory-Guided Diffusion for Foreground-Preserving Background Generation in Multi-Layer Documents29 Jan 2026
- 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvement16 Jan 2026
- 2025Text-Conditioned Background Generation for Editable Multi-Layer Documents19 Dec 2025
- 2025PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Design3 Dec 2025
- 2025SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integrity30 Jul 2025
- 2025DesignLab: Designing Slides Through Iterative Detection and Correction23 Jul 2025
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 9
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Taskscited by 8
- 2026WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editingcited by 7
- 2025PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Designcited by 6
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 5
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 2
- 2025DesignLab: Designing Slides Through Iterative Detection and Correctioncited by 1
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
- 2026Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classificationcited by 1
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decompositioncited by 1
- 2025SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integritycited by 0
- 2025Text-Conditioned Background Generation for Editable Multi-Layer Documentscited by 0
12 most cited of 16 All 16 (JSON)
- 2026PLAYGROUND: Progressive Layout Generation with Render-Grounded Planning13 Oct 2026
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generation8 Oct 2026
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition28 Jul 2026
- 2026Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classification11 Jul 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layers21 Apr 2026
- 2026CPT: Controllable and Editable Design Variations with Language Models6 Apr 2026
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks5 Apr 2026
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editing12 Mar 2026
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
- 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvement16 Jan 2026
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Design
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approach
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Design
- 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Composition
- 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
- 2026LICA: Layered Image Composition Annotations for Graphic Design Research
- 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
- 2024Multimodal Markup Document Models for Graphic Design Completion