PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Design
Not on the map. Why?
Abstract (arXiv)
Graphic design forms the cornerstone of modern visual communication, serving as a vital medium for promoting cultural and commercial events. Recent advances have explored automating this process using Large Multimodal Models (LMMs), yet existing methods often produce geometrically inaccurate layouts and lack the iterative, layer-specific editing required in professional workflows. To address these limitations, we present PosterCopilot, a framework that advances layout reasoning and controllable editing for professional graphic design. Specifically, we introduce a progressive three-stage training strategy that equips LMMs with geometric understanding and aesthetic reasoning for layout design, consisting of Perturbed Supervised Fine-Tuning, Reinforcement Learning for Visual-Reality Alignment, and Reinforcement Learning from Aesthetic Feedback. Furthermore, we develop a complete workflow that couples the trained LMM-based design model with generative models, enabling layer-controllable, iterative editing for precise element refinement while maintaining global visual consistency. Extensive experiments demonstrate that PosterCopilot achieves geometrically accurate and aesthetically superior layouts, offering unprecedented controllability for professional iterative design.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 49 of its 68 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
49 of 68 references.
References · 49
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2015Fast R-CNNcited by 2,930
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
37 more
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
- 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
- 2024VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agentscited by 101
- 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
- 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
- 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
- 2025Detect Anything via Next Point Predictioncited by 66
- 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 47
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 39
- 2024Graphic Design with Large Multimodal Modelcited by 38
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
- 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
- 2025Bridging Continuous and Discrete Tokens for Autoregressive Visual Generationcited by 29
- 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
- 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generationcited by 17
- 2025Perception Before Reasoning: Two-Stage Reinforcement Learning for Visual Reasoning in Vision-Language Modelscited by 16
- 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
- 2024SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generationcited by 15
- 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 11
- 2023High-Fidelity Diffusion-based Image Editingcited by 10
- 2025Enhancing Spatial Reasoning in Vision-Language Models via Chain-of-Thought Prompting and Reinforcement Learningcited by 9
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 8
- 2025Beyond Automation: How UI/UX Designers Perceive AI as a Creative Partner in the Divergent Thinking Stagescited by 6
- 2024Spatial Diffusion for Cell Layout Generationcited by 5
- 2025Language Models Do Not Embed Numbers Continuouslycited by 4
- 2025One Shot vs. Iterative: Rethinking Pruning Strategies for Model Compressioncited by 3
- 2025Preserving Product Fidelity in Large Scale Image Recontextualization with Diffusion Modelscited by 2
- 2024Interaction Design with Generative AI: An Empirical Study of Emerging Strategies Across the Four Phases of Designcited by 1
- 2025Aligning Large Vision-Language Models by Deep Reinforcement Learning and Direct Preference Optimizationcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generationcited by 3
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?cited by 1
- 2026ETPDesigner: Multi-Agent Orchestration for Interactive Multimodal Electronic Theater Programcited by 1
- 2026Vibe AIGC: A New Paradigm for Content Generation via Agentic Orchestrationcited by 0
- 2026ETPDesigner: Multi-Agent Orchestration for Interactive Multimodal Electronic Theater Program22 Jul 2026
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?14 May 2026
- 2026DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation6 Feb 2026
- 2026Vibe AIGC: A New Paradigm for Content Generation via Agentic Orchestration4 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design
- 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Framework
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
- 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
- 2026iPoster: Content-Aware Layout Generation for Interactive Poster Design via Graph-Enhanced Diffusion Models
- 2026Seeing is Improving: Visual Feedback for Iterative Text Layout Refinement
- 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generation