mlsanityData to 7 Oct 2026

PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Design

arXiv 2512.04082 ↗First posted 3 Dec 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Graphic design forms the cornerstone of modern visual communication, serving as a vital medium for promoting cultural and commercial events. Recent advances have explored automating this process using Large Multimodal Models (LMMs), yet existing methods often produce geometrically inaccurate layouts and lack the iterative, layer-specific editing required in professional workflows. To address these limitations, we present PosterCopilot, a framework that advances layout reasoning and controllable editing for professional graphic design. Specifically, we introduce a progressive three-stage training strategy that equips LMMs with geometric understanding and aesthetic reasoning for layout design, consisting of Perturbed Supervised Fine-Tuning, Reinforcement Learning for Visual-Reality Alignment, and Reinforcement Learning from Aesthetic Feedback. Furthermore, we develop a complete workflow that couples the trained LMM-based design model with generative models, enabling layer-controllable, iterative editing for precise element refinement while maintaining global visual consistency. Extensive experiments demonstrate that PosterCopilot achieves geometrically accurate and aesthetically superior layouts, offering unprecedented controllability for professional iterative design.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 49 of its 68 references that are in the map. First posted on arXiv 3 Dec 2025.

Builds on

49 of 68 references.

References · 49

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2015Fast R-CNNcited by 2,930
  8. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  9. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  10. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  11. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  12. 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
37 more
  1. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  2. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
  3. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  4. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  5. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  6. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  7. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
  8. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
  9. 2024VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agentscited by 101
  10. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  11. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
  12. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  13. 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
  14. 2025Detect Anything via Next Point Predictioncited by 66
  15. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 47
  16. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
  17. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 39
  18. 2024Graphic Design with Large Multimodal Modelcited by 38
  19. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  20. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
  21. 2025Bridging Continuous and Discrete Tokens for Autoregressive Visual Generationcited by 29
  22. 2024LayerDiff: Exploring Text-guided Multi-layered Composable Image Synthesis via Layer-Collaborative Diffusion Modelcited by 26
  23. 2025CreatiPoster: Towards Editable and Controllable Multi-Layer Graphic Design Generationcited by 17
  24. 2025Perception Before Reasoning: Two-Stage Reinforcement Learning for Visual Reasoning in Vision-Language Modelscited by 16
  25. 2022LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designercited by 15
  26. 2024SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generationcited by 15
  27. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 11
  28. 2023High-Fidelity Diffusion-based Image Editingcited by 10
  29. 2025Enhancing Spatial Reasoning in Vision-Language Models via Chain-of-Thought Prompting and Reinforcement Learningcited by 9
  30. 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Modelscited by 8
  31. 2025Beyond Automation: How UI/UX Designers Perceive AI as a Creative Partner in the Divergent Thinking Stagescited by 6
  32. 2024Spatial Diffusion for Cell Layout Generationcited by 5
  33. 2025Language Models Do Not Embed Numbers Continuouslycited by 4
  34. 2025One Shot vs. Iterative: Rethinking Pruning Strategies for Model Compressioncited by 3
  35. 2025Preserving Product Fidelity in Large Scale Image Recontextualization with Diffusion Modelscited by 2
  36. 2024Interaction Design with Generative AI: An Empirical Study of Emerging Strategies Across the Four Phases of Designcited by 1
  37. 2025Aligning Large Vision-Language Models by Deep Reinforcement Learning and Direct Preference Optimizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design
  2. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Framework
  3. 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
  4. 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
  5. 2026iPoster: Content-Aware Layout Generation for Interactive Poster Design via Graph-Enhanced Diffusion Models
  6. 2026Seeing is Improving: Visual Feedback for Iterative Text Layout Refinement
  7. 2026PosterIQ: A Design Perspective Benchmark for Poster Understanding and Generation
  8. 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generation