Editable Visual Design
Not on the map. Why?
Abstract (arXiv)
While diffusion base models such as GPT-Image-2 and Nano-Banana exhibit remarkable visual expressiveness, their end-to-end generation inherently yields flattened bitmaps with error-prone text, precluding layer-wise post-editing. Conversely, code-based visual generation via Coding Agents provides precise layout control and decoupled layers, yet remains constrained by a lack of global aesthetic intuition and the difficulty of coding complex visual assets. To address this, we propose Editable Visual Design, a new paradigm driven by a Coding Agent. We designate the VLM as the ``creative brain'' for requirement comprehension, task planning, and aesthetic judgment, while utilizing the image generation model as an on-demand ``visual world simulator'' to synthesize standalone visual assets. Operating under an ``imagine first, then act'' closed-loop workflow, the agent generates isolated assets, writes native HTML/CSS, and iteratively refines the design against visual rendering feedback. Furthermore, Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers. Ultimately, the system delivers editable artifacts with decoupled layers and real text, enabling users to perform intuitive mouse dragging and layout adjustments on a graphical user interface. Validations on posters, infographics, and other scenarios show that this paradigm successfully achieves both refined aesthetics and production-grade editability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 64 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
58 of 64 references.
References · 58
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2025Qwen-Image Technical Reportcited by 973
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 126
38 more
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 118
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 96
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
- 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 83
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 78
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 66
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 57
- 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 52
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 50
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 41
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
- 2023Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generationcited by 38
- 2024Graphic Design with Large Multimodal Modelcited by 38
- 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 37
- 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
- 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 27
- 2025UICopilot: Automating UI Synthesis via Hierarchical Code Generation from Webpage Designscited by 22
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detectioncited by 19
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generationcited by 18
- 2025MLLM-Based UI2Code Automation Guided by UI Layout Informationcited by 17
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 16
- 2025Unified Multimodal Models as Auto-Encoderscited by 13
- 2025DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generationcited by 13
- 2025InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Modelscited by 12
- 2025UI2Code^N: UI-to-Code Generation as Interactive Visual Optimizationcited by 12
- 2025OmniAID: Decoupling Semantics and Artifacts for Universal AI-Generated Image Detection in the Wildcited by 12
- 2025RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewardscited by 11
- 2026GENIUS: Generative Fluid Intelligence Evaluation Suitecited by 11
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approach
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides
- 2024ChatDiT: A Training-Free Baseline for Task-Agnostic Free-Form Chatting with Diffusion Transformers
- 2024BlenderAlchemy: Editing 3D Graphics with Vision-Language Models
- 2024Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping
- 2026Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
- 2026PosterMELD: Multi-Agent Paper-to-Poster Generation for Controllable Design Diversity with Editable Print-Ready Outputs