mlsanityData to 7 Oct 2026

Editable Visual Design

arXiv 2609.04034 ↗First posted 3 Sep 2026cs.CV cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

While diffusion base models such as GPT-Image-2 and Nano-Banana exhibit remarkable visual expressiveness, their end-to-end generation inherently yields flattened bitmaps with error-prone text, precluding layer-wise post-editing. Conversely, code-based visual generation via Coding Agents provides precise layout control and decoupled layers, yet remains constrained by a lack of global aesthetic intuition and the difficulty of coding complex visual assets. To address this, we propose Editable Visual Design, a new paradigm driven by a Coding Agent. We designate the VLM as the ``creative brain'' for requirement comprehension, task planning, and aesthetic judgment, while utilizing the image generation model as an on-demand ``visual world simulator'' to synthesize standalone visual assets. Operating under an ``imagine first, then act'' closed-loop workflow, the agent generates isolated assets, writes native HTML/CSS, and iteratively refines the design against visual rendering feedback. Furthermore, Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers. Ultimately, the system delivers editable artifacts with decoupled layers and real text, enabling users to perform intuitive mouse dragging and layout adjustments on a graphical user interface. Validations on posters, infographics, and other scenarios show that this paradigm successfully achieves both refined aesthetics and production-grade editability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 64 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

58 of 64 references.

References · 58

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2025Qwen-Image Technical Reportcited by 973
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  4. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  5. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  6. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  7. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  8. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  9. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
  10. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
  11. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
  12. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 126
38 more
  1. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 118
  2. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
  3. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 96
  4. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
  5. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
  6. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 83
  7. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 78
  8. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
  9. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
  10. 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 66
  11. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  12. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
  13. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 57
  14. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 55
  15. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 52
  16. 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
  17. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 50
  18. 2026World Action Models: The Next Frontier in Embodied AIcited by 46
  19. 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 41
  20. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
  21. 2023Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generationcited by 38
  22. 2024Graphic Design with Large Multimodal Modelcited by 38
  23. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 37
  24. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
  25. 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
  26. 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 27
  27. 2025UICopilot: Automating UI Synthesis via Hierarchical Code Generation from Webpage Designscited by 22
  28. 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detectioncited by 19
  29. 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generationcited by 18
  30. 2025MLLM-Based UI2Code Automation Guided by UI Layout Informationcited by 17
  31. 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 16
  32. 2025Unified Multimodal Models as Auto-Encoderscited by 13
  33. 2025DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generationcited by 13
  34. 2025InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Modelscited by 12
  35. 2025UI2Code^N: UI-to-Code Generation as Interactive Visual Optimizationcited by 12
  36. 2025OmniAID: Decoupling Semantics and Artifacts for Universal AI-Generated Image Detection in the Wildcited by 12
  37. 2025RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewardscited by 11
  38. 2026GENIUS: Generative Fluid Intelligence Evaluation Suitecited by 11

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues
  2. 2025Rethinking Layered Graphic Design Generation with a Top-Down Approach
  3. 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides
  4. 2024ChatDiT: A Training-Free Baseline for Task-Agnostic Free-Form Chatting with Diffusion Transformers
  5. 2024BlenderAlchemy: Editing 3D Graphics with Vision-Language Models
  6. 2024Sketch2Code: Evaluating Vision-Language Models for Interactive Web Design Prototyping
  7. 2026Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  8. 2026PosterMELD: Multi-Agent Paper-to-Poster Generation for Controllable Design Diversity with Editable Print-Ready Outputs