DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editable
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Recent image-generation models and multimodal agents can produce high-quality visuals for increasingly complex visual communication tasks. Yet their raster outputs remain difficult to use directly because meaningful content and relationships are flattened into pixels, preventing users from inspecting, modifying, rearranging, or reusing individual components. We formulate image-to-editable reconstruction, which recovers a structured, directly manipulable artifact from a raster image while preserving its visual and semantic content. The central challenge is to jointly satisfy Fidelity and Editability, which often trade off in practice. To study this task, we introduce DrawAI, comprising an agentic benchmark, DrawAI-Bench, and a reconstruction workflow, DrawAI-Flow. DrawAI-Bench spans scientific figures, presentation slides, posters, and diagrams, combining real and AI-generated images to reflect practical visual-creation scenarios. It evaluates Fidelity and Editability through a hybrid protocol of 39 criteria: deterministic rule-based metrics measure properties with direct correspondences, while asset-specific vision-language rubrics capture semantic and perceptual qualities for which exact matching is misleading. Besides, we propose DrawAI-Flow, a two-stage agentic workflow in which a Parser Agent turns extracted elements evidence into an explicit reconstruction plan, and a Reconstruction Agent realizes the plan as executable graphics code through an iterative code-render-validate-revise loop. On DrawAI-Bench, we systematically evaluate thirteen models across five agent harnesses to study the effects of model capability, harness choice, and workflow design. The results show that reconstruction quality and costs vary substantially across model-harness configurations, while DrawAI-Flow consistently improves editable structure.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 47 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
42 of 47 references.
Closest ancestors · 1
Same direction, newest first
Other references · 41
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 511
29 more
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 158
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 118
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 96
- 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 83
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
- 2016Image-to-Markup Generation with Coarse-to-Fine Attentioncited by 79
- 2022Towards Layer-wise Image Vectorizationcited by 77
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
- 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
- 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 68
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 56
- 2024SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilitiescited by 25
- 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 22
- 2026AutoFigure: Generating and Refining Publication-Ready Scientific Illustrationscited by 20
- 2024SuperSVG: Superpixel-based Scalable Vector Graphics Synthesiscited by 19
- 2026AutoFigure-Edit: Generating Editable Scientific Illustrationcited by 12
- 2026PresentBench: A Fine-Grained Rubric-Based Benchmark for Slide Generationcited by 12
- 2026DECKBench: Benchmarking Multi-Agent Frameworks for Academic Slide Generation and Editingcited by 9
- 2026Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputscited by 8
- 2023Image is All You Need to Empower Large-scale Diffusion Models for In-Domain Generationcited by 7
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Taskscited by 6
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 6
- 2025Semantic Document Derendering: SVG Reconstruction via Vision-Language Modelingcited by 3
- 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peelingcited by 3
- 2025CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Designcited by 2
- 2026From Dead Pixels to Editable Slides: Infographic Reconstruction into Native Google Slides via Vision-Language Region Understandingcited by 1
- 2026AnchorFlow: Learning Anchor Placement for Faithful and Editable SVG Reconstructioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition
- 2026ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides
- 2026SLIDEFORGE: An LLM Agent for Controllable Editing of Slides as Structured Artifacts
- 2026CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
- 2026The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue
- 2025See it. Say it. Sorted: Agentic System for Compositional Diagram Generation