VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
Vision-language models (VLMs) have shown strong capabilities in generating visualization code from textual or visual specifications. However, real-world visualization authoring is inherently iterative: users frequently revise existing visualizations to repair flawed charts or adapt them to desired styles. Existing benchmarks primarily evaluate generation from scratch, leaving visualization code editing from multimodal feedback largely unexplored. We introduce VisEditBench, a benchmark of 1,395 human-annotated visualization code-editing tasks grounded in realistic visualization workflows and failure cases. VisEditBench covers two practical settings: feedback-guided repair, where models revise visualization code using buggy or marked charts together with textual feedback, and reference-guided restyling, where models modify code to match a target chart image. Evaluating 20 state-of-the-art VLMs reveals that visualization code editing remains challenging: Claude-4.6-Sonnet achieves the best overall pass rate of 74.46%, while most open-source models remain below 50%. Performance is particularly weak on visually grounded style adaptation, where Claude-4.6-Sonnet achieves only 55.71%. To establish a strong baseline, we further propose VisEditAgent, a render-grounded editing framework that iteratively generates, executes, validates, and refines candidate edits. Built on GPT-4o, VisEditAgent improves overall pass rate from 55.75% to 67.99%, demonstrating the importance of render-grounded feedback for faithful visualization editing. We will release VisEditBench at https://github.com/vis-nlp/VisEditBench.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 16 of its 33 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
16 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation14 Jun
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering5 Mar
- 2023ChartBench: A Benchmark for Complex Visual Reasoning in Charts26 Dec
Other references · 13
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 331
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 74
- 2018Data2Vis: Automatic Generation of Data Visualizations Using Sequence to Sequence Recurrent Neural Networkscited by 48
- 2024MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problemscited by 40
- 2021nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Taskcited by 28
- 2024SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilitiescited by 26
- 2019Sketch2code: Generating a website from a paper mockupcited by 20
1 more
- 2016Converting Basic D3 Charts into Reusable Style Templatescited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectoriescited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026VisAudit: Evaluating Multimodal Agents for Visual Diagnosis and Repaircited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operationcited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation12 Oct 2026
- 2026VisAudit: Evaluating Multimodal Agents for Visual Diagnosis and Repair1 Oct 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectories1 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025VisCoder2: Building Multi-Language Visualization Coding Agents
- 2025PlotGen-Bench: Evaluating VLMs on Generating Visualization Code from Diverse Plots across Multiple Libraries
- 2025Automated Visualization Code Synthesis via Multi-Path Reasoning and Feedback-Driven Optimization
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing
- 2026ChartEditBench: Evaluating Grounded Multi-Turn Chart Editing in Multimodal Language Models
- 2025From Charts to Code: A Hierarchical Benchmark for Multimodal Models
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?
- 2026De-rendering, Reasoning, and Repairing Charts with Vision-Language Models