mlsanityData to 14 Oct 2026

VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?

arXiv 2608.10408 ↗First posted 11 Aug 2026cs.CLcited by 4

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Vision-language models (VLMs) have shown strong capabilities in generating visualization code from textual or visual specifications. However, real-world visualization authoring is inherently iterative: users frequently revise existing visualizations to repair flawed charts or adapt them to desired styles. Existing benchmarks primarily evaluate generation from scratch, leaving visualization code editing from multimodal feedback largely unexplored. We introduce VisEditBench, a benchmark of 1,395 human-annotated visualization code-editing tasks grounded in realistic visualization workflows and failure cases. VisEditBench covers two practical settings: feedback-guided repair, where models revise visualization code using buggy or marked charts together with textual feedback, and reference-guided restyling, where models modify code to match a target chart image. Evaluating 20 state-of-the-art VLMs reveals that visualization code editing remains challenging: Claude-4.6-Sonnet achieves the best overall pass rate of 74.46%, while most open-source models remain below 50%. Performance is particularly weak on visually grounded style adaptation, where Claude-4.6-Sonnet achieves only 55.71%. To establish a strong baseline, we further propose VisEditAgent, a render-grounded editing framework that iteratively generates, executes, validates, and refines candidate edits. Built on GPT-4o, VisEditAgent improves overall pass rate from 55.75% to 67.99%, demonstrating the importance of render-grounded feedback for faithful visualization editing. We will release VisEditBench at https://github.com/vis-nlp/VisEditBench.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 16 of its 33 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

16 of 33 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation14 Jun
  2. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering5 Mar
  3. 2023ChartBench: A Benchmark for Complex Visual Reasoning in Charts26 Dec

Other references · 13

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  3. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
  4. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 331
  5. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
  6. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
  7. 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 74
  8. 2018Data2Vis: Automatic Generation of Data Visualizations Using Sequence to Sequence Recurrent Neural Networkscited by 48
  9. 2024MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problemscited by 40
  10. 2021nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Taskcited by 28
  11. 2024SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilitiescited by 26
  12. 2019Sketch2code: Generating a website from a paper mockupcited by 20
1 more
  1. 2016Converting Basic D3 Charts into Reusable Style Templatescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VisCoder2: Building Multi-Language Visualization Coding Agents
  2. 2025PlotGen-Bench: Evaluating VLMs on Generating Visualization Code from Diverse Plots across Multiple Libraries
  3. 2025Automated Visualization Code Synthesis via Multi-Path Reasoning and Feedback-Driven Optimization
  4. 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing
  5. 2026ChartEditBench: Evaluating Grounded Multi-Turn Chart Editing in Multimodal Language Models
  6. 2025From Charts to Code: A Hierarchical Benchmark for Multimodal Models
  7. 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?
  8. 2026De-rendering, Reasoning, and Repairing Charts with Vision-Language Models