mlsanityData to 14 Oct 2026

ChartRevise: A Dataset and Evaluation Protocol for Exact Chart Editing via Code

arXiv 2609.38642 ↗First posted 29 Sep 2026cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Chart editing requires cross-modal edit grounding, realizing a requested visual change in the code that draws it, with necessary related updates and without altering unrelated content. Existing benchmarks emphasize either code executability or chart quality, but their metrics do not clearly distinguish request completion from missed coupled updates and gratuitous changes. We introduce ChartRevise, a structured dataset and evaluation protocol for exact program-grounded chart editing. For dataset construction, we build on the grammar of graphics to systematically cover chart-editing operations, using source-program checks to verify their applicability across chart types and libraries. To improve edit exactness, our pipeline checks individual requirements and guides repair or exclusion when they are unmet. The resulting dataset contains 92,438 records covering 344 edit types across 20 chart types and three plotting libraries. For evaluation, our reference-free protocol separately measures atomic requirement completion, identifies gratuitous changes, and detects missed coupled updates. These checks are combined with successful execution and rendering to determine exact-edit success. Across five models and four external benchmarks, fine-tuning yields relative gains of 16% in mean requirement recall and 22% in mean exact-edit rate.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 47 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

37 of 47 references.

References · 37

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  7. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  8. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  9. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  10. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  11. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  12. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
25 more
  1. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  2. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  3. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  4. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
  5. 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
  6. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 160
  7. 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 133
  8. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
  9. 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 128
  10. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
  11. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
  12. 2024ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wildcited by 79
  13. 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 77
  14. 2023Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructionscited by 48
  15. 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 32
  16. 2024ChartReformer: Natural Language-Driven Chart Image Editingcited by 13
  17. 2025From Charts to Code: A Hierarchical Benchmark for Multimodal Modelscited by 13
  18. 2025ChartEditor: A Reinforcement Learning Framework for Robust Chart Editingcited by 11
  19. 2025Charts Are Not Images: On the Challenges of Scientific Chart Editingcited by 11
  20. 2025ChartM3: Benchmarking Chart Editing with Multimodal Instructionscited by 9
  21. 2026ChartEditBench: Evaluating Grounded Multi-Turn Chart Editing in Multimodal Language Modelscited by 8
  22. 2026ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understandingcited by 8
  23. 2026ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editingcited by 4
  24. 2025PlotEdit: Natural Language-Driven Accessible Chart Editing in PDFs via Multimodal LLM Agentscited by 3
  25. 2026Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generationcited by 2

Built on by

Not cited yet.