mlsanityData to 7 Oct 2026

Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ

arXiv 2608.13441 ↗First posted 13 Aug 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Although multimodal large language models (MLLMs) have shown substantial potential in visual understanding and graphic code generation, editing scientific figures through code presents a greater challenge: a model must jointly recover visual structure, ground the requested change, generate compilable code, and preserve all unrelated content. While existing TikZ benchmarks mainly focus on figure reconstruction and generation, few systematically evaluate instruction-guided scientific figure editing with compilable code. We introduce Edit2TikZ, a comprehensive benchmark for scientific figure editing tasks, featuring 1,548 diverse and high-quality samples. Edit2TikZ combines real-world and controlled synthetic edit cases, supports both textual and visual localization request, and contains multi-step editing, each with step-level annotations. We further construct a human-aligned evaluation framework to measure whether a requested edit is completed while irrelevant content is preserved. Utilizing Edit2TikZ, we evaluate 14 mainstream MLLMs and find that current systems remain unreliable: on average, proprietary models achieve a compilation success rate of merely 75% and remain limited in both figure restoration and edit correctness, while compact models below 9B struggle further with instruction following and complete figure generation. Therefore, we build a mixed training set TikZEditMix and adopt reconstruction-then-editing curriculum learning for compact models. On Qwen3.5-4B, this training improves the compilation success rate from 45.35% to 83.40% and yields an average improvement of 18.7 points across our proposed evaluation metrics. The code and data will be released at https://github.com/Solunny/Edit2TikZ.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 15 of its 20 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

15 of 20 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing15 May
  2. 2026Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation11 May
  3. 2026ChartEditBench: Evaluating Grounded Multi-Turn Chart Editing in Multimodal Language Models17 Feb
  4. 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editing17 May
  5. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generation11 Jan
  6. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation14 Jun
  7. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering5 Mar

Other references · 8

  1. 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesiscited by 21
  2. 2025SVGEditBench V2: A Benchmark for Instruction-based SVG Editingcited by 9
  3. 2025ChartM3: Benchmarking Chart Editing with Multimodal Instructionscited by 9
  4. 2025ChartEditor: A Reinforcement Learning Framework for Robust Chart Editingcited by 9
  5. 2026Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learningcited by 6
  6. 2025LLM Code Customization with Visual Results: A Benchmark on TikZcited by 5
  7. 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approachcited by 3
  8. 2026GeoTikzBridge: Advancing Multimodal Code Generation for Geometric Perception and Reasoningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EdiTikZ: Scientific Figure Editing from Revision Trajectories
  2. 2024DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ
  3. 2026ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
  4. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
  5. 2026PaintBench: Deterministic Evaluation of Precise Visual Editing
  6. 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?
  7. 2024Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots
  8. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editing