EdiTikZ: Scientific Figure Editing from Revision Trajectories
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
Vision-language models (VLMs) have shown strong performance in generating scientific figures from text or images. However, publication-ready figures often require iterative refinement, making scientific figure editing an important yet largely unexplored step toward interactive figure creation. Existing approaches rely on costly proprietary agentic systems, focus primarily on evaluation, or construct training supervision from synthetically generated edits. Instead, we leverage naturally occurring scientific revision and development trajectories as a scalable source of supervision. To this end, we introduce DaEdiTikZ, the first large-scale dataset of revision-derived scientific figure edits, constructed by mining 391K plausible TikZ edit pairs from arXiv, GitHub, and TeX SE and inferring 781K directed edit instructions with a VLM conditioned on rendered figures and TikZ code. We further introduce DaEdiTikZ-Bench, a human-refined benchmark with 690 instances, and train two compact Qwen3.5-based EdiTikZ models (4B and 9B) by jointly learning image-to-TikZ reconstruction and instruction-conditioned editing, followed by reinforcement learning (RL) with complementary rewards for rendered fidelity and edit application. Automatic evaluation places our 9B model above all tested baselines, while human evaluation with 9 annotators and 4,320 ratings places it above GPT-5.6-Sol and on par with Gemini-3.1-Pro. Under severe out-of-distribution shifts, it remains competitive with GPT-5.6-Sol near its 2K training sequence-length regime.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 50 of its 65 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
50 of 65 references.
Closest ancestors · 5
Same direction, newest first
- 2026Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams12 Aug
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?11 Aug
- 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editing17 May
- 2024ScImage: How Good Are Multimodal Large Language Models at Scientific Text-to-Image Generation?3 Dec
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs26 Jun
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023Visual Instruction Tuningcited by 7,869
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
33 more
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
- 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 189
- 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 102
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
- 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
- 2025ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflowscited by 52
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 42
- 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generationcited by 39
- 2024Chat2SVG: Vector Graphics Generation with Large Language Models and Image Diffusion Modelscited by 38
- 2024From Words to Structured Visuals: A Benchmark and Framework for Text-to-Diagram Generation and Editingcited by 31
- 2023InstructCoder: Instruction Tuning Large Language Models for Code Editingcited by 29
- 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 26
- 2025TikZero: Zero-Shot Text-Guided Graphics Program Synthesiscited by 24
- 2025VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generationcited by 17
- 2024SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinementcited by 15
- 2026AutoFigure-Edit: Generating Editable Scientific Illustrationcited by 14
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editingcited by 11
- 2026Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputscited by 9
- 2026TikZilla: Scaling Text-to-TikZ with High-Quality Data and Reinforcement Learningcited by 7
- 2025VisCoder2: Building Multi-Language Visualization Coding Agentscited by 6
- 2026Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learningcited by 6
- 2025VectorEdits: A Dataset and Benchmark for Instruction-Based Editing of Vector Graphicscited by 5
- 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
- 2026MM-ReCoder: Advancing Chart-to-Code Generation with Reinforcement Learning and Self-Correctioncited by 5
- 2026OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Rewardcited by 4
- 2026GENFIG1: Visual Summaries of Scholarly Work as a Challenge for Vision-Language Modelscited by 2
- 2026S1-Omni-Image: A Unified Model for Scientific Image Understanding, Generation, and Editingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ
- 2024DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ
- 2026SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions
- 2026ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
- 2026SciFig: Towards Automating Editable Figure Generation for Scientific Papers
- 2026FigAct: Turning Scientific Figures into Active Canvases for Explanation
- 2025From Pixels to Paths: A Multi-Agent Framework for Editable Scientific Illustration
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editing