FigMirror: Ground It, Code It, Plot It
Not on the map. Why?
Abstract (arXiv)
Converting scientific figures into executable code has gained increasing attention, yet existing methods primarily focus on reproducing the reference figure itself. A more practical setting is to plot new data while preserving the visual style of a reference figure (e.g., color scheme and typography). Prior approaches mimic the reference through pixel-level optimization and struggle to carry its style to new data. We show that the key to this task lies in the coordinate grounding and coding capabilities present in modern computer-use models. We propose FigMirror, an agentic framework that unlocks these capabilities through Grounded Measurement, which locates visual elements by coordinates and measures their properties through executable code. We further introduce PlotTwin-Bench, an expert-curated benchmark with fine-grained code and image-level style metrics. Experiments show that FigMirror consistently outperforms existing methods on reference-conditioned style transfer. All plots in this paper are generated by FigMirror, except those produced by other methods for comparison. Our code and data are available at: https://github.com/VILA-Lab/FigMirror.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 45 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
27 of 45 references.
References · 27
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
15 more
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 382
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 378
- 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 340
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 169
- 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 133
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
- 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scalingcited by 34
- 2025ChartGalaxy: A Dataset for Infographic Chart Understanding and Generationcited by 18
- 2025ChartMaster: Advancing Chart-to-Code Generation with Real-World Charts and Chart Similarity Reinforcement Learningcited by 16
- 2025Improved Iterative Refinement for Chart-to-Code Generation via Structured Instructioncited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FigAct: Turning Scientific Figures into Active Canvases for Explanation
- 2026ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
- 2026PlotGround: Grounding Plot Digitization in Real Scientific Figures and Their Source Data
- 2026Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ
- 2026Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation
- 2024Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots
- 2024DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ
- 2025PlotGen-Bench: Evaluating VLMs on Generating Visualization Code from Diverse Plots across Multiple Libraries