Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Graphics Program Synthesis is pivotal for interpreting and editing visual data, effectively facilitating the reverse-engineering of static visuals into editable TikZ code. While TikZ is the de facto standard for scientific schematics due to its programmatic flexibility, its requirement for rigorous spatial precision presents a significant challenge for Multimodal Large Language Models. Progress is currently stifled by two primary gaps: (1) Data Quality Gap: existing image-TikZ corpora often lack strict executability and reliable visual alignment; (2) Evaluation Gap: a lack of benchmarks for both structural and visual fidelity. To address these, we present a closed-loop framework featuring: SciTikZ-230K, a large-scale, high-quality dataset from our Execution-Centric Data Engine covering 11 diverse scientific disciplines; SciTikZ-Bench, a multifaceted benchmark spanning from basic geometric constructs to intricate hierarchical schematics to evaluate both visual fidelity and structural logic. To further broaden the scope of visual-code optimization methodology, we introduce a novel Dual Self-Consistency Reinforcement Learning optimization paradigm, which utilizes Round-Trip Verification to penalize degenerate code and boost overall self-consistency. Empowered by these, our trained model SciTikZer-8B achieves state-of-the-art performance, consistently outperforming proprietary giants like Gemini-2.5-Pro and massive models like Qwen3-VL-235B-A22B-Instruct.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 61 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
29 of 61 references.
Closest ancestors · 9
Same direction, newest first
- 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods29 Jan
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback28 Jul
- 2025GRIT: Teaching MLLMs to Think with Images21 May
- 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scaling24 Feb
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation14 Jun
Other references · 20
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
8 more
- 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 146
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 98
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 74
- 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 28
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 18
- 2024GAMEBoT: Transparent Assessment of LLM Reasoning in Gamescited by 16
- 2025A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learningcited by 6
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0
- 2026SciForma: Structure-Faithful Generation of Scientific Diagramscited by 0
- 2026Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZcited by 0
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectoriescited by 0
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoningcited by 0
- 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning1 Oct 2026
- 2026EdiTikZ: Scientific Figure Editing from Revision Trajectories1 Sep 2026
- 2026Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ13 Aug 2026
- 2026SciForma: Structure-Faithful Generation of Scientific Diagrams20 Jul 2026
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ
- 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility
- 2026TurtleAI: Benchmarking Multimodal Models for Visual Programming in Turtle Graphics
- 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation
- 2025Boosting Chart-to-Code Generation in MLLM via Dual Preference-Guided Refinement
- 2026Self-Distillation Policy Optimization via Visual Feedback: Bridging Code and Visual Artifacts
- 2026DICS: Exploring Data Intrinsic Consistency for Visual Instruction Selection
- 2026Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generation