mlsanityData to 7 Oct 2026

Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning

arXiv 2604.06079 ↗First posted 7 Apr 2026cs.CV cs.AIcited by 6

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Graphics Program Synthesis is pivotal for interpreting and editing visual data, effectively facilitating the reverse-engineering of static visuals into editable TikZ code. While TikZ is the de facto standard for scientific schematics due to its programmatic flexibility, its requirement for rigorous spatial precision presents a significant challenge for Multimodal Large Language Models. Progress is currently stifled by two primary gaps: (1) Data Quality Gap: existing image-TikZ corpora often lack strict executability and reliable visual alignment; (2) Evaluation Gap: a lack of benchmarks for both structural and visual fidelity. To address these, we present a closed-loop framework featuring: SciTikZ-230K, a large-scale, high-quality dataset from our Execution-Centric Data Engine covering 11 diverse scientific disciplines; SciTikZ-Bench, a multifaceted benchmark spanning from basic geometric constructs to intricate hierarchical schematics to evaluate both visual fidelity and structural logic. To further broaden the scope of visual-code optimization methodology, we introduce a novel Dual Self-Consistency Reinforcement Learning optimization paradigm, which utilizes Round-Trip Verification to penalize degenerate code and boost overall self-consistency. Empowered by these, our trained model SciTikZer-8B achieves state-of-the-art performance, consistently outperforming proprietary giants like Gemini-2.5-Pro and massive models like Qwen3-VL-235B-A22B-Instruct.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 61 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

29 of 61 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods29 Jan
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  3. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback28 Jul
  4. 2025GRIT: Teaching MLLMs to Think with Images21 May
  5. 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning15 May
  6. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  7. 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scaling24 Feb
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  9. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation14 Jun

Other references · 20

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  9. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  10. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  11. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  12. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
8 more
  1. 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 146
  2. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 98
  3. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
  4. 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 74
  5. 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 28
  6. 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 18
  7. 2024GAMEBoT: Transparent Assessment of LLM Reasoning in Gamescited by 16
  8. 2025A Practical Two-Stage Recipe for Mathematical LLMs: Maximizing Accuracy with SFT and Efficiency with Reinforcement Learningcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ
  2. 2026Scientific Image Synthesis: Benchmarking, Methodologies, and Downstream Utility
  3. 2026TurtleAI: Benchmarking Multimodal Models for Visual Programming in Turtle Graphics
  4. 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation
  5. 2025Boosting Chart-to-Code Generation in MLLM via Dual Preference-Guided Refinement
  6. 2026Self-Distillation Policy Optimization via Visual Feedback: Bridging Code and Visual Artifacts
  7. 2026DICS: Exploring Data Intrinsic Consistency for Visual Instruction Selection
  8. 2026Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generation