mlsanityData to 7 Oct 2026

CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolution

arXiv 2604.22192 ↗First posted 24 Apr 2026cs.CVcited by 2

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Chart-to-code generation demands strict visual precision and syntactic correctness from Vision-Language Models (VLMs). However, existing approaches are fundamentally constrained by data-centric limitations: despite the availability of growing chart-to-code datasets, simply scaling homogeneous chart-code pairs conflates visual perception with program logic, preventing models from fully leveraging the richness of multimodal supervision. We present CharTide, a novel data-centric framework that systematically redesigns both training and alignment data for chart-to-code generation. First, we construct a 2M-sample dataset via a Tri-Perspective Tuning strategy, explicitly decoupling training into visual perception, pure-text code logic, and modality fusion streams, enabling a 7B model to surpass specialized baselines using only supervised data. Second, we reformulate alignment as a data verification problem rather than a heuristic scoring task. To this end, we introduce an Inquiry-Driven RL framework grounded in the principle of information invariance: a downstream model should yield consistent answers to identical visual queries across both original and generated charts. Moving beyond rigid rule matching or VLM scoring, we employ a frozen Inspector to objectively verify generated charts through atomic QA tasks, providing verifiable reward signals based on answer accuracy. Experiments on ChartMimic, Plot2Code, and ChartX show that CharTide-7B/8B significantly outperforms open-source baselines, surpasses GPT-4o, and is competitive with GPT-5.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 28 references that are in the map. First posted on arXiv 24 Apr 2026.

Builds on

20 of 28 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation19 Aug
  2. 2025ChartCap: Mitigating Hallucination of Dense Chart Captioning5 Aug
  3. 2025Chart-R1: Chain-of-Thought Supervision and Reinforcement for Advanced Chart Reasoner21 Jul
  4. 2025Boosting Chart-to-Code Generation in MLLM via Dual Preference-Guided Refinement3 Apr
  5. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generation11 Jan
  6. 2024Distill Visual Chart Reasoning Ability from LLMs to MLLMs24 Oct
  7. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering5 Mar

Other references · 13

  1. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  2. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  4. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  5. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  6. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
  7. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 105
  8. 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 36
  9. 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuningcited by 31
  10. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedbackcited by 31
  11. 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 18
  12. 2025ChartMaster: Advancing Chart-to-Code Generation with Real-World Charts and Chart Similarity Reinforcement Learningcited by 15
1 more
  1. 2025Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curationcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Visual Programmability: A Guide for Code-as-Thought in Chart Understanding
  2. 2025Improved Iterative Refinement for Chart-to-Code Generation via Structured Instruction
  3. 2026Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generation
  4. 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning
  5. 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding
  6. 2025EncQA: Benchmarking Vision-Language Models on Visual Encodings for Charts
  7. 2026ChartJudgeBench: Evaluating LMM Judges for Chart-to-Code Generation
  8. 2026RealChart2Code: Advancing Chart-to-Code Generation with Real Data and Multi-Task Evaluation