CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolution
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
Chart-to-code generation demands strict visual precision and syntactic correctness from Vision-Language Models (VLMs). However, existing approaches are fundamentally constrained by data-centric limitations: despite the availability of growing chart-to-code datasets, simply scaling homogeneous chart-code pairs conflates visual perception with program logic, preventing models from fully leveraging the richness of multimodal supervision. We present CharTide, a novel data-centric framework that systematically redesigns both training and alignment data for chart-to-code generation. First, we construct a 2M-sample dataset via a Tri-Perspective Tuning strategy, explicitly decoupling training into visual perception, pure-text code logic, and modality fusion streams, enabling a 7B model to surpass specialized baselines using only supervised data. Second, we reformulate alignment as a data verification problem rather than a heuristic scoring task. To this end, we introduce an Inquiry-Driven RL framework grounded in the principle of information invariance: a downstream model should yield consistent answers to identical visual queries across both original and generated charts. Moving beyond rigid rule matching or VLM scoring, we employ a frozen Inspector to objectively verify generated charts through atomic QA tasks, providing verifiable reward signals based on answer accuracy. Experiments on ChartMimic, Plot2Code, and ChartX show that CharTide-7B/8B significantly outperforms open-source baselines, surpasses GPT-4o, and is competitive with GPT-5.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 28 references that are in the map. First posted on arXiv 24 Apr 2026.
Builds on
20 of 28 references.
Closest ancestors · 7
Same direction, newest first
- 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation19 Aug
- 2025ChartCap: Mitigating Hallucination of Dense Chart Captioning5 Aug
- 2025Chart-R1: Chain-of-Thought Supervision and Reinforcement for Advanced Chart Reasoner21 Jul
- 2025Boosting Chart-to-Code Generation in MLLM via Dual Preference-Guided Refinement3 Apr
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generation11 Jan
- 2024Distill Visual Chart Reasoning Ability from LLMs to MLLMs24 Oct
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering5 Mar
Other references · 13
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 105
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 36
- 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuningcited by 31
- 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedbackcited by 31
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 18
- 2025ChartMaster: Advancing Chart-to-Code Generation with Real-World Charts and Chart Similarity Reinforcement Learningcited by 15
1 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Visual Programmability: A Guide for Code-as-Thought in Chart Understanding
- 2025Improved Iterative Refinement for Chart-to-Code Generation via Structured Instruction
- 2026Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generation
- 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding
- 2025EncQA: Benchmarking Vision-Language Models on Visual Encodings for Charts
- 2026ChartJudgeBench: Evaluating LMM Judges for Chart-to-Code Generation
- 2026RealChart2Code: Advancing Chart-to-Code Generation with Real Data and Multi-Task Evaluation