Chart-R1: Chain-of-Thought Supervision and Reinforcement for Advanced Chart Reasoner
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Chart reasoning presents unique challenges due to its inherent complexity -- requiring precise numerical comprehension, multi-level visual understanding, and logical inference across interconnected data elements. Existing vision-language models often struggle with such reasoning tasks, particularly when handling multi-subchart scenarios and numerical sensitivity. To address these challenges, we introduce Chart-R1, a chart-domain vision-language model that leverages reinforcement fine-tuning for advanced chart reasoning. We first propose a programmatic data synthesis approach to generate high-quality step-by-step reasoning data with verifiable answer formats, covering diverse chart types and complexity levels. Our two-stage training strategy includes: (1) Chart-COT, which decomposes complex reasoning into interpretable subtasks through chain-of-thought supervision, and (2) Chart-RFT, which employs group relative policy optimization with numerically sensitive rewards tailored for chart-specific reasoning. Experiments on open-source benchmarks and our proposed ChartRQA dataset demonstrate that Chart-R1 significantly outperforms existing chart-domain methods and rivals large-scale open/closed-source models.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 49 references that are in the map. First posted on arXiv 21 Jul 2025.
Builds on
36 of 49 references.
Closest ancestors · 16
Same direction, newest first
- 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning16 Jun
- 2025ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering11 Jun
- 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning26 May
- 2025ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models19 May
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024Distill Visual Chart Reasoning Ability from LLMs to MLLMs24 Oct
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation14 Jun
4 more
- 2024TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning25 Apr
- 2024ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning14 Mar
- 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning19 Feb
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 20
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 169
8 more
- 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
- 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
- 2024ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wildcited by 79
- 2024ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understandingcited by 46
- 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 32
- 2025ChartCards: A Chart-Metadata Generation Framework for Multi-Task Chart Understandingcited by 5
Built on by
Citing papers per year: 2025: 11; 2026: 14.
25 papers.
Sort:
By area:
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 21
- 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generationcited by 19
- 2025Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curationcited by 13
- 2025PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Imagescited by 12
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 10
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2025START: Spatial and Textual Learning for Chart Understandingcited by 4
- 2025Do MLLMs Really Understand the Charts?cited by 3
- 2025Composition-Grounded Data Synthesis for Visual Reasoningcited by 3
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoningcited by 3
- 2025Metis-HOME: Hybrid Optimized Mixture-of-Experts for Multimodal Reasoningcited by 2
13 more
- 2026ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Chartscited by 2
- 2026CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolutioncited by 2
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understandingcited by 2
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understandingcited by 1
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensemblescited by 1
- 2026Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexitiescited by 1
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessmentcited by 0
- 2026CharTool: Tool-Integrated Visual Reasoning for Chart Understandingcited by 0
- 2026Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoningcited by 0
- 2026Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learningcited by 0
- 2026WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoningcited by 0
- 2026Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillationcited by 0
- 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoningcited by 0
- 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoning7 Oct 2026
- 2026Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation30 Sep 2026
- 2026WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning28 Sep 2026
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding23 Aug 2026
- 2026Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexities7 Jul 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning3 Jun 2026
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles21 May 2026
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding11 May 2026
- 2026Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoning5 May 2026
- 2026CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolution24 Apr 2026
- 2026CharTool: Tool-Integrated Visual Reasoning for Chart Understanding3 Apr 2026
13 more
- 2026ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Charts30 Mar 2026
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan 2026
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoning26 Dec 2025
- 2025START: Spatial and Textual Learning for Chart Understanding8 Dec 2025
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessment1 Nov 2025
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learning1 Nov 2025
- 2025Metis-HOME: Hybrid Optimized Mixture-of-Experts for Multimodal Reasoning23 Oct 2025
- 2025Composition-Grounded Data Synthesis for Visual Reasoning16 Oct 2025
- 2025PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Images29 Sep 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025Do MLLMs Really Understand the Charts?27 Aug 2025
- 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation19 Aug 2025
- 2025Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curation18 Aug 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generationcited by 19
- 2025Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curationcited by 13
- 2025PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Imagescited by 12
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 10
- 2025Do MLLMs Really Understand the Charts?cited by 3
- 2025Composition-Grounded Data Synthesis for Visual Reasoningcited by 3
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoningcited by 3
- 2025Metis-HOME: Hybrid Optimized Mixture-of-Experts for Multimodal Reasoningcited by 2
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understandingcited by 2
- 2026CharTool: Tool-Integrated Visual Reasoning for Chart Understandingcited by 0
- 2026Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoning7 Oct 2026
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding23 Aug 2026
- 2026Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoning5 May 2026
- 2026CharTool: Tool-Integrated Visual Reasoning for Chart Understanding3 Apr 2026
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch20 Jan 2026
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoning26 Dec 2025
- 2025Metis-HOME: Hybrid Optimized Mixture-of-Experts for Multimodal Reasoning23 Oct 2025
- 2025Composition-Grounded Data Synthesis for Visual Reasoning16 Oct 2025
- 2025PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Images29 Sep 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025Do MLLMs Really Understand the Charts?27 Aug 2025
- 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation19 Aug 2025
12 newest of 13 All 13 (JSON)
- 2025START: Spatial and Textual Learning for Chart Understandingcited by 4
- 2026CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolutioncited by 2
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understandingcited by 1
- 2026Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learningcited by 0
- 2026Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning3 Jun 2026
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding11 May 2026
- 2026CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolution24 Apr 2026
- 2025START: Spatial and Textual Learning for Chart Understanding8 Dec 2025
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 21
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2026ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Chartscited by 2
- 2026Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexitiescited by 1
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessmentcited by 0
- 2026Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexities7 Jul 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Charts30 Mar 2026
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessment1 Nov 2025
- 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learning1 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Chart-RVR: Reinforcement Learning with Verifiable Rewards for Explainable Chart Reasoning
- 2026Chart-RL: Policy Optimization Reinforcement Learning for Enhanced Visual Reasoning in Chart Question Answering with Vision Language Models
- 2025ChartM3: A Multi-Stage Code-Driven Pipeline for Constructing Multi-Dimensional and Multi-Step Visual Reasoning Data in Chart Comprehension
- 2025Visual Programmability: A Guide for Code-as-Thought in Chart Understanding
- 2026Chart-RL: Generalized Chart Comprehension via Reinforcement Learning with Verifiable Rewards
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning
- 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning
- 2025ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understanding