mlsanityData to 14 Oct 2026

Chart-R1: Chain-of-Thought Supervision and Reinforcement for Advanced Chart Reasoner

arXiv 2507.15509 ↗First posted 21 Jul 2025cs.AI cs.CVcited by 25

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Chart reasoning presents unique challenges due to its inherent complexity -- requiring precise numerical comprehension, multi-level visual understanding, and logical inference across interconnected data elements. Existing vision-language models often struggle with such reasoning tasks, particularly when handling multi-subchart scenarios and numerical sensitivity. To address these challenges, we introduce Chart-R1, a chart-domain vision-language model that leverages reinforcement fine-tuning for advanced chart reasoning. We first propose a programmatic data synthesis approach to generate high-quality step-by-step reasoning data with verifiable answer formats, covering diverse chart types and complexity levels. Our two-stage training strategy includes: (1) Chart-COT, which decomposes complex reasoning into interpretable subtasks through chain-of-thought supervision, and (2) Chart-RFT, which employs group relative policy optimization with numerically sensitive rewards tailored for chart-specific reasoning. Experiments on open-source benchmarks and our proposed ChartRQA dataset demonstrate that Chart-R1 significantly outperforms existing chart-domain methods and rivals large-scale open/closed-source models.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 49 references that are in the map. First posted on arXiv 21 Jul 2025.

Builds on

36 of 49 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning16 Jun
  2. 2025ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering11 Jun
  3. 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning26 May
  4. 2025ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models19 May
  5. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  6. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  7. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  8. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  9. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  10. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  11. 2024Distill Visual Chart Reasoning Ability from LLMs to MLLMs24 Oct
  12. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation14 Jun
4 more
  1. 2024TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning25 Apr
  2. 2024ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning14 Mar
  3. 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning19 Feb
  4. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 20

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  7. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  8. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  9. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  10. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  11. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  12. 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 169
8 more
  1. 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
  2. 2023MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuningcited by 150
  3. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
  4. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
  5. 2024ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wildcited by 79
  6. 2024ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understandingcited by 46
  7. 2025ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editingcited by 32
  8. 2025ChartCards: A Chart-Metadata Generation Framework for Multi-Task Chart Understandingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 11; 2026: 14.

25 papers.

Sort:

By area:

  1. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
  2. 2025VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learningcited by 21
  3. 2025Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generationcited by 19
  4. 2025Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curationcited by 13
  5. 2025PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Imagescited by 12
  6. 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 10
  7. 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
  8. 2025START: Spatial and Textual Learning for Chart Understandingcited by 4
  9. 2025Do MLLMs Really Understand the Charts?cited by 3
  10. 2025Composition-Grounded Data Synthesis for Visual Reasoningcited by 3
  11. 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoningcited by 3
  12. 2025Metis-HOME: Hybrid Optimized Mixture-of-Experts for Multimodal Reasoningcited by 2
13 more
  1. 2026ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Chartscited by 2
  2. 2026CharTide: Data-Centric Chart-to-Code Generation via Tri-Perspective Tuning and Inquiry-Driven Evolutioncited by 2
  3. 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understandingcited by 2
  4. 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understandingcited by 1
  5. 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensemblescited by 1
  6. 2026Data Analysis in the Wild: Benchmarking Large Language Models Against Real-World Data Complexitiescited by 1
  7. 2025PreferThinker: Reasoning-based Personalized Image Preference Assessmentcited by 0
  8. 2026CharTool: Tool-Integrated Visual Reasoning for Chart Understandingcited by 0
  9. 2026Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoningcited by 0
  10. 2026Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learningcited by 0
  11. 2026WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoningcited by 0
  12. 2026Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillationcited by 0
  13. 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Chart-RVR: Reinforcement Learning with Verifiable Rewards for Explainable Chart Reasoning
  2. 2026Chart-RL: Policy Optimization Reinforcement Learning for Enhanced Visual Reasoning in Chart Question Answering with Vision Language Models
  3. 2025ChartM3: A Multi-Stage Code-Driven Pipeline for Constructing Multi-Dimensional and Multi-Step Visual Reasoning Data in Chart Comprehension
  4. 2025Visual Programmability: A Guide for Code-as-Thought in Chart Understanding
  5. 2026Chart-RL: Generalized Chart Comprehension via Reinforcement Learning with Verifiable Rewards
  6. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning
  7. 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuning
  8. 2025ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understanding