Chart-RVR: Reinforcement Learning with Verifiable Rewards for Explainable Chart Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The capabilities of Large Vision-Language Models (LVLMs) have reached state-of-the-art on many visual reasoning tasks, including chart reasoning, yet they still falter on out-of-distribution (OOD) data, and degrade further when asked to produce their chain-of-thought (CoT) rationales, limiting explainability. We present Chart-RVR, a general framework that fine-tunes LVLMs to be more robust and explainable for chart reasoning by coupling Group Relative Policy Optimization (GRPO) with automatically verifiable rewards. Our framework comprises of three rewards that maximize: (i) correct chart-type classification, (ii) faithful chart table reconstruction, and (iii) process conformity. Applied to 3-billion-parameter LVLMs, Chart-RVR consistently outperforms standard supervised fine-tuning (SFT) on both in-distribution and out-of-distribution datasets, closing the OOD performance gap while improving rationale fidelity. The resulting models, the Chart-RVR-3B series, achieve state-of-the-art results on six chart-reasoning benchmarks spanning in-domain and OOD settings, surpassing all existing models of comparable size. Beyond accuracy, Chart-RVR yields more interpretable CoT rationales, strengthening trust and reliability - showcasing the power of verifiable rewards with GRPO for training reliable, interpretable chart-reasoning models.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 39 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
17 of 39 references.
Closest ancestors · 5
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2023ChartBench: A Benchmark for Complex Visual Reasoning in Charts26 Dec
Other references · 12
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemma 3 Technical Reportcited by 1,824
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
- 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
- 2025Boosting Chart-to-Code Generation in MLLM via Dual Preference-Guided Refinementcited by 11
- 2025ChartQA-X: Generating Explanations for Visual Chart Reasoningcited by 10
- 2025SCI-Reason: A Dataset with Chain-of-Thought Rationales for Complex Multimodal Reasoning in Academic Areascited by 5
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026RubiCap: Rubric-Guided Reinforcement Learning for Dense Image Captioningcited by 9
- 2026Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVRcited by 4
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understandingcited by 2
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understandingcited by 1
- 2026Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoningcited by 1
- 2026When Does Consensus Mean Correctness? Measuring the Agreement-Accuracy Coupling with Semantics-Preserving Re-Renderingcited by 0
- 2026Consistency Has a Computable Blind Spot: A Commutation Theory of Label-Free Reliability for Vision-Language Figure Readingcited by 0
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding23 Aug 2026
- 2026Consistency Has a Computable Blind Spot: A Commutation Theory of Label-Free Reliability for Vision-Language Figure Reading6 Aug 2026
- 2026When Does Consensus Mean Correctness? Measuring the Agreement-Accuracy Coupling with Semantics-Preserving Re-Rendering6 Aug 2026
- 2026Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoning1 Jun 2026
- 2026Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR29 May 2026
- 2026Learning More from Less: Exploiting Counterfactuals for Data-Efficient Chart Understanding11 May 2026
- 2026RubiCap: Rubric-Guided Reinforcement Learning for Dense Image Captioning10 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Chart-R1: Chain-of-Thought Supervision and Reinforcement for Advanced Chart Reasoner
- 2026Chart-RL: Policy Optimization Reinforcement Learning for Enhanced Visual Reasoning in Chart Question Answering with Vision Language Models
- 2026Chart-RL: Generalized Chart Comprehension via Reinforcement Learning with Verifiable Rewards
- 2026CharTool: Tool-Integrated Visual Reasoning for Chart Understanding
- 2026Monitorable Chart Reasoning Agents via Verifiable Process Rewards
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch
- 2026Chart Specification: Structural Representations for Incentivizing VLM Reasoning in Chart-to-Code Generation
- 2025BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuning