Monitorable Chart Reasoning Agents via Verifiable Process Rewards
On the map: LLM reasoning → Reasoning for agents, planning and code also fits: Reinforcement learning for reasoning
also in 1 more
Abstract (arXiv)
Chart reasoning agents are increasingly used to extract actionable insights in critical domains, achieving state-of-the-art performance on multiple benchmarks. Yet, high benchmark accuracy alone is insufficient for deployment, where stakeholders must be able to audit and verify how a model reaches its answer. Existing LVLM-based chart agents produce either answer-only predictions or free-form rationales that are hard to verify, obscuring whether an error arose from misreading the chart, extracting a wrong value, or miscomputing. We propose Chart-RVR, a reinforcement learning framework for training monitorable chart agents with verifiable process rewards. Chart-RVR decomposes chart reasoning into three auditable blocks: Structure, identifying the chart type; Evidence, reconstructing the underlying data table in JSON; and Derivation, exposing the stepwise trace that computes the answer. Across six in-domain and out-of-domain benchmarks, Chart-RVR attains state-of-the-art accuracy among comparable-sized LVLMs. Beyond accuracy, we assess monitorability using a triangulated protocol that combines ground-truth surrogate metrics, an oracle information-gain measure, and an LLM-as-auditor scoring Process Verifiability and Evidence Localization, showing that Chart-RVR yields rationales that are markedly more verifiable and evidence-grounded than those from CoT prompting, SFT, and existing chart-specific baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 44 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
19 of 44 references.
References · 19
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2023ChartBench: A Benchmark for Complex Visual Reasoning in Chartscited by 120
- 2024Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoningcited by 110
7 more
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
- 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
- 2025Monitoring Monitorabilitycited by 58
- 2025BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuningcited by 13
- 2025ChartQA-X: Generating Explanations for Visual Chart Reasoningcited by 10
- 2025SCI-Reason: A Dataset with Chain-of-Thought Rationales for Complex Multimodal Reasoning in Academic Areascited by 5
- 2026Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Chart-RVR: Reinforcement Learning with Verifiable Rewards for Explainable Chart Reasoning
- 2025Chart-R1: Chain-of-Thought Supervision and Reinforcement for Advanced Chart Reasoner
- 2026CharTool: Tool-Integrated Visual Reasoning for Chart Understanding
- 2026Chart-RL: Generalized Chart Comprehension via Reinforcement Learning with Verifiable Rewards
- 2026Chart-RL: Policy Optimization Reinforcement Learning for Enhanced Visual Reasoning in Chart Question Answering with Vision Language Models
- 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch
- 2026VeriGraph: Towards Verifiable Data-Analytic Agents
- 2026AlphaDiana: A Measurement System for Agents in Verifiable Reasoning Tasks