mlsanityData to 14 Oct 2026

Chart Deep Research in LVLMs via Parallel Relative Policy Optimization

arXiv 2603.06677 ↗First posted 3 Mar 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

With the rapid advancement of data science, charts have evolved from simple numerical presentation tools to essential instruments for insight discovery and decision-making support. However, current chart data intelligence exhibits significant limitations in deep research capabilities, with existing methods predominantly addressing shallow tasks such as visual recognition or factual question-answering, rather than the complex reasoning and high-level data analysis that deep research requires. This limitation stems from two primary technical bottlenecks: at the training level, existing post-training techniques exhibit deficiencies in handling multi-dimensional reward signal interference and heterogeneous data gradient conflicts, preventing models from achieving balanced development across multiple capability dimensions; at the evaluation level, current methods remain limited to factual retrieval and basic computation, failing to assess end-to-end analytic reasoning and other deep research capabilities. To address the training challenge, we propose PRPO, which performs parallel optimization across reward dimensions and capability partitioning across data types, effectively disentangling conflicts between heterogeneous data and multi-dimensional reward signals while ensuring optimization stability. For the evaluation challenge, we construct MCDR-Bench based on the ``error uniqueness principle," transforming subjective generation assessment into objective error identification through controllable error injection, enabling quantifiable evaluation of deep research capabilities. Experimental validation confirms that the proposed PRPO and MCDR-Bench jointly establish a unified framework that systematically advances chart deep research through enhanced collaborative training and objective evaluation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 46 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

39 of 46 references.

References · 39

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  9. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  10. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  11. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  12. 2025Group Sequence Policy Optimizationcited by 835
27 more
  1. 2021Tabular Data: Deep Learning is Not All You Needcited by 535
  2. 2021InfographicVQAcited by 437
  3. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  4. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  5. 2019PlotQA: Reasoning over Scientific Plotscited by 321
  6. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
  7. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  8. 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 169
  9. 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
  10. 2023ChartBench: A Benchmark for Complex Visual Reasoning in Chartscited by 120
  11. 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 112
  12. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 108
  13. 2024ChartGemma: Visual Instruction-tuning for Chart Reasoning in the Wildcited by 79
  14. 2024ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understandingcited by 46
  15. 2025SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Rewardcited by 45
  16. 2024Multimodal Table Understandingcited by 44
  17. 2025RePO: Replay-Enhanced Policy Optimizationcited by 39
  18. 2022Chart Question Answering: State of the Art and Future Directionscited by 26
  19. 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
  20. 2025InfoChartQA: A Benchmark for Multimodal Question Answering on Infographic Chartscited by 17
  21. 2025ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understandingcited by 13
  22. 2025ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answeringcited by 13
  23. 2025ExPO: Unlocking Hard Reasoning with Self-Explanation-Guided Reinforcement Learningcited by 13
  24. 2024mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoningcited by 9
  25. 2024Knowledge-Aware Reasoning over Multimodal Semi-structured Tablescited by 9
  26. 2025MMTABREAL: Real-World Benchmark for Multimodal Table Understandingcited by 9
  27. 2022Dashboard Design Patternscited by 4

Built on by

Not cited yet.