mlsanityData to 7 Oct 2026

V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning

arXiv 2608.25580 ↗First posted 26 Aug 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Vision-language models can produce fluent answers that are insufficiently grounded in the visual evidence: a single unsupported object, chart value, or intermediate inference can undermine an otherwise plausible response. We argue that this is a credit-assignment failure in multimodal post-training. Scalar outcome rewards indicate whether an answer is acceptable, but do not identify which visual facts are grounded, which reasoning steps are valid, or which instruction constraints are missed. We introduce Visual Rubrics-Based Reinforcement Learning, which decomposes reference responses into atomic propositions and scores generated answers along Visual Faithfulness (VF), Reasoning Consistency (RC), and Instruction Following (IF). The resulting rubric items provide structured partial credit and localize rubric credit when supporting evidence spans are available. We first obtain an SFT checkpoint by fine-tuning Qwen3-VL-8B-Instruct on the public OpenMMReasoner-SFT-874K corpus, adapting OpenMMReasoner's cold-start data recipe. We construct V-Rubrics 50K, a 50,248-example training set from 17 visually grounded sources, by applying rule-based filters before deriving example difficulty from rejection-sampling scores and then annotating every example with Gemini-3-Pro under the same structured prompt and protocol. We train our model based on the same SFT checkpoint using component-wise, prefix-localized rubric credit. Experiments show that our rubricbased GRPO improves over both the shared SFT baseline and answer-only GRPO, with the largest gains on knowledge-oriented and visually grounded reasoning benchmarks. The results show rubrics as a useful reward abstraction for visual post-training.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 51 of its 73 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

51 of 73 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoning11 Jul
  2. 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Reward8 Jun
  3. 2025R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning5 May
  4. 2025Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration17 Apr
  5. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  6. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar

Other references · 45

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  3. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  4. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  7. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  8. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  9. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  10. 2016A Diagram Is Worth A Dozen Imagescited by 793
  11. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
  12. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
33 more
  1. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  2. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  3. 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 431
  4. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  5. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  6. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
  7. 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 293
  8. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
  9. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 240
  10. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  11. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvementcited by 144
  12. 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 129
  13. 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 123
  14. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 112
  15. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 85
  16. 2024Detecting and Mitigating Hallucination in Large Vision Language Models via Fine-Grained AI Feedbackcited by 80
  17. 2024MMInA: Benchmarking Multihop Multimodal Internet Agentscited by 55
  18. 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
  19. 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resourcescited by 37
  20. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
  21. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoningcited by 34
  22. 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoningcited by 32
  23. 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuningcited by 31
  24. 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 31
  25. 2025Skywork-VL Reward: An Effective Reward Model for Multimodal Understanding and Reasoningcited by 30
  26. 2025MM-PRM: Enhancing Multimodal Mathematical Reasoning with Scalable Step-Level Supervisioncited by 28
  27. 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmarkcited by 28
  28. 2023MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteriacited by 27
  29. 2024Mitigating Hallucination in Multimodal Large Language Model via Hallucination-targeted Direct Preference Optimizationcited by 20
  30. 2025ChartGalaxy: A Dataset for Infographic Chart Understanding and Generationcited by 15
  31. 2026Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisitioncited by 8
  32. 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scalingcited by 8
  33. 2026Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Be Faithful When Response: Returning Fluent and Grounded Answers for Vision-Language Models Reinforcement Learning
  2. 2026Rationale Matters: Learning Transferable Rubrics via Proxy-Guided Critique for VLM Reward Models
  3. 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
  4. 2025Reinforcement Learning with Rubric Anchors
  5. 2026Visual sensitivity is not claim retractability: persistence-aware credit assignment for multimodal reinforcement learning
  6. 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoning
  7. 2026Think-with-Rubrics: From External Evaluator to Internal Reasoning Guidance
  8. 2026RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning