mlsanityData to 14 Oct 2026

Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention

arXiv 2605.22072 ↗First posted 21 May 2026cs.CL cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for advancing complex reasoning in large language models, and recent work extends RLVR to multimodal large language models (MLLMs). This transfer, however, surfaces a faithfulness challenge: faithful perception of task-relevant visual evidence and faithful use of that evidence during reasoning, leading to unsatisfactory gains on multimodal benchmarks. Specifically, existing perception supervision often operates on textual descriptions rather than natively on image regions, and faithful use is largely overlooked, exposing the perception-reasoning disconnect where correctly perceived evidence is dropped or contradicted during reasoning. To close these gaps, we propose Faithful-MR1, a training framework that anchors and reinforces visual attention to address both halves of faithful multimodal reasoning. The Anchoring stage turns perception into an explicit pre-reasoning subtask, supervising a dedicated <Focus> token's attention directly against image regions rather than through textual descriptions. The Reinforcing stage exposes faithful use through counterfactual image intervention, rewarding answer-correct trajectories that concentrate visual attention where vision causally matters. Extensive experiments demonstrate that Faithful-MR1 outperforms recent multimodal reasoning baselines on both Qwen2.5-VL-Instruct 3B and 7B backbones while using substantially less training data.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 46 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

21 of 46 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul
  2. 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning26 May
  3. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
  4. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  5. 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoning23 Apr
  6. 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation17 Apr
  7. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  8. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar

Other references · 13

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2024OpenAI o1 System Cardcited by 1,244
  9. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  10. 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 445
  11. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 357
  12. 2025Are Reasoning Models More Prone to Hallucination?cited by 64
1 more
  1. 2026HISR: Hindsight Information Modulated Segmental Process Rewards For Multi-turn Agentic Reinforcement Learningcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoning
  2. 2026Credit Where It is Due: Cross-Modality Connectivity Drives Precise Reinforcement Learning for MLLM Reasoning
  3. 2026Reinforcing Multimodal Reasoning via Token-Level Perception-Grounded Advantage Estimation
  4. 2026Visually-Guided Policy Optimization for Multimodal Reasoning
  5. 2026Do MLLMs Really See It: Reinforcing Visual Attention in Multimodal LLMs
  6. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs
  7. 2025Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs
  8. 2025VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Grounding