mlsanityData to 7 Oct 2026

Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models

arXiv 2604.03179 ↗First posted 3 Apr 2026cs.LG cs.AI cs.CVcited by 1

On the map: LLM reasoning → Hallucination detection and mitigation

also in 1 more
Abstract (arXiv)

The recent success of reinforcement learning (RL) in large reasoning models has inspired the growing adoption of RL for post-training Multimodal Large Language Models (MLLMs) to enhance their visual reasoning capabilities. Although many studies have reported improved performance, it remains unclear whether RL training truly enables models to learn from visual information. In this work, we propose the Hallucination-as-Cue Framework, an analytical framework designed to investigate the effects of RL-based post-training on multimodal reasoning models from the perspective of model hallucination. Specifically, we introduce hallucination-inductive, modality-specific corruptions that remove or replace essential information required to derive correct answers, thereby forcing the model to reason by hallucination. By applying these corruptions during both training and evaluation, our framework provides a unique perspective for diagnosing RL training dynamics and understanding the intrinsic properties of datasets. Through extensive experiments and analyses across multiple multimodal reasoning benchmarks, we reveal that the role of model hallucination for RL-training is more significant than previously recognized. For instance, we find that RL post-training under purely hallucination-inductive settings can still significantly improve models' reasoning performance, and in some cases even outperform standard training. These findings challenge prevailing assumptions about MLLM reasoning training and motivate the development of more modality-aware RL-based training designs.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 28 of its 45 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

28 of 45 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM30 May
  2. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Models23 May

Other references · 26

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  7. 2024OpenAI o1 System Cardcited by 1,220
  8. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  9. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
  10. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  11. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  12. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
14 more
  1. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 315
  2. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 209
  3. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
  4. 2025RL's Razor: Why Online Reinforcement Learning Forgets Lesscited by 162
  5. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
  6. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvementcited by 144
  7. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 120
  8. 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentationcited by 86
  9. 2024Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Modelscited by 72
  10. 2026MIRAGE: The Illusion of Visual Understandingcited by 57
  11. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learningcited by 51
  12. 2025VisionThink: Smart and Efficient Vision Language Model via Reinforcement Learningcited by 41
  13. 2025Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Modelscited by 30
  14. 2025Mitigating Hallucinations in Large Vision-Language Models via Entity-Centric Multimodal Preference Optimizationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Seeing Through the Chain: Mitigate Hallucination in Multimodal Reasoning Models via CoT Compression and Contrastive Preference Optimization
  2. 2026HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models
  3. 2025Learning to Reason for Hallucination Span Detection
  4. 2025Are Reasoning Models More Prone to Hallucination?
  5. 2025Reasoning Models Hallucinate More: Factuality-Aware Reinforcement Learning for Large Reasoning Models
  6. 2024Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning
  7. 2026Look Carefully: Adaptive Visual Reinforcements in Multimodal Large Language Models for Hallucination Mitigation
  8. 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models