Seeing Through the Chain: Mitigate Hallucination in Multimodal Reasoning Models via CoT Compression and Contrastive Preference Optimization
On the map: LLM reasoning → Hallucination detection and mitigation
also in 1 more
Abstract (arXiv)
While multimodal reasoning models (MLRMs) have exhibited impressive capabilities, they remain prone to hallucinations, and effective solutions are still underexplored. In this paper, we experimentally analyze the hallucination cause and propose C3PO, a training-based mitigation framework comprising Chain-of-Thought Compression and Contrastive Preference Optimization. Firstly, we identify that introducing reasoning mechanisms exacerbates models' reliance on language priors while overlooking visual inputs, which can produce CoTs with reduced visual cues but redundant text tokens. To this end, we propose to selectively filter redundant thinking tokens for a more compact and signal-efficient CoT representation that preserves task-relevant information while suppressing noise. In addition, we observe that the quality of the reasoning trace largely determines whether hallucination emerges in subsequent responses. To leverage this insight, we introduce a reasoning-enhanced preference tuning scheme that constructs training pairs using high-quality AI feedback. We further design a multimodal hallucination-inducing mechanism that elicits models' inherent hallucination patterns via carefully crafted inducers, yielding informative negative signals for contrastive correction. We provide theoretical justification for the effectiveness and demonstrate consistent hallucination reduction across diverse MLRMs and benchmarks.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 43 of its 47 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
43 of 47 references.
Closest ancestors · 3
Same direction, newest first
- 2025MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM30 May
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Models23 May
- 2024Mitigating Object Hallucination via Concentric Causal Attention21 Oct
Other references · 40
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2016Deep Variational Information Bottleneckcited by 915
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
28 more
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
- 2018Object Hallucination in Image Captioningcited by 661
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
- 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 468
- 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
- 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 404
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 343
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 294
- 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 293
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 246
- 2023Woodpecker: Hallucination Correction for Multimodal Large Language Modelscited by 223
- 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 223
- 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 196
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvementcited by 144
- 2024Improve Vision Language Model Chain-of-thought Reasoningcited by 135
- 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 129
- 2023HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Datacited by 124
- 2023Hallucination Augmented Contrastive Learning for Multimodal Large Language Modelcited by 119
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 112
- 2025Efficient Reasoning Models: A Surveycited by 93
- 2024mDPO: Conditional Preference Optimization for Multimodal Large Language Modelscited by 92
- 2025Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Keycited by 64
- 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resourcescited by 37
- 2025One RL to See Them All: Visual Triple Unified Reinforcement Learningcited by 29
- 2025ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancycited by 17
- 2025Grounding Language with Vision: A Conditional Mutual Information Calibrated Decoding Strategy for Reducing Hallucinations in LVLMscited by 16
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoningcited by 5
- 2026Latent Visual Cache for Video Reasoningcited by 3
- 2026Looking Back and Forth: Cross-Image Attention Calibration and Attentive Preference Learning for Multi-Image Hallucination Mitigationcited by 2
- 2026Reasoning Matters: Mitigate Hallucination in Multimodal Large Reasoning Models via Reasoning-Conditioned Preference Optimizationcited by 2
- 2026MergeHEIR: Mitigating Multimodal Hallucinations as the Tax of Model Mergingcited by 0
- 2026MergeHEIR: Mitigating Multimodal Hallucinations as the Tax of Model Merging26 Sep 2026
- 2026Latent Visual Cache for Video Reasoning1 Jul 2026
- 2026Reasoning Matters: Mitigate Hallucination in Multimodal Large Reasoning Models via Reasoning-Conditioned Preference Optimization27 May 2026
- 2026LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning21 May 2026
- 2026Looking Back and Forth: Cross-Image Attention Calibration and Attentive Preference Learning for Multi-Image Hallucination Mitigation7 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination
- 2026Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models
- 2026Understanding and Mitigating Hallucinations in Multimodal Chain-of-Thought Models
- 2025Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model
- 2026HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models
- 2024VaLiD: Mitigating the Hallucination of Large Vision Language Models by Visual Layer Fusion Contrastive Decoding
- 2026Grounded Post-Training with Hard Examples for Reducing Hallucination in Multimodal Large Language Models
- 2024Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning