mlsanityData to 7 Oct 2026

Seeing Through the Chain: Mitigate Hallucination in Multimodal Reasoning Models via CoT Compression and Contrastive Preference Optimization

arXiv 2602.03380 ↗First posted 3 Feb 2026cs.CVcited by 5

On the map: LLM reasoning → Hallucination detection and mitigation

also in 1 more
Abstract (arXiv)

While multimodal reasoning models (MLRMs) have exhibited impressive capabilities, they remain prone to hallucinations, and effective solutions are still underexplored. In this paper, we experimentally analyze the hallucination cause and propose C3PO, a training-based mitigation framework comprising Chain-of-Thought Compression and Contrastive Preference Optimization. Firstly, we identify that introducing reasoning mechanisms exacerbates models' reliance on language priors while overlooking visual inputs, which can produce CoTs with reduced visual cues but redundant text tokens. To this end, we propose to selectively filter redundant thinking tokens for a more compact and signal-efficient CoT representation that preserves task-relevant information while suppressing noise. In addition, we observe that the quality of the reasoning trace largely determines whether hallucination emerges in subsequent responses. To leverage this insight, we introduce a reasoning-enhanced preference tuning scheme that constructs training pairs using high-quality AI feedback. We further design a multimodal hallucination-inducing mechanism that elicits models' inherent hallucination patterns via carefully crafted inducers, yielding informative negative signals for contrastive correction. We provide theoretical justification for the effectiveness and demonstrate consistent hallucination reduction across diverse MLRMs and benchmarks.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 43 of its 47 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

43 of 47 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM30 May
  2. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Models23 May
  3. 2024Mitigating Object Hallucination via Concentric Causal Attention21 Oct

Other references · 40

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  7. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  8. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  9. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  10. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  11. 2016Deep Variational Information Bottleneckcited by 915
  12. 2015Deep Learning and the Information Bottleneck Principlecited by 793
28 more
  1. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
  2. 2018Object Hallucination in Image Captioningcited by 661
  3. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
  4. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
  5. 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 468
  6. 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 439
  7. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 404
  8. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
  9. 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 343
  10. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 294
  11. 2023AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination Evaluationcited by 293
  12. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 246
  13. 2023Woodpecker: Hallucination Correction for Multimodal Large Language Modelscited by 223
  14. 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 223
  15. 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 196
  16. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvementcited by 144
  17. 2024Improve Vision Language Model Chain-of-thought Reasoningcited by 135
  18. 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 129
  19. 2023HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Datacited by 124
  20. 2023Hallucination Augmented Contrastive Learning for Multimodal Large Language Modelcited by 119
  21. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 112
  22. 2025Efficient Reasoning Models: A Surveycited by 93
  23. 2024mDPO: Conditional Preference Optimization for Multimodal Large Language Modelscited by 92
  24. 2025Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Keycited by 64
  25. 2025MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resourcescited by 37
  26. 2025One RL to See Them All: Visual Triple Unified Reinforcement Learningcited by 29
  27. 2025ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancycited by 17
  28. 2025Grounding Language with Vision: A Conditional Mutual Information Calibrated Decoding Strategy for Reducing Hallucinations in LVLMscited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination
  2. 2026Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models
  3. 2026Understanding and Mitigating Hallucinations in Multimodal Chain-of-Thought Models
  4. 2025Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model
  5. 2026HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models
  6. 2024VaLiD: Mitigating the Hallucination of Large Vision Language Models by Visual Layer Fusion Contrastive Decoding
  7. 2026Grounded Post-Training with Hard Examples for Reducing Hallucination in Multimodal Large Language Models
  8. 2024Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning