Decoupling Perception from Reasoning for Hallucination-Resistant Video Understanding
On the map: LLM reasoning → Hallucination detection and mitigation
Abstract (arXiv)
Video Large Language Models improve reasoning over complex videos by generating intermediate reasoning text. However, reliable reasoning depends on accurate video perception. In existing approaches, perception evidence is intertwined with reasoning text, making it difficult to directly supervise the perception process. We argue that reliable supervision requires explicitly separating perception evidence from reasoning so that perception can be verified independently. To supervise perception directly, we propose Decoupled Perception and Logic (DPL), which represents perception as fixed-format evidence units containing timestamps and visual descriptions. This structured representation enables direct extraction of perception content and simplifies alignment between video segments and reward evaluation. Building on DPL, we introduce a perception reward that encourages both hallucination resistance and perception-based reasoning. An Factual-Aware Evaluator (FAE) provides anti-hallucination scores and achieves hallucination evaluation performance comparable to GPT-4o. In addition, we validate reasoning consistency by feeding perception results and questions into a reference model. Experiments show that, by providing reliable process rewards, Video-DPL consistently improves post-training performance at both 3B and 7B scales, while delivering higher data efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 38 of its 41 references that are in the map. First posted on arXiv 23 Nov 2025.
Builds on
38 of 41 references.
Closest ancestors · 2
Same direction, newest first
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Models23 May
- 2025Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigation25 Mar
Other references · 36
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
24 more
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
- 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 135
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
- 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 114
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 93
- 2024VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Modelscited by 90
- 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learningcited by 87
- 2024VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understandingcited by 68
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoningcited by 62
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
- 2025xVerify: Efficient Answer Verifier for Reasoning Model Evaluationscited by 55
- 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 49
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoningcited by 42
- 2025ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shortscited by 41
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 37
- 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 26
- 2025Towards Video Thinking Test: A Holistic Benchmark for Advanced Video Reasoning and Understandingcited by 24
- 2025Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Modelscited by 16
- 2025VIDEOP2R: Video Understanding from Perception to Reasoningcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models
- 2025SEASON: Mitigating Temporal Hallucination in Video Large Language Models via Self-Diagnostic Contrastive Decoding
- 2026Learning to Decode Against Compositional Hallucination in Video Multimodal Large Language Models
- 2025Generate, but Verify: Reducing Hallucination in Vision-Language Models with Retrospective Resampling
- 2026Vision-Language Introspection: Mitigating Overconfident Hallucinations in MLLMs via Interpretable Bi-Causal Steering
- 2024Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence
- 2026Does Playing it Safe Count as Faithfulness? Reassessing LVLM Hallucination Mitigation Methods
- 2026HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models