mlsanityData to 14 Oct 2026

Decoupling Perception from Reasoning for Hallucination-Resistant Video Understanding

arXiv 2511.18463 ↗First posted 23 Nov 2025cs.CVcited by 0

On the map: LLM reasoning → Hallucination detection and mitigation

Abstract (arXiv)

Video Large Language Models improve reasoning over complex videos by generating intermediate reasoning text. However, reliable reasoning depends on accurate video perception. In existing approaches, perception evidence is intertwined with reasoning text, making it difficult to directly supervise the perception process. We argue that reliable supervision requires explicitly separating perception evidence from reasoning so that perception can be verified independently. To supervise perception directly, we propose Decoupled Perception and Logic (DPL), which represents perception as fixed-format evidence units containing timestamps and visual descriptions. This structured representation enables direct extraction of perception content and simplifies alignment between video segments and reward evaluation. Building on DPL, we introduce a perception reward that encourages both hallucination resistance and perception-based reasoning. An Factual-Aware Evaluator (FAE) provides anti-hallucination scores and achieves hallucination evaluation performance comparable to GPT-4o. In addition, we validate reasoning consistency by feeding perception results and questions into a reference model. Experiments show that, by providing reliable process rewards, Video-DPL consistently improves post-training performance at both 3B and 7B scales, while delivering higher data efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 38 of its 41 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

38 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Models23 May
  2. 2025Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigation25 Mar

Other references · 36

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  7. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  8. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  10. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
  11. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
  12. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
24 more
  1. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  2. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
  3. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
  4. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
  5. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
  6. 2023Can I Trust Your Answer? Visually Grounded Video Question Answeringcited by 135
  7. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
  8. 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 114
  9. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 93
  10. 2024VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Modelscited by 90
  11. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learningcited by 87
  12. 2024VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understandingcited by 68
  13. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
  14. 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoningcited by 62
  15. 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 61
  16. 2025xVerify: Efficient Answer Verifier for Reasoning Model Evaluationscited by 55
  17. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidencecited by 49
  18. 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoningcited by 42
  19. 2025ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shortscited by 41
  20. 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 37
  21. 2025ReWatch-R1: Boosting Complex Video Reasoning in Large Vision-Language Models through Agentic Data Synthesiscited by 26
  22. 2025Towards Video Thinking Test: A Holistic Benchmark for Advanced Video Reasoning and Understandingcited by 24
  23. 2025Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Modelscited by 16
  24. 2025VIDEOP2R: Video Understanding from Perception to Reasoningcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models
  2. 2025SEASON: Mitigating Temporal Hallucination in Video Large Language Models via Self-Diagnostic Contrastive Decoding
  3. 2026Learning to Decode Against Compositional Hallucination in Video Multimodal Large Language Models
  4. 2025Generate, but Verify: Reducing Hallucination in Vision-Language Models with Retrospective Resampling
  5. 2026Vision-Language Introspection: Mitigating Overconfident Hallucinations in MLLMs via Interpretable Bi-Causal Steering
  6. 2024Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence
  7. 2026Does Playing it Safe Count as Faithfulness? Reassessing LVLM Hallucination Mitigation Methods
  8. 2026HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models