mlsanityData to 14 Oct 2026

Video Evidence to Reasoning Efficient Video Understanding via Explicit Evidence Grounding

arXiv 2601.07761 ↗First posted 12 Jan 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Large Vision-Language Models (LVLMs) face a fundamental dilemma in video reasoning: they are caught between the prohibitive computational costs of verbose reasoning and the hallucination risks of efficient, ungrounded approaches. To resolve this, we introduce the Chain of Evidence (CoE), a novel framework that architecturally decouples and co-optimizes perceptual grounding and reasoning efficiency. CoE incorporates two core innovations: (1) A lightweight Evidence Grounding Module (EGM) that acts as a query-guided filter, dynamically identifying and extracting a compact set of high-fidelity visual evidence; and (2) An Evidence-Anchoring Protocol optimized via Reinforcement Learning. Crucially, we design a composite reward mechanism that enforces process alignment, compelling the model to strictly reference identified temporal anchors during deduction, thereby mitigating hallucinations. To enable this, we construct CoE-Instruct, a large-scale dataset (164k samples) featuring a novel dual-annotation schema for separate perception and reasoning supervision. Extensive experiments on five benchmarks, including Video-MME, MVBench, and VSI-Bench, demonstrate that CoE-enhanced models establish a new state-of-the-art. They significantly outperform existing methods in accuracy, proving CoE to be a powerful and practical paradigm for reliable video understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 19 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

19 of 19 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes11 Jun
  2. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
  3. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection22 Nov
  4. 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Tool7 Jul
  5. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May

Other references · 14

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  8. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  10. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
  11. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  12. 2025M-LLM Based Video Frame Selection for Efficient Video Understandingcited by 88
2 more
  1. 2024EventHallusion: Diagnosing Event Hallucinations in Video LLMscited by 57
  2. 2024VidHal: Benchmarking Temporal Hallucinations in Vision LLMscited by 19

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoning
  2. 2026Chain-of-Glimpse: Search-Guided Progressive Object-Grounded Reasoning for Video Understanding
  3. 2025Conan: Progressive Learning to Reason Like a Detective over Multi-Scale Visual Evidence
  4. 2025TAR: Temporal Anchor-Constrained Reasoning for Video Temporal Grounding
  5. 2025Rethinking Chain-of-Thought Reasoning for Videos
  6. 2026Process-of-Thought Reasoning for Videos
  7. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
  8. 2026H-GRPO: Permutation-Invariant Reinforcement Learning for Grounded Visual Reasoning