Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Understanding long-form egocentric videos remains challenging for multimodal large language models (MLLMs) due to limited context length and insufficient grounding of fine-grained visual details. The recently proposed HD-EPIC benchmark highlights these limitations: even strong long-context models achieve relatively low performance across diverse video question answering tasks. In this paper, we propose a unified framework that decouples long-video reasoning into two complementary forms of evidence: semantic evidence and visual evidence. Semantic evidence captures global procedural structure through a coarse-to-fine extraction pipeline, while object-centric visual evidence preserves fine-grained grounding through bounding boxes and visual embeddings. During inference, we formulate reasoning as a query-conditioned evidence retrieval and integration process, dynamically selecting relevant information from both sources. Our approach achieves competitive performance in the HD-EPIC-VQA Challenge across multiple task categories. More broadly, our results demonstrate that explicitly structuring, retrieving, and integrating semantic and visual evidence is critical for effective long-video understanding with MLLMs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 5 of its 10 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
5 of 10 references.
Closest ancestors · 1
Same direction, newest first
Other references · 4
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2026Agentic Very Long Video Understandingcited by 19
- 2025WeDetect: Fast Open-Vocabulary Object Detection as Retrievalcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Frame Selection: Rethinking Long-Video Understanding with MLLMs
- 2025From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-reward Alignment
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling
- 2026Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding
- 2025HLV-1K: A Large-scale Hour-Long Video Benchmark for Time-Specific Long Video Understanding
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding
- 2024Neptune: The Long Orbit to Benchmarking Long Video Understanding