See What You Need: Query-Aware Visual Intelligence through Reasoning-Perception Loops
Not on the map. Why?
Abstract (arXiv)
Human video comprehension demonstrates dynamic coordination between reasoning and visual attention, adaptively focusing on query-relevant details. However, current long-form video question answering systems employ rigid pipelines that decouple reasoning from perception, leading to either information loss through premature visual abstraction or computational inefficiency through exhaustive processing. The core limitation lies in the inability to adapt visual extraction to specific reasoning requirements, different queries demand fundamentally different visual evidence from the same video content. In this work, we present CAVIA, a training-free framework that revolutionizes video understanding through reasoning, perception coordination. Unlike conventional approaches where visual processing operates independently of reasoning, CAVIA creates a closed-loop system where reasoning continuously guides visual extraction based on identified information gaps. CAVIA introduces three innovations: (1) hierarchical reasoning, guided localization to precise frames; (2) cross-modal semantic bridging for targeted extraction; (3) confidence-driven iterative synthesis. CAVIA achieves state-of-the-art performance on challenging benchmarks: EgoSchema (65.7%, +5.3%), NExT-QA (76.1%, +2.6%), and IntentQA (73.8%, +6.9%), demonstrating that dynamic reasoning-perception coordination provides a scalable paradigm for video understanding.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 25 Aug 2025.
Builds on
22 of 32 references.
References · 22
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
- 2023Self-Chained Image-Language Model for Video Localization and Question Answeringcited by 203
- 2023A Simple LLM Framework for Long-Range Video Question-Answeringcited by 178
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 169
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 153
- 2024Efficient Multimodal Large Language Models: A Surveycited by 96
10 more
- 2024DrVideo: Document Retrieval Based Long Video Understandingcited by 65
- 2023Large Language Models are Temporal and Causal Reasoners for Video Question Answeringcited by 51
- 2024Memory Consolidation Enables Long-Context Video Understandingcited by 45
- 2023A Simple Recipe for Contrastively Pre-training Video-First Encoders Beyond 16 Framescited by 34
- 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMscited by 29
- 2024FMA-Net: Flow-Guided Dynamic Filtering and Iterative Feature Refinement with Multi-Attention for Joint Video Super-Resolution and Deblurringcited by 28
- 2023Accurate and Fast Compressed Video Captioningcited by 22
- 2025∞-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory Consolidationcited by 14
- 2024A-VL: Adaptive Attention for Large Vision-Language Modelscited by 7
- 2024STAIR: Spatial-Temporal Reasoning with Auditable Intermediate Results for Video Question Answeringcited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.