HiCrew: Hierarchical Reasoning for Long-Form Video Understanding via Question-Aware Multi-Agent Collaboration
Not on the map. Why?
Abstract (arXiv)
Long-form video understanding remains fundamentally challenged by pervasive spatiotemporal redundancy and intricate narrative dependencies that span extended temporal horizons. While recent structured representations compress visual information effectively, they frequently sacrifice temporal coherence, which is critical for causal reasoning. Meanwhile, existing multi-agent frameworks operate through rigid, pre-defined workflows that fail to adapt their reasoning strategies to question-specific demands. In this paper, we introduce HiCrew, a hierarchical multi-agent framework that addresses these limitations through three core contributions. First, we propose a Hybrid Tree structure that leverages shot boundary detection to preserve temporal topology while performing relevance-guided hierarchical clustering within semantically coherent segments. Second, we develop a Question-Aware Captioning mechanism that synthesizes intent-driven visual prompts to generate precision-oriented semantic descriptions. Third, we integrate a Planning Layer that dynamically orchestrates agent collaboration by adaptively selecting roles and execution paths based on question complexity. Extensive experiments on EgoSchema and NExT-QA validate the effectiveness of our approach, demonstrating strong performance across diverse question types with particularly pronounced gains in temporal and causal reasoning tasks that benefit from our hierarchical structure-preserving design.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 29 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
27 of 29 references.
References · 27
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2024GPT-4o System Cardcited by 4,588
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 546
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2024Long Context Transfer from Language to Visioncited by 515
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
15 more
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 229
- 2022Learning Video Representations from Large Language Modelscited by 205
- 2023A Simple LLM Framework for Long-Range Video Question-Answeringcited by 178
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 138
- 2024EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameterscited by 99
- 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
- 2023HierVL: Learning Hierarchical Video-Language Embeddingscited by 66
- 2024DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models (Exemplified as A Video Agent)cited by 58
- 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understandingcited by 50
- 2024OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquercited by 34
- 2024VideoMamba: Spatio-Temporal Selective State Space Modelcited by 25
- 2025BIMBA: Selective-Scan Compression for Long-Range Video Question Answeringcited by 24
- 2025VideoLucy: Deep Memory Backtracking for Long Video Understandingcited by 22
- 2025Agentic Keyframe Search for Video Question Answeringcited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026VAMR: Multi-Question Agentic Reasoning for Efficient Long-Form Video Understanding
- 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understanding
- 2026Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding
- 2026Scaling Video Understanding via Compact Latent Multi-Agent Collaboration
- 2025VideoMultiAgents: A Multi-Agent Framework for Video Question Answering
- 2025AVATAAR: Agentic Video Answering via Temporal Adaptive Alignment and Reasoning
- 2026Hierarchical Long Video Understanding with Audiovisual Entity Cohesion and Agentic Search
- 2026A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding