MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding
Not on the map. Why?
Abstract (arXiv)
The dominant paradigm in video retrieval relies on embedding-based full-corpus scanning, which suffers from inherent computational inefficiency and the semantic asymmetry between information-dense videos and sparse textual queries. To bridge this gap, we introduce MAVIS, a novel multi-agent framework that rethinks retrieval as cooperative reasoning rather than brute-force search. MAVIS first bridges the granularity mismatch by parsing raw videos into a Structured Semantic Library, enabling explicit attribute-level indexing. During retrieval, a planner decomposes complex user intents into atomic sub-tasks, dispatching specialized agents to independently nominate candidates. Crucially, MAVIS employs a Logic-aware Debate mechanism with a strict veto protocol, where agents collaboratively prune logical mismatches to identify a compact set of ``controversial'' candidates for fine-grained verification. This agentic workflow effectively bypasses the inefficiency of full-library traversal. Extensive experiments on MSR-VTT, MSVD, and ActivityNet demonstrate that MAVIS achieves competitive performance without task-specific fine-tuning, offering a scalable and interpretable alternative to traditional dual-encoder approaches.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
22 of 41 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2017Dense-Captioning Events in Videoscited by 789
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
- 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 279
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 278
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
- 2023VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Datasetcited by 168
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 134
- 2024VideoPrism: A Foundational Visual Encoder for Video Understandingcited by 103
10 more
- 2023Vita-CLIP: Video and text adaptive CLIP via Multimodal Promptingcited by 90
- 2025LVAgent: Long Video Understanding by Multi-Round Dynamical Collaboration of MLLM Agentscited by 58
- 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
- 2024CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarioscited by 53
- 2023Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignmentcited by 31
- 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 16
- 2024MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipelinecited by 9
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 9
- 2025When Eyes and Ears Disagree: Can MLLMs Discern Audio-Visual Confusion?cited by 7
- 2026Retrieving to Recover: Towards Incomplete Audio-Visual Question Answering via Semantic-consistent Purificationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Adaptive Multi-Agent Reasoning for Text-to-Video Retrieval
- 2026VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
- 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understanding
- 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoning
- 2026VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking
- 2026RACER: Reflective Agent Coupling Query Interpretation and Tool-Based Retrieval for Frame Selection in Long Video Understanding
- 2025MASR: Self-Reflective Reasoning through Multimodal Hierarchical Attention Focusing for Agent-based Video Understanding
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding