mlsanityData to 7 Oct 2026

MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding

arXiv 2606.09641 ↗First posted 8 Jun 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The dominant paradigm in video retrieval relies on embedding-based full-corpus scanning, which suffers from inherent computational inefficiency and the semantic asymmetry between information-dense videos and sparse textual queries. To bridge this gap, we introduce MAVIS, a novel multi-agent framework that rethinks retrieval as cooperative reasoning rather than brute-force search. MAVIS first bridges the granularity mismatch by parsing raw videos into a Structured Semantic Library, enabling explicit attribute-level indexing. During retrieval, a planner decomposes complex user intents into atomic sub-tasks, dispatching specialized agents to independently nominate candidates. Crucially, MAVIS employs a Logic-aware Debate mechanism with a strict veto protocol, where agents collaboratively prune logical mismatches to identify a compact set of ``controversial'' candidates for fine-grained verification. This agentic workflow effectively bypasses the inefficiency of full-library traversal. Extensive experiments on MSR-VTT, MSVD, and ActivityNet demonstrate that MAVIS achieves competitive performance without task-specific fine-tuning, offering a scalable and interpretable alternative to traditional dual-encoder approaches.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

22 of 41 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  4. 2017Dense-Captioning Events in Videoscited by 789
  5. 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
  6. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
  7. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 279
  8. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 278
  9. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
  10. 2023VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Datasetcited by 168
  11. 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 134
  12. 2024VideoPrism: A Foundational Visual Encoder for Video Understandingcited by 103
10 more
  1. 2023Vita-CLIP: Video and text adaptive CLIP via Multimodal Promptingcited by 90
  2. 2025LVAgent: Long Video Understanding by Multi-Round Dynamical Collaboration of MLLM Agentscited by 58
  3. 2024VCA: Video Curious Agent for Long Video Understandingcited by 54
  4. 2024CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarioscited by 53
  5. 2023Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignmentcited by 31
  6. 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 16
  7. 2024MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipelinecited by 9
  8. 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 9
  9. 2025When Eyes and Ears Disagree: Can MLLMs Discern Audio-Visual Confusion?cited by 7
  10. 2026Retrieving to Recover: Towards Incomplete Audio-Visual Question Answering via Semantic-consistent Purificationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Adaptive Multi-Agent Reasoning for Text-to-Video Retrieval
  2. 2026VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
  3. 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understanding
  4. 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoning
  5. 2026VideoSeek: Long-Horizon Video Agent with Tool-Guided Seeking
  6. 2026RACER: Reflective Agent Coupling Query Interpretation and Tool-Based Retrieval for Frame Selection in Long Video Understanding
  7. 2025MASR: Self-Reflective Reasoning through Multimodal Hierarchical Attention Focusing for Agent-based Video Understanding
  8. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understanding