FLARE: Full-Modality Long-Video Audiovisual Retrieval Benchmark with User-Simulated Queries
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
As video becomes increasingly central to information dissemination and multimodal large language models (MLLMs) continue to advance, evaluating video retrieval has become increasingly important. In realistic search scenarios, this requires matching short user queries to long-form content using both visual and auditory evidence. Yet existing retrieval benchmarks are still dominated by short clips, single modalities, and caption-based evaluation. We introduce FLARE, a full-modality long-video audiovisual retrieval benchmark with user-simulated queries. Built from 399 carefully screened Video-MME videos (10--60 min, 225.4 h) to ensure source quality and diversity, FLARE contains 87,697 clips annotated with vision, audio, and unified audiovisual captions, together with 274,933 user-style queries. Cross-modal queries are further filtered by a hard bimodal constraint, requiring retrieval to fail under either modality alone but succeed when both are combined. FLARE evaluates models under two regimes, caption-based and query-based retrieval, across vision, audio, and unified audiovisual settings. Experiments with 15 representative retrievers show that user-style queries substantially change model behavior, strong caption-based performance does not always transfer to query-based retrieval, and audio--language alignment remains a key bottleneck for unified audiovisual retrieval. Our code and data are released at https://flarebench.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 11 May 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CFVBench: A Comprehensive Video Benchmark for Fine-grained Multimodal Retrieval-Augmented Generation
- 2026VideoStir: Understanding Long Videos via Spatio-Temporally Structured and Intent-Aware RAG
- 2025LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension
- 2025MMMORRF: Multimodal Multilingual Modularized Reciprocal Rank Fusion
- 2026MARQUIS: A Three-Stage Pipeline for Video Retrieval-Augmented Generation
- 2026Where to Focus: Query-Modulated Multimodal Keyframe Selection for Long Video Understanding
- 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding