Omni-DeepSearch: A Benchmark for Audio-Driven Omni-Modal Deep Search
Not on the map. Why?
Abstract (arXiv)
Current omni-modal benchmarks mainly evaluate models under settings where multiple modalities are provided simultaneously, while the ability to start from audio alone and actively search for cross-modal evidence remains underexplored. In this paper, we introduce Omni-DeepSearch, a benchmark for audio-driven omni-modal deep search. Given one or more audio clips and a related question, models must infer useful clues from audio, invoke text, image, and video search tools, and perform multi-hop reasoning to produce a short, objective, and verifiable answer. Omni-DeepSearch contains 640 samples across 15 fine-grained categories, covering four retrieval target modalities and four audio content types. A multi-stage filtering pipeline ensures audio dependence, retrieval necessity, visual modality necessity, and answer uniqueness. Experiments on recent closed-source and open-source omni-modal models show that this task remains highly challenging: the strongest evaluated model, Gemini-3-Pro, achieves only 43.44% average accuracy. Further analyses illustrate key bottlenecks in audio entity inference, query formulation, tool-use reliability, multi-hop retrieval, and cross-modal verification. These results highlight audio-driven omni-modal deep search as an important and underexplored direction for future multimodal agents.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
22 of 37 references.
References · 22
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2025Qwen3-Omni Technical Reportcited by 451
- 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 339
- 2026MiMo-V2-Flash Technical Reportcited by 163
- 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 147
- 2026Qwen3.5-Omni Technical Reportcited by 146
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 114
- 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 101
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?cited by 46
- 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
10 more
- 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 18
- 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoningcited by 14
- 2025UNO-Bench: A Unified Benchmark for Exploring the Compositional Law Between Uni-modal and Omni-modal in Omni Modelscited by 12
- 2026DiaDem: Advancing Dialogue Descriptions in Audiovisual Video Captioning for Multimodal Large Language Modelscited by 12
- 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 9
- 2026Do Audio-Visual Large Language Models Really See and Hear?cited by 9
- 2026Omni-Modal Dissonance Benchmark: Systematically Breaking Modality Consensus to Probe Robustness and Calibrated Abstentioncited by 6
- 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Videocited by 5
- 2025Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustnesscited by 3
- 2026OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval
- 2026OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation
- 2026OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models
- 2026AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compression
- 2026Empowering Long-form Omni-modal Understanding with Robust Audio Perception
- 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editing
- 2026OmniScope: Modality-Decoupled Token Compression for Omnimodal Large Language Models
- 2023Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries