mlsanityData to 7 Oct 2026

Omni-DeepSearch: A Benchmark for Audio-Driven Omni-Modal Deep Search

arXiv 2605.08762 ↗First posted 9 May 2026cs.SD cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Current omni-modal benchmarks mainly evaluate models under settings where multiple modalities are provided simultaneously, while the ability to start from audio alone and actively search for cross-modal evidence remains underexplored. In this paper, we introduce Omni-DeepSearch, a benchmark for audio-driven omni-modal deep search. Given one or more audio clips and a related question, models must infer useful clues from audio, invoke text, image, and video search tools, and perform multi-hop reasoning to produce a short, objective, and verifiable answer. Omni-DeepSearch contains 640 samples across 15 fine-grained categories, covering four retrieval target modalities and four audio content types. A multi-stage filtering pipeline ensures audio dependence, retrieval necessity, visual modality necessity, and answer uniqueness. Experiments on recent closed-source and open-source omni-modal models show that this task remains highly challenging: the strongest evaluated model, Gemini-3-Pro, achieves only 43.44% average accuracy. Further analyses illustrate key bottlenecks in audio entity inference, query formulation, tool-use reliability, multi-hop retrieval, and cross-modal verification. These results highlight audio-driven omni-modal deep search as an important and underexplored direction for future multimodal agents.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

22 of 37 references.

References · 22

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  2. 2025Qwen2.5-Omni Technical Reportcited by 704
  3. 2025Qwen3-Omni Technical Reportcited by 451
  4. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 339
  5. 2026MiMo-V2-Flash Technical Reportcited by 163
  6. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 147
  7. 2026Qwen3.5-Omni Technical Reportcited by 146
  8. 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 114
  9. 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 101
  10. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
  11. 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?cited by 46
  12. 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
10 more
  1. 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 18
  2. 2026Watching, Reasoning, and Searching: A Video Deep Research Benchmark on Open Web for Agentic Video Reasoningcited by 14
  3. 2025UNO-Bench: A Unified Benchmark for Exploring the Compositional Law Between Uni-modal and Omni-modal in Omni Modelscited by 12
  4. 2026DiaDem: Advancing Dialogue Descriptions in Audiovisual Video Captioning for Multimodal Large Language Modelscited by 12
  5. 2025Video-Browser: Towards Agentic Open-web Video Browsingcited by 9
  6. 2026Do Audio-Visual Large Language Models Really See and Hear?cited by 9
  7. 2026Omni-Modal Dissonance Benchmark: Systematically Breaking Modality Consensus to Probe Robustness and Calibrated Abstentioncited by 6
  8. 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Videocited by 5
  9. 2025Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustnesscited by 3
  10. 2026OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval
  2. 2026OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation
  3. 2026OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models
  4. 2026AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compression
  5. 2026Empowering Long-form Omni-modal Understanding with Robust Audio Perception
  6. 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editing
  7. 2026OmniScope: Modality-Decoupled Token Compression for Omnimodal Large Language Models
  8. 2023Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries