mlsanityData to 7 Oct 2026

Multi-Domain Audio Question Answering Benchmark Toward Acoustic Content Reasoning

arXiv 2505.07365 ↗First posted 12 May 2025cs.SD cs.AI cs.CLcited by 5

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

We present Task 5 of the DCASE 2025 Challenge: an Audio Question Answering (AQA) benchmark spanning multiple domains of sound understanding. This task defines three QA subsets (Bioacoustics, Temporal Soundscapes, and Complex QA) to test audio-language models on interactive question-answering over diverse acoustic scenes. We describe the dataset composition (from marine mammal calls to soundscapes and complex real-world clips), the evaluation protocol (top-1 accuracy with answer-shuffling robustness), and baseline systems (Qwen2-Audio-7B, AudioFlamingo 2, Gemini-2-Flash). Preliminary results on the development set are compared, showing strong variation across models and subsets. This challenge aims to advance the audio understanding and reasoning capabilities of audio-language models toward human-level acuity, which are crucial for enabling AI agents to perceive and interact about the world effectively.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 26 references that are in the map. First posted on arXiv 12 May 2025.

Builds on

18 of 26 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities6 Mar
  2. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark24 Oct
  3. 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities17 Jun

Other references · 15

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2023Qwen Technical Reportcited by 3,273
  4. 2024Qwen2-Audio Technical Reportcited by 543
  5. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
  6. 2023Pengi: An Audio Language Model for Audio Taskscited by 217
  7. 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
  8. 2024Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilitiescited by 183
  9. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144
  10. 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 124
  11. 2023Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Promptingcited by 71
  12. 2019A multi-room reverberant dataset for sound event localization and detectioncited by 18
3 more
  1. 2019The NIGENS General Sound Events Databasecited by 8
  2. 2024A decade of DCASE: Achievements, practices, evaluations and future challengescited by 7
  3. 2024Overview of the L3DAS23 Challenge on Audio-Visual Extended Realitycited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Audiopedia: Audio QA with Knowledge
  2. 2025Audio Question Answering with GRPO-Based Fine-Tuning and Calibrated Segment-Level Predictions
  3. 2026Multi-Source Evidence Fusion for Audio Question Answering
  4. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  5. 2025CMDAR: A Chinese Multi-scene Dynamic Audio Reasoning Benchmark with Diverse Challenges
  6. 2025Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understanding
  7. 2024Enhancing Temporal Understanding in Audio Question Answering for Large Audio Language Models
  8. 2026SEABED: SouthEast Asian Benchmark for Evaluating Audio Reasoning