mlsanityData to 14 Oct 2026

MuLA-Bench: A Multilingual Long-Form Audio Understanding Benchmark via Multi-Tier Auditing

arXiv 2609.23416 ↗First posted 20 Sep 2026cs.SD cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Long-form audio performance is often summarized by context length and aggregate accuracy, obscuring how language, evidence, and task jointly shape difficulty. We introduce MuLA-Bench: 5,038 open-ended questions over 1,769 in-the-wild recordings totaling 1,377.9 hours, covering 16 languages and eight domains. A balanced Language x Domain semantic track supports controlled comparisons, while a complementary acoustic track preserves naturally occurring non-speech evidence. Evidence-grounded generation, shortcut checks, and language-expert review provide auditable questions without translating a shared source set or injecting target sounds. We evaluate ten audio-language models and conduct pooled diagnostics on a fixed eight-model cohort. Language rankings change across domains and tasks; acoustic-semantic performance gaps vary with the requested operation; and temporal errors can persist after the correct event is identified. Long-range retrieval is comparatively strong, while precise clock alignment and factual grounding of natural acoustic events remain fragile. MuLA-Bench thus exposes conditional failure patterns that a single long-context score does not capture.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 11 references that are in the map. First posted on arXiv 20 Sep 2026.

Builds on

11 of 11 references.

References · 11

  1. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 288
  2. 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 220
  3. 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 128
  4. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mixcited by 117
  5. 2024Benchmarking Open-ended Audio Dialogue Understanding for Large Audio-Language Modelscited by 29
  6. 2025Listening Between the Frames: Bridging Temporal Gaps in Large Audio-Language Modelscited by 8
  7. 2026ChronosAudio: A Comprehensive Long-Audio Benchmark for Evaluating Audio-Large Language Modelscited by 5
  8. 2026LongSpeech: A Scalable Benchmark for Transcription, Translation and Understanding in Long Speechcited by 5
  9. 2026SCENEBench: An Audio Understanding Benchmark Grounded in Assistive and Industrial Use Casescited by 3
  10. 2026LongAudioSpan: Spanning the Duration and Depth of Audio Comprehensioncited by 2
  11. 2026VoiceGiraffe: A Benchmark for Extreme Long-Context Audio-Language Understandingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.