RSA-Bench: Benchmarking Audio Large Models in Real-World Acoustic Scenarios
Not on the map. Why?
Abstract (arXiv)
While Audio Large Models (ALMs) have achieved remarkable proficiency, their robustness remains brittle in real-world deployment. Existing evaluations largely rely on synthetic Gaussian noise or simplistic single-source interference, failing to capture the intricate, multi-layered acoustic dynamics -- or ``Acoustic Ecology'' -- that characterize authentic physical environments. To bridge this ecological gap, we introduce RSA-Bench, a comprehensive robustness benchmark designed to stress-test ALLMs through high-fidelity auditory scene simulations. Unlike traditional methods, we construct evaluation samples by naturally superimposing diverse environmental soundscapes -- spanning textitPasture, textitExtreme Weather, textitClassroom, and textitOutdoors -- onto clean speech signals across a spectrum of interference intensities. By evaluating models on six core tasks ranging from fundamental perception to complex reasoning, our study unveils three macro-level insights: (I) The Perception-Cognition Gap: Models maintain relative resilience in low-level recognition but suffer a functional collapse in high-order reasoning tasks under stress; (II) Scenario Sensitivity: ``Vocal-like'' interference (e.g., background laughter) proves significantly more destructive than mechanical noise, challenging the model's auditory attention mechanisms; and (III) The Denoising Paradox: Standard speech enhancement often exacerbates performance degradation, as ALLMs prove highly sensitive to the semantic distortions introduced by denoising artifacts.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Jan 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMscited by 1
- 2026EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillationcited by 0
- 2026Long-Term Memory-Guided Enhancement for Target Perception in Audio-Language Modelscited by 0
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoningcited by 0
- 2026From Acoustic Sensing to Physical Actions: A Comprehensive Survey of Security Risks in Edge-Deployed Audio LLM-Based Agentscited by 0
- 2026From Acoustic Sensing to Physical Actions: A Comprehensive Survey of Security Risks in Edge-Deployed Audio LLM-Based Agents11 Oct 2026
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning30 Sep 2026
- 2026Long-Term Memory-Guided Enhancement for Target Perception in Audio-Language Models29 Sep 2026
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMs29 May 2026
- 2026EchoDistill: Robust Large Audio Language Models via Noisy-to-Clean Self-Distillation11 May 2026