SonicBench: Dissecting the Physical Perception Bottleneck in Large Audio Language Models
Not on the map. Why?
Abstract (arXiv)
Large Audio Language Models (LALMs) excel at semantic and paralinguistic tasks, yet their ability to perceive the fundamental physical attributes of audio such as pitch, loudness, and spatial location remains under-explored. To bridge this gap, we introduce SonicBench, a psychophysically grounded benchmark that systematically evaluates 12 core physical attributes across five perceptual dimensions. Unlike previous datasets, SonicBench uses a controllable generation toolbox to construct stimuli for two complementary paradigms: recognition (absolute judgment) and comparison (relative judgment). This design allows us to probe not only sensory precision but also relational reasoning capabilities, a domain where humans typically exhibit greater proficiency. Our evaluation reveals a substantial deficiency in LALMs' foundational auditory understanding; most models perform near random guessing and, contrary to human patterns, fail to show the expected advantage on comparison tasks. Furthermore, explicit reasoning yields minimal gains. However, our linear probing analysis demonstrates crucially that frozen audio encoders do successfully capture these physical cues (accuracy at least 60%), suggesting that the primary bottleneck lies in the alignment and decoding stages, where models fail to leverage the sensory signals they have already captured.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 43 of its 106 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
43 of 106 references.
References · 43
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 652
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 378
- 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 281
- 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 222
- 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
- 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 210
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
31 more
- 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilitiescited by 151
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 127
- 2018AISHELL-2: Transforming Mandarin ASR Research Into Industrial Scalecited by 125
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 101
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 94
- 2023Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioningcited by 77
- 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 75
- 2024A Survey on Speech Large Language Models for Understandingcited by 71
- 2024Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Taskscited by 70
- 2025Baichuan-Audio: A Unified Framework for End-to-End Speech Interactioncited by 68
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 64
- 2025MiMo-Audio: Audio Language Models are Few-Shot Learnerscited by 58
- 2025FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM Integrationcited by 44
- 2024Scaling up masked audio encoder learning for general audio classificationcited by 43
- 2024MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Modelscited by 43
- 2023STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Eventscited by 39
- 2019Learning to Groove with Inverse Sequence Transformationscited by 33
- 2025MiDashengLM: Efficient Audio Understanding with General Audio Captionscited by 31
- 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Modelcited by 30
- 2025ColorBench: Can VLMs See and Understand the Colorful World? A Comprehensive Benchmark for Color Perception, Reasoning, and Robustnesscited by 28
- 2025Mellow: a small audio language model for reasoningcited by 27
- 2019A multi-room reverberant dataset for sound event localization and detectioncited by 18
- 2025Jailbreak-AudioBench: In-Depth Evaluation and Analysis of Jailbreak Threats for Large Audio Language Modelscited by 17
- 2019The LOCATA Challenge: Acoustic Source Localization and Trackingcited by 16
- 2024PicoAudio: Enabling Precise Timestamp and Frequency Controllability of Audio Events in Text-to-audio Generationcited by 12
- 2025OpenOmni: Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-Time Self-Aware Emotional Speech Synthesiscited by 10
- 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligencecited by 10
- 2025Position: Reasoning After Perception Means Reasoning Without Visioncited by 8
- 2025Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understandingcited by 5
- 2025LLaSO: A Foundational Framework for Reproducible Research in Large Language and Speech Modelcited by 3
- 2025WoW-Bench: Evaluating Fine-Grained Acoustic Perception in Audio-Language Models via Marine Mammal Vocalizationscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026A Closer Look at Failure Modes in Temporal Understanding of Large Audio-Language Models
- 2025Bridging Ears and Eyes: Analyzing Audio and Visual Large Language Models to Humans in Visible Sound Recognition and Reducing Their Sensory Gap via Cross-Modal Distillation
- 2025Thinking with Sound: Audio Chain-of-Thought Enables Multimodal Reasoning in Large Audio-Language Models
- 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs
- 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captions
- 2026MRMAD: A Multi-Round Multi-Audio Benchmark for Evaluating Acoustic Degradation Perception in Large Audio-Language Models
- 2025The MUSE Benchmark: Probing Music Perception and Auditory Relational Reasoning in Audio LLMS
- 2026All That Glitters Is Not Audio: Rethinking Text Priors and Audio Reliance in Audio-Language Evaluation