EvA: An Evidence-First Audio Understanding Paradigm for LALMs
Not on the map. Why?
Abstract (arXiv)
Large Audio Language Models (LALMs) still struggle in complex acoustic scenes because they often fail to preserve task-relevant acoustic evidence before reasoning begins. We identify this error pattern as the evidence bottleneck: state-of-the-art systems show larger deficits in acoustic evidence extraction than in downstream reasoning, suggesting that upstream perception is often the limiting factor. To address this problem, we propose EvA (Evidence-First Audio), a dual-path architecture that enhances acoustic evidence preservation through hierarchical aggregation and non-compressive, time-aligned fusion. We also build EvA-Perception, a large-scale training set with about 54K event-ordered captions and 500K evidence-grounded QA pairs. Under a unified zero-shot protocol, EvA achieves the best open-source Perception results on MMAU, MMAR, and MMSU, with the largest gains on perception-heavy splits. Human evaluation on open-ended captioning further shows improved fine-grained acoustic coverage and caption quality. These results support the evidence-first hypothesis: stronger audio understanding depends on preserving acoustic evidence before reasoning. Project can be found at https://satsuki2486441738.github.io/EvA/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 29 Mar 2026.
Builds on
18 of 26 references.
References · 18
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2019Clotho: An Audio Captioning Datasetcited by 358
- 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 267
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 219
- 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilitiescited by 156
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 103
- 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Modelscited by 95
- 2021The Benefit Of Temporally-Strong Labels In Audio Event Classificationcited by 83
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 65
6 more
- 2022CochlScene: Acquisition of acoustic scene data using crowdsourcingcited by 33
- 2023Auto-ACD: A Large-scale Dataset for Audio-Language Representation Learningcited by 33
- 2023CED: Consistent ensemble distillation for audio taggingcited by 29
- 2024AudioTime: A Temporally-aligned Audio-text Benchmark Datasetcited by 19
- 2024OpenMU: Your Swiss Army Knife for Music Understandingcited by 9
- 2025FusionAudio-1.2M: Towards Fine-grained Audio Captioning with Multimodal Contextual Fusioncited by 6
Built on by
Not cited yet.