A Survey of Large Audio Language Models: Generalization, Trustworthiness, and Outlook
Not on the map. Why?
Abstract (arXiv)
Advances in Large Language Models (LLMs) have paved the way for Multimodal Large Language Models (MLLMs). Among these, Large Audio Language Models (LALMs) are essential for realizing universal auditory intelligence. Despite their remarkable performance, the escalation of LALMs' capabilities has significantly outpaced the development of systemic frameworks to ensure their trustworthiness. This survey provides a comprehensive investigation into the endogenous mechanisms of LALMs, detailing the architectural innovations and alignment algorithms that facilitate emergent reasoning. Specifically, we analyze how the transition to unified end-to-end frameworks and the integration of continuous acoustic signals expand the attack surface. To rigorously evaluate the risks within these paradigms, we establish a comprehensive taxonomy of trustworthiness, categorizing critical vulnerabilities such as cross-modal jailbreaking, latent acoustic backdoors, and biometric privacy leakage. We review the state-of-the-art LALMs through six analytical pillars: hallucination, robustness, safety, privacy, fairness, and authentication. The pronounced imbalance between a mature offensive landscape and underdeveloped defenses highlights persistent trustworthiness gaps and multidimensional risks in audio-centric intelligence. Finally, we propose a roadmap advocating for ``Defense-in-Depth'' architectures, causal auditory world modeling, and intrinsic representation engineering to support the development of more reliable and trustworthy audio intelligence. Our project has been uploaded to GitHub https://github.com/Kwwwww74/Awesome-Trustworthy-AudioLLMs.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 May 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026X3-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignmentcited by 3
- 2026TouchThinker: Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representationcited by 2
- 2026MISHAP-Bench: A Hallucination Benchmark for Large Audio-Language Modelscited by 0
- 2026SafeEvo: Deciphering the Safety Alignment Mechanism and Evolution in Language Modelscited by 0
- 2026From Acoustic Sensing to Physical Actions: A Comprehensive Survey of Security Risks in Edge-Deployed Audio LLM-Based Agentscited by 0
- 2026From Acoustic Sensing to Physical Actions: A Comprehensive Survey of Security Risks in Edge-Deployed Audio LLM-Based Agents11 Oct 2026
- 2026SafeEvo: Deciphering the Safety Alignment Mechanism and Evolution in Language Models7 Oct 2026
- 2026MISHAP-Bench: A Hallucination Benchmark for Large Audio-Language Models27 Sep 2026
- 2026X3-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment23 Jul 2026
- 2026TouchThinker: Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation10 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation
- 2025ALMGuard: Safety Shortcuts and Where to Find Them as Guardrails for Audio-Language Models
- 2025Jailbreak-AudioBench: In-Depth Evaluation and Analysis of Jailbreak Threats for Large Audio Language Models
- 2025"I am bad": Interpreting Stealthy, Universal and Robust Audio Jailbreaks in Audio-Language Models
- 2025Multilingual and Multi-Accent Jailbreaking of Audio LLMs
- 2025Hidden in the Noise: Unveiling Backdoors in Audio LLMs Alignment through Latent Acoustic Pattern Triggers
- 2025Investigating Safety Vulnerabilities of Large Audio-Language Models Under Speaker Emotional Variations
- 2025Breaking Audio Large Language Models by Attacking Only the Encoder: A Universal Targeted Latent-Space Audio Attack