Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation
On the map: LLM safety and security → Audio jailbreaks and speech backdoors
Abstract (arXiv)
Large Audio Language Models (LALMs) expand jailbreak risks from token-level prompting to the full speech perception-to-reasoning pipeline, where unsafe behavior can be induced through semantics, acoustic style, signal artifacts, or internal representations. Existing work studies these risks under heterogeneous threat models and evaluation protocols, making it difficult to compare attack practicality or defense utility. This paper provides a unified taxonomy and a controlled empirical evaluation of LALM jailbreak attacks and defenses. We organize prior work into semantic, acoustic, signal, and embedding-layer attacks; guard-based, training-free, and training-based defenses; and cross-modal, audio-native, and interactive benchmarks. We then evaluate representative attacks and defenses across ten open-source LALMs, measuring not only attack success rate but also benign refusal and latency. Our results show that Acoustic Best-of-N reveals strong worst-case audio-space vulnerabilities, Narrative Framing is an effective low-latency semantic threat, and current defenses trade robustness against benign usability. These findings support cost- and utility-aware evaluation as a necessary complement to success-rate-only LALM safety benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio jailbreaks and speech backdoors, one of 12 directions in LLM safety and security. Builds on 57 of its 69 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
57 of 69 references.
Closest ancestors · 17
Same direction, newest first
- 2026Acoustic Interference: A New Paradigm Weaponizing Acoustic Latent Semantic for Universal Jailbreak against Large Audio Language Models18 May
- 2026Sparse Tokens Suffice: Jailbreaking Audio Language Models via Token-Aware Gradient Optimization6 May
- 2026AudioGuard: Toward Comprehensive Audio Safety Protection Across Diverse Threat Models10 Apr
- 2025Speech-Audio Compositional Attacks on Multimodal LLMs and Their Mitigation with SALMONN-Guard13 Nov
- 2025ALMGuard: Safety Shortcuts and Where to Find Them as Guardrails for Audio-Language Models30 Oct
- 2025ERIS: Evolutionary Real-world Interference Scheme for Jailbreaking Audio Large Models14 Sep
- 2025When Good Sounds Go Adversarial: Jailbreaking Audio-Language Models with Benign Inputs5 Aug
- 2025Hidden in the Noise: Unveiling Backdoors in Audio LLMs Alignment through Latent Acoustic Pattern Triggers4 Aug
- 2025Audio Jailbreak Attacks: Exposing Vulnerabilities in SpeechGPT in a White-Box Framework24 May
- 2025JALMBench: Benchmarking Jailbreak Vulnerabilities in Audio Language Models23 May
- 2025Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models21 May
- 2025AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Models20 May
5 more
- 2025SPIRIT: Patching Speech Language Models against Jailbreak Attacks18 May
- 2025Multilingual and Multi-Accent Jailbreaking of Audio LLMs1 Apr
- 2025`From Prompt to Perturbation': An Adaptive Framework for Voice-Based Jailbreaks on Audio LLMs2 Feb
- 2025Jailbreak-AudioBench: In-Depth Evaluation and Analysis of Jailbreak Threats for Large Audio Language Models23 Jan
- 2024AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models11 Dec
Other references · 40
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 533
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 364
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 210
- 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 94
28 more
- 2024Best-of-N Jailbreakingcited by 71
- 2025MiDashengLM: Efficient Audio Understanding with General Audio Captionscited by 31
- 2025WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Modelscited by 18
- 2025VoiceAgentBench: Are Voice Assistants ready for agentic tasks?cited by 15
- 2024Speech Retrieval-Augmented Generation without Automatic Speech Recognitioncited by 14
- 2025Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Modelscited by 13
- 2025AudioTrust: Benchmarking the Multifaceted Trustworthiness of Audio Large Language Modelscited by 12
- 2025Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Studycited by 11
- 2026MoshiRAG: Asynchronous Knowledge Retrieval for Full-Duplex Speech Language Modelscited by 11
- 2025SEA: Low-Resource Safety Alignment for Multimodal Large Language Models via Synthetic Embeddingscited by 9
- 2025Attacker's Noise Can Manipulate Your Audio-based LLM in the Real Worldcited by 8
- 2024Who Can Withstand Chat-Audio Attacks? An Evaluation Benchmark for Large Audio-Language Modelscited by 6
- 2025SARSteer: Safeguarding Large Audio-Language Models via Safe-Ablated Refusal Steeringcited by 6
- 2025ARGUS: Defending Against Multimodal Indirect Prompt Injection via Steering Instruction-Following Behaviorcited by 6
- 2025DuplexMamba: Enhancing Real-time Speech Conversations with Duplex and Streaming Capabilitiescited by 5
- 2025ShieldVLM: Safeguarding the Multimodal Implicit Toxicity via Deliberative Reasoning with LVLMscited by 5
- 2025Universal Acoustic Adversarial Attacks for Flexible Control of Speech-LLMscited by 5
- 2026Now You Hear Me: Audio Narrative Attacks Against Large Audio-Language Modelscited by 5
- 2025Reshaping Representation Space to Balance the Safety and Over-rejection in Large Audio Language Modelscited by 4
- 2025StyleBreak: Revealing Alignment Vulnerabilities in Large Audio-Language Models via Style-Aware Audio Jailbreakcited by 4
- 2026LALM-as-a-Judge: Benchmarking Large Audio-Language Models for Safety Evaluation in Multi-Turn Spoken Dialoguescited by 4
- 2025Protect: Towards Robust Guardrailing Stack for Trustworthy Enterprise LLM Systemscited by 3
- 2025Breaking Audio Large Language Models by Attacking Only the Encoder: A Universal Targeted Latent-Space Audio Attackcited by 3
- 2024Controlling Whisper: Universal Acoustic Adversarial Attacks to Control Speech Foundation Modelscited by 2
- 2025SmoothGuard: Defending Multimodal Large Language Models with Noise Perturbation and Clustering Aggregationcited by 2
- 2025Beyond Text: Multimodal Jailbreaking of Vision-Language and Audio Models through Perceptually Simple Transformationscited by 1
- 2026SoundBreak: A Systematic Study of Audio-Only Adversarial Attacks on Trimodal Modelscited by 1
- 2026VoiceSHIELD-Small: Real-Time Malicious Speech Detection and Transcriptioncited by 1
Built on by
Not cited yet.