mlsanityData to 14 Oct 2026

Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMs

arXiv 2603.13847 ↗First posted 14 Mar 2026cs.CR cs.AI cs.SDcited by 1

On the map: LLM safety and security → Audio jailbreaks and speech backdoors

Abstract (arXiv)

Speech-driven large language models (LLMs) are increasingly accessed through speech interfaces, introducing new security risks via open acoustic channels. We present Sirens' Whisper (SWhisper), the first practical framework for covert prompt-based attacks against speech-driven LLMs under realistic black-box conditions using commodity hardware. SWhisper enables robust, inaudible delivery of arbitrary target baseband audio-including long and structured prompts-on commodity devices by encoding it into near-ultrasound waveforms that demodulate faithfully after acoustic transmission and microphone nonlinearity. This is achieved through a simple yet effective approach to modeling nonlinear channel characteristics across devices and environments, combined with lightweight channel-inversion pre-compensation. Building on this high-fidelity covert channel, we design a voice-aware jailbreak generation method that ensures intelligibility, brevity, and transferability under speech-driven interfaces. Experiments across both commercial and open-source speech-driven LLMs demonstrate strong black-box effectiveness. On commercial models, SWhisper achieves up to 0.94 non-refusal (NR) and 0.925 specific-convincing (SC). A controlled user study further shows that the injected jailbreak audio is perceptually indistinguishable from background-only playback for human listeners. Although jailbreaks serve as a case study, the underlying covert acoustic channel enables a broader class of high-fidelity prompt-injection and commandexecution attacks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Audio jailbreaks and speech backdoors, one of 12 directions in LLM safety and security. Builds on 34 of its 57 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

34 of 57 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models11 Dec

Other references · 33

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2023Mistral 7Bcited by 3,164
  3. 2025Gemma 3 Technical Reportcited by 1,824
  4. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  5. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  6. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  7. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  8. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  9. 2025Qwen2.5-Omni Technical Reportcited by 736
  10. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  11. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 486
  12. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
21 more
  1. 2024A StrongREJECT for Empty Jailbreakscited by 385
  2. 2023Low-Resource Languages Jailbreak GPT-4cited by 309
  3. 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 224
  4. 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbotscited by 183
  5. 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Modelscited by 110
  6. 2024Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstructioncited by 107
  7. 2024Soft Prompt Threats: Attacking Safety Alignment and Unlearning in Open-Source LLMs through the Embedding Spacecited by 91
  8. 2024Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Modelscited by 86
  9. 2017DolphinAtack: Inaudible Voice Commandscited by 69
  10. 2024Uncovering Safety Risks of Large Language Models through Concept Activation Vectorcited by 67
  11. 2024Speak Out of Turn: Safety Vulnerability of Large Language Models in Multi-turn Dialoguecited by 66
  12. 2022Learning Neural Acoustic Fieldscited by 65
  13. 2024Signed-Prompt: A New Approach to Prevent Prompt Injection Attacks Against LLM-Integrated Applicationscited by 54
  14. 2024Boosting Jailbreak Attack with Momentumcited by 40
  15. 2018Fooling End-to-end Speaker Verification by Adversarial Examplescited by 39
  16. 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulationcited by 33
  17. 2024Faster-GCG: Efficient Discrete Optimization Jailbreak Attacks against Aligned Large Language Modelscited by 25
  18. 2025Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Reportcited by 23
  19. 2023Inaudible Adversarial Perturbation: Manipulating the Recognition of User Speech in Real Timecited by 8
  20. 2024Resource Allocation for Stable LLM Training in Mobile Edge Computingcited by 7
  21. 2020Cascaded all-pass filters with randomized center frequencies and phase polarity for acoustic and speech measurement and data augmentationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025`From Prompt to Perturbation': An Adaptive Framework for Voice-Based Jailbreaks on Audio LLMs
  2. 2025AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Models
  3. 2025Multilingual and Multi-Accent Jailbreaking of Audio LLMs
  4. 2026GRM: Utility-Aware Jailbreak Attacks on Audio LLMs via Gradient-Ratio Masking
  5. 2026Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation
  6. 2026Sparse Tokens Suffice: Jailbreaking Audio Language Models via Token-Aware Gradient Optimization
  7. 2026A Survey of Large Audio Language Models: Generalization, Trustworthiness, and Outlook
  8. 2025ALMGuard: Safety Shortcuts and Where to Find Them as Guardrails for Audio-Language Models