mlsanityData to 7 Oct 2026

Piggybacking on Perception: Stealthy Concurrent Audio Prompt Injections against Multimodal LLM Agents

arXiv 2607.28165 ↗First posted 30 Jul 2026cs.CRcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Large Language Model (LLM)-driven multimodal agents are increasingly deployed to execute autonomous tasks via continuous audio interaction. While this paradigm enhances interaction naturalness, it introduces a critical yet under-explored attack surface, as audio inputs inevitably contain environmental noise beyond user control. In this paper, we investigate concurrent audio prompt injection attacks targeting multimodal agents. Distinct from traditional acoustic attacks on voice devices, we propose novel techniques for instruction augmentation and scenario concealment. These methods allow malicious audio instructions to imperceptibly "piggyback" onto user speech, thereby hijacking agents to execute malicious actions. To systematically quantify this threat, we construct AudioAgentSecurity, the first comprehensive benchmark for audio instruction injection attacks, encompassing 8 real-world task scenarios and 10 distinct attack patterns. We evaluate 11 state-of-the-art agents, including Gemini 3 Pro and GPT-4o-audio. Notably, our methods achieve an average Attack Success Rate (ASR) of 69.10% against the advanced Gemini 3 Pro. To counter this threat, we further introduce Cascaded Audio Decoupling and Verification (CADV), a defense mechanism based on source separation and consistency analysis. Compared with existing prompt-level defenses, CADV achieving up to 96% detection accuracy and providing effective protection against a broad range of acoustic injection attacks. Finally, real-world experiments with human volunteers on Doubao AI Smartphone in diverse dynamic real-world scenarios confirm the attacks' high stealth and efficacy, while demonstrating that our defense reliably mitigates these vulnerabilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 49 of its 68 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

49 of 68 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents1 Oct
  2. 2025WebInject: Prompt Injection Attack to Web Agents16 May
  3. 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
  4. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
  5. 2024The Wolf Within: Covert Injection of Malice into MLLM Societies via an MLLM Operative20 Feb

Other references · 44

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  7. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  8. 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
  9. 2025Qwen3-Omni Technical Reportcited by 451
  10. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  11. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
  12. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
32 more
  1. 2018Audio Adversarial Examples: Targeted Attacks on Speech-to-Textcited by 268
  2. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
  3. 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 208
  4. 2024Jailbreaking Attack against Multimodal Large Language Modelcited by 128
  5. 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
  6. 2023Abusing Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMscited by 117
  7. 2022PromptTTS: Controllable Text-to-Speech with Text Descriptionscited by 106
  8. 2026Qwen3-TTS Technical Reportcited by 106
  9. 2025Step-Audio 2 Technical Reportcited by 101
  10. 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
  11. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
  12. 2025MAI-UI Technical Report: Real-World Centric Foundation GUI Agentscited by 88
  13. 2025Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judgecited by 75
  14. 2017DolphinAtack: Inaudible Voice Commandscited by 65
  15. 2018CommanderSong: A Systematic Approach for Practical Adversarial Voice Recognitioncited by 63
  16. 2024MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agentscited by 63
  17. 2023MossFormer2: Combining Transformer and RNN-Free Recurrent Network for Enhanced Time-Domain Monaural Speech Separationcited by 39
  18. 2024Voice Jailbreak Attacks Against GPT-4ocited by 39
  19. 2025PromptLocate: Localizing Prompt Injection Attackscited by 23
  20. 2024Enhancing Prompt Injection Attacks to LLMs via Poisoning Alignmentcited by 18
  21. 2024Empirical Analysis of Large Vision-Language Models against Goal Hijacking via Visual Prompt Injectioncited by 17
  22. 2025AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Modelscited by 16
  23. 2026Toward Efficient Agents: Memory, Tool learning, and Planningcited by 11
  24. 2024Overview of Speaker Modeling and Its Applications: From the Lens of Deep Speaker Representation Learningcited by 8
  25. 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AIcited by 8
  26. 2025Speech-Audio Compositional Attacks on Multimodal LLMs and Their Mitigation with SALMONN-Guardcited by 8
  27. 2024Self-interpreting Adversarial Imagescited by 7
  28. 2025Hidden in the Noise: Unveiling Backdoors in Audio LLMs Alignment through Latent Acoustic Pattern Triggerscited by 7
  29. 2025Invisible Injections: Exploiting Vision-Language Models Through Steganographic Prompt Embeddingcited by 5
  30. 2025Towards Robust Multimodal Large Language Models Against Jailbreak Attackscited by 4
  31. 2026Hijacking Large Audio-Language Models via Context-Agnostic and Imperceptible Auditory Prompt Injectioncited by 2
  32. 2025Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Breaking Audio Large Language Models by Attacking Only the Encoder: A Universal Targeted Latent-Space Audio Attack
  2. 2025When Good Sounds Go Adversarial: Jailbreaking Audio-Language Models with Benign Inputs
  3. 2025ARGUS: Defending Against Multimodal Indirect Prompt Injection via Steering Instruction-Following Behavior
  4. 2025"I am bad": Interpreting Stealthy, Universal and Robust Audio Jailbreaks in Audio-Language Models
  5. 2026Acoustic Interference: A New Paradigm Weaponizing Acoustic Latent Semantic for Universal Jailbreak against Large Audio Language Models
  6. 2025Multilingual and Multi-Accent Jailbreaking of Audio LLMs
  7. 2025Investigating Vulnerabilities and Defenses Against Audio-Visual Attacks: A Comprehensive Survey Emphasizing Multimodal Models
  8. 2025Con Instruction: Universal Jailbreaking of Multimodal Large Language Models via Non-Textual Modalities