mlsanityData to 7 Oct 2026

Mental Damage: Caption Poisoning Attacks on Retrieval-Augmented Text-to-Music Generation

arXiv 2605.30365 ↗First posted 18 May 2026cs.SD cs.AI eess.AScited by 0

On the map: Retrieval-augmented generation → Privacy and security of RAG

Abstract (arXiv)

Retrieval-augmented text-to-music (TTM) systems augment underspecified user prompts using captions retrieved from a music caption dataset. This design introduces an integrity dependency on the music knowledge database. We show that an attacker can poison the database by injecting a small number of crafted music captions, causing the system to retrieve malicious captions that bias prompt augmentation and steer generation away from the user's intended function, without modifying the user prompt, retriever, or generator. To achieve the music caption poisoning attack, we propose a dual-layer caption poisoning strategy that preserves high-level retrieval anchors while injecting low-level acoustic descriptors to steer prompt augmentation and downstream music generation toward an attacker-chosen target intent. In a MusicCaps knowledge database, CLAP retriever, and MusicGen pipeline, poisoned generations move substantially closer to the attacker's target, while remaining comparably aligned with the original user query. These results expose a practical integrity risk for retrieval-augmented creative AI systems. Our demo can be found at: https://yizhu-wen.github.io/Mental-Damage/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 27 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

16 of 27 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Poisoned-MRAG: Knowledge Poisoning Attacks to Multimodal Retrieval Augmented Generation8 Mar
  2. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb

Other references · 14

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  3. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  4. 2023Simple and Controllable Music Generationcited by 480
  5. 2023MusicLM: Generating Music From Textcited by 442
  6. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
  7. 2022KNN-Diffusion: Image Generation via Large-Scale Retrievalcited by 135
  8. 2022Retrieval-Augmented Multimodal Language Modelingcited by 125
  9. 2023RECAP: Retrieval-Augmented Audio Captioningcited by 26
  10. 2023Retrieval-Augmented Text-to-Audio Generationcited by 23
  11. 2022Beyond the Status Quo: A Contemporary Survey of Advances and Challenges in Audio Captioningcited by 9
  12. 2024Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generationcited by 6
2 more
  1. 2024Music Discovery Dialogue Generation Using Human Intent Analysis and Large Language Modelscited by 4
  2. 2024Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hidden in the Metadata: Stealth Poisoning Attacks on Multimodal Retrieval-Augmented Generation
  2. 2025Practical Poisoning Attacks against Retrieval-Augmented Generation
  3. 2025MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks
  4. 2026Acoustic Interference: A New Paradigm Weaponizing Acoustic Latent Semantic for Universal Jailbreak against Large Audio Language Models
  5. 2026PIDP-Attack: Combining Prompt Injection with Database Poisoning Attacks on Retrieval-Augmented Generation Systems
  6. 2024Human-Imperceptible Retrieval Poisoning Attacks in LLM-Powered Applications
  7. 2025POISONCRAFT: Practical Poisoning of Retrieval-Augmented Generation for Large Language Models
  8. 2025Uncovering Competing Poisoning Attacks in Retrieval-Augmented Generation