Auditing Training Data in Generative Music Models via Black-Box Membership Inference
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
Recent advances in text-to-music generation enable high-fidelity synthesis of structured musical audio, raising growing concerns about data provenance, consent, and training transparency. These models are typically trained on large-scale corpora with little disclosure, leaving no practical mechanism to verify whether a particular audio sample was included in training. In this paper, we investigate black-box membership inference for generative music models, aiming to determine whether a candidate music sample was used during training, given only query access to the deployed system. Our key insight is that training membership induces systematically stronger semantic and structural alignment between a candidate sample and the model's generation conditioned on its caption. We query the target model with the associated caption and measure the relationship between the candidate audio and the generated output in a learned feature space. To capture features that separate members from non-members, we construct paired examples consisting of each track and its caption-conditioned generation from shadow models, and train a music auditor to classify membership. The auditor captures alignment patterns characteristic of training membership and generalizes to unseen target models in a fully black-box setting without access to model parameters or training metadata. Across multiple state-of-the-art music generators, our method achieves up to 98.6% accuracy, with false-positive and false-negative rates as low as 1.9% and 1.0%, demonstrating that reliable training-data auditing is feasible in realistic deployment scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 32 of its 37 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
32 of 37 references.
Closest ancestors · 6
Same direction, newest first
- 2025Assessing the Effectiveness of Membership Inference on Generative Music25 Dec
- 2025Membership and Dataset Inference Attacks on Large Audio Generative Models10 Dec
- 2025GenAI Confessions: Black-box Membership Inference for Generative Image Models11 Jan
- 2024Do Membership Inference Attacks Work on Large Language Models?12 Feb
- 2022Membership Inference Attacks Against Text-to-image Generation Models3 Oct
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar
Other references · 26
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
- 2023Simple and Controllable Music Generationcited by 480
- 2023MusicLM: Generating Music From Textcited by 442
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
- 2019White-box vs Black-box: Bayes Optimal Strategies for Membership Inferencecited by 265
- 2016FMA: A Dataset For Music Analysiscited by 205
- 2023Understanding and Mitigating Copying in Diffusion Modelscited by 205
- 2024Stable Audio Opencited by 192
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 175
- 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
14 more
- 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Modelcited by 145
- 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
- 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
- 2025YuE: Scaling Open Foundation Models for Long-Form Music Generationcited by 68
- 2024Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generationcited by 27
- 2022MAP-Music2Vec: A Simple and Effective Baseline for Self-Supervised Music Audio Representation Learningcited by 22
- 2025Music Flamingo: Scaling Music Understanding in Audio Language Modelscited by 19
- 2024A General Framework for Data-Use Auditing of ML Modelscited by 15
- 2025JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignmentcited by 9
- 2025Live Music Modelscited by 9
- 2025Fx-Encoder++: Extracting Instrument-Wise Audio Effects Representations from Mixturescited by 6
- 2025Instance-Level Data-Use Auditing of Visual ML Modelscited by 4
- 2025Auditing Data Provenance in Real-world Text-to-Image Diffusion Models for Privacy and Copyright Protectioncited by 2
- 2026Membership Inference Attack Against Music Diffusion Models via Generative Manifold Perturbationcited by 1
Built on by
Not cited yet.