mlsanityData to 7 Oct 2026

Membership and Dataset Inference Attacks on Large Audio Generative Models

arXiv 2512.09654 ↗First posted 10 Dec 2025cs.LGcited by 2

On the map: LLM safety and security → Membership inference attacks

Abstract (arXiv)

Generative audio models, based on diffusion and autoregressive architectures, have advanced rapidly in both quality and expressiveness. This progress, however, raises pressing copyright concerns, as such models are often trained on vast corpora of artistic and commercial works. A central question is whether one can reliably verify if an artist's material was included in training, thereby providing a means for copyright holders to protect their content. In this work, we investigate the feasibility of such verification through membership inference attacks (MIA) on open-source generative audio models, which attempt to determine whether a specific audio sample was part of the training set. Our empirical results show that membership inference alone is of limited effectiveness at scale, as the per-sample membership signal is weak for models trained on large and diverse datasets. However, artists and media owners typically hold collections of works rather than isolated samples. Building on prior work in text and vision domains, in this work we focus on dataset inference (DI), which aggregates diverse membership evidence across multiple samples. We find that DI is successful in the audio domain, offering a more practical mechanism for assessing whether an artist's works contributed to model training. Our results suggest DI as a promising direction for copyright protection and dataset accountability in the era of large audio generative models.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 27 of its 33 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

27 of 33 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024Context-Aware Membership Inference Attacks against Pre-trained Large Language Models11 Sep
  2. 2024LLM Dataset Inference: Did you train on my dataset?10 Jun
  3. 2024Membership Inference on Text-to-Image Diffusion Models via Conditional Likelihood Discrepancy23 May
  4. 2023Scalable Membership Inference Attacks via Quantile Regression7 Jul
  5. 2023Towards More Realistic Membership Inference Attacks on Large Diffusion Models22 Jun
  6. 2023Membership Inference Attacks against Language Models via Neighbourhood Comparison29 May
  7. 2023An Efficient Membership Inference Attack for the Diffusion Model by Proximal Initialization26 May
  8. 2021Dataset Inference: Ownership Resolution in Machine Learning21 Apr

Other references · 19

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  6. 2020Extracting Training Data from Large Language Modelscited by 2,144
  7. 2023Extracting Training Data from Diffusion Modelscited by 723
  8. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  9. 2023Detecting Pretraining Data from Large Language Modelscited by 375
  10. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  11. 2022AudioGen: Textually Guided Audio Generationcited by 292
  12. 2022Masked Autoencoders that Listencited by 271
7 more
  1. 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Modelcited by 145
  2. 2024Min-K%++: Improved Baseline for Detecting Pre-Training Data from Large Language Modelscited by 102
  3. 2022Dataset Inference for Self-Supervised Modelscited by 36
  4. 2022On the Difficulty of Defending Self-Supervised Learning against Model Extractioncited by 22
  5. 2024CDI: Copyrighted Data Identification in Diffusion Modelscited by 17
  6. 2025Privacy Attacks on Image AutoRegressive Modelscited by 15
  7. 2025Unlocking Post-hoc Dataset Inference with Synthetic Datacited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.