mlsanityData to 7 Oct 2026

Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audio

arXiv 2407.14364 ↗First posted 19 Jul 2024cs.SD cs.AI cs.MMcited by 10

Not on the map. Why?

Abstract (arXiv)

Recent advancements in music generation are raising multiple concerns about the implications of AI in creative music processes, current business models and impacts related to intellectual property management. A relevant discussion and related technical challenge is the potential replication and plagiarism of the training set in AI-generated music, which could lead to misuse of data and intellectual property rights violations. To tackle this issue, we present the Music Replication Assessment (MiRA) tool: a model-independent open evaluation method based on diverse audio music similarity metrics to assess data replication. We evaluate the ability of five metrics to identify exact replication by conducting a controlled replication experiment in different music genres using synthetic samples. Our results show that the proposed methodology can estimate exact data replication with a proportion higher than 10%. By introducing the MiRA tool, we intend to encourage the open evaluation of music-generative models by researchers, developers, and users concerning data replication, highlighting the importance of the ethical, social, legal, and economic consequences. Code and examples are available for reproducibility purposes.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 19 Jul 2024.

Builds on

20 of 33 references.

References · 20

  1. 2022Quantifying Memorization Across Neural Language Modelscited by 755
  2. 2023Extracting Training Data from Diffusion Modelscited by 723
  3. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  4. 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
  5. 2023Simple and Controllable Music Generationcited by 480
  6. 2023MusicLM: Generating Music From Textcited by 442
  7. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  8. 2022AudioGen: Textually Guided Audio Generationcited by 292
  9. 2021Efficient Training of Audio Transformers with Patchoutcited by 222
  10. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
  11. 2023MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategiescited by 94
  12. 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
8 more
  1. 2021Contrastive Learning of Musical Representationscited by 81
  2. 2023VampNet: Music Generation via Masked Acoustic Token Modelingcited by 57
  3. 2023The Ethical Implications of Generative Audio Models: A Systematic Literature Reviewcited by 18
  4. 2024Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Modelcited by 13
  5. 2020TensorFlow Audio Models in Essentiacited by 9
  6. 2023Generation or Replication: Auscultating Audio Latent Diffusion Modelscited by 9
  7. 2023A Comprehensive Survey for Evaluation Methodologies of AI-Generated Musiccited by 6
  8. 2018Deep Learning for Singing Processing: Achievements, Challenges and Impact on Singers and Listenerscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 2.

10 papers.