mlsanityData to 14 Oct 2026

The Ethical Implications of Generative Audio Models: A Systematic Literature Review

arXiv 2307.05527 ↗First posted 7 Jul 2023cs.CY cs.LG cs.SDcited by 18

Not on the map. Why?

Abstract (arXiv)

Generative audio models typically focus their applications in music and speech generation, with recent models having human-like quality in their audio output. This paper conducts a systematic literature review of 884 papers in the area of generative audio models in order to both quantify the degree to which researchers in the field are considering potential negative impacts and identify the types of ethical implications researchers in this area need to consider. Though 65% of generative audio research papers note positive potential impacts of their work, less than 10% discuss any negative impacts. This jarringly small percentage of papers considering negative impact is particularly worrying because the issues brought to light by the few papers doing so are raising serious ethical implications and concerns relevant to the broader field such as the potential for fraud, deep-fakes, and copyright infringement. By quantifying this lack of ethical consideration in generative audio research and identifying key areas of potential harm, this paper lays the groundwork for future work in the field at a critical point in time in order to guide more conscientious research as this field progresses.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 174 of its 217 references that are in the map. First posted on arXiv 7 Jul 2023.

Builds on

174 of 217 references.

References · 174

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  4. 2018Self-Attention with Relative Position Representationscited by 1,120
  5. 2021Ethical and social risks of harm from Language Modelscited by 966
  6. 2018Image Transformercited by 772
  7. 2022Quantifying Memorization Across Neural Language Modelscited by 763
  8. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  9. 2020Jukebox: A Generative Model for Musiccited by 542
  10. 2023MusicLM: Generating Music From Textcited by 448
  11. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
  12. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 340
38 more
  1. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 324
  2. 2022AudioGen: Textually Guided Audio Generationcited by 295
  3. 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 273
  4. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
  5. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  6. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  7. 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 202
  8. 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 197
  9. 2020DDSP: Differentiable Digital Signal Processingcited by 178
  10. 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 169
  11. 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 165
  12. 2021Symbolic Music Generation with Diffusion Modelscited by 154
  13. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  14. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
  15. 2022Conditional Diffusion Probabilistic Model for Speech Enhancementcited by 132
  16. 2021How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVENcited by 124
  17. 2020An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learningcited by 112
  18. 2019Text-based Editing of Talking-head Videocited by 103
  19. 2022Speech Enhancement with Score-Based Generative Models in the Complex STFT Domaincited by 102
  20. 2018Neural Voice Cloning with a Few Samplescited by 100
  21. 2023On Provable Copyright Protection for Generative Modelscited by 98
  22. 2018Hierarchical Generative Modeling for Controllable Speech Synthesiscited by 93
  23. 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
  24. 2019Deep Learning for Audio Signal Processingcited by 92
  25. 2019High Fidelity Speech Synthesis with Adversarial Networkscited by 92
  26. 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
  27. 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
  28. 2020PopMAG: Pop Music Accompaniment Generationcited by 68
  29. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
  30. 2018The challenge of realistic music generation: modelling raw audio at scalecited by 63
  31. 2020The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measurescited by 53
  32. 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Modelcited by 53
  33. 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
  34. 2022DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANscited by 43
  35. 2019MelNet: A Generative Model for Audio in the Frequency Domaincited by 42
  36. 2020Learning Interpretable Representation for Controllable Polyphonic Music Generationcited by 40
  37. 2021Self-supervised Contrastive Cross-Modality Representation Learning for Spoken Question Answeringcited by 39
  38. 2020Wave-Tacotron: Spectrogram-free end-to-end text-to-speech synthesiscited by 38

50 most cited of 174 All 174 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 9; 2025: 7; 2026: 1.

18 papers.

Sort:

By area:

  1. 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
  2. 2024Two Types of AI Existential Risk: Decisive and Accumulativecited by 22
  3. 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
  4. 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generatorscited by 18
  5. 2024Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Modelcited by 13
  6. 2024Acceptable Use Policies for Foundation Modelscited by 12
  7. 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detectioncited by 11
  8. 2024Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audiocited by 10
  9. 2025Survey on the Evaluation of Generative Models in Musiccited by 10
  10. 2025Music Arena: Live Evaluation for Text-to-Musiccited by 8
  11. 2025MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AIcited by 7
  12. 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4
6 more
  1. 2024Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Musiccited by 3
  2. 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Makingcited by 2
  3. 2024Towards Training Music Taggers on Synthetic Datacited by 1
  4. 2024Generating Sample-Based Musical Instruments Using Neural Audio Codec Language Modelscited by 1
  5. 2026MusGU+: Toward a Musician-Centered Evaluation Framework and Discovery Tool for Generative Music AIcited by 1
  6. 2025Detecting Musical Deepfakescited by 0