The Ethical Implications of Generative Audio Models: A Systematic Literature Review
Not on the map. Why?
Abstract (arXiv)
Generative audio models typically focus their applications in music and speech generation, with recent models having human-like quality in their audio output. This paper conducts a systematic literature review of 884 papers in the area of generative audio models in order to both quantify the degree to which researchers in the field are considering potential negative impacts and identify the types of ethical implications researchers in this area need to consider. Though 65% of generative audio research papers note positive potential impacts of their work, less than 10% discuss any negative impacts. This jarringly small percentage of papers considering negative impact is particularly worrying because the issues brought to light by the few papers doing so are raising serious ethical implications and concerns relevant to the broader field such as the potential for fraud, deep-fakes, and copyright infringement. By quantifying this lack of ethical consideration in generative audio research and identifying key areas of potential harm, this paper lays the groundwork for future work in the field at a critical point in time in order to guide more conscientious research as this field progresses.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 174 of its 217 references that are in the map. First posted on arXiv 7 Jul 2023.
Builds on
174 of 217 references.
References · 174
- 2017Attention Is All You Needcited by 60,361
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2018Self-Attention with Relative Position Representationscited by 1,120
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2018Image Transformercited by 772
- 2022Quantifying Memorization Across Neural Language Modelscited by 763
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
- 2020Jukebox: A Generative Model for Musiccited by 542
- 2023MusicLM: Generating Music From Textcited by 448
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 340
38 more
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 324
- 2022AudioGen: Textually Guided Audio Generationcited by 295
- 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 273
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
- 2020The Creation and Detection of Deepfakes: A Surveycited by 247
- 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 202
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 197
- 2020DDSP: Differentiable Digital Signal Processingcited by 178
- 2020Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Modelscited by 169
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 165
- 2021Symbolic Music Generation with Diffusion Modelscited by 154
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancementcited by 132
- 2021How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVENcited by 124
- 2020An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learningcited by 112
- 2019Text-based Editing of Talking-head Videocited by 103
- 2022Speech Enhancement with Score-Based Generative Models in the Complex STFT Domaincited by 102
- 2018Neural Voice Cloning with a Few Samplescited by 100
- 2023On Provable Copyright Protection for Generative Modelscited by 98
- 2018Hierarchical Generative Modeling for Controllable Speech Synthesiscited by 93
- 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
- 2019Deep Learning for Audio Signal Processingcited by 92
- 2019High Fidelity Speech Synthesis with Adversarial Networkscited by 92
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
- 2020PopMAG: Pop Music Accompaniment Generationcited by 68
- 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
- 2018The challenge of realistic music generation: modelling raw audio at scalecited by 63
- 2020The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measurescited by 53
- 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Modelcited by 53
- 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
- 2022DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANscited by 43
- 2019MelNet: A Generative Model for Audio in the Frequency Domaincited by 42
- 2020Learning Interpretable Representation for Controllable Polyphonic Music Generationcited by 40
- 2021Self-supervised Contrastive Cross-Modality Representation Learning for Spoken Question Answeringcited by 39
- 2020Wave-Tacotron: Spectrogram-free end-to-end text-to-speech synthesiscited by 38
50 most cited of 174 All 174 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 9; 2025: 7; 2026: 1.
18 papers.
Sort:
By area:
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
- 2024Two Types of AI Existential Risk: Decisive and Accumulativecited by 22
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generatorscited by 18
- 2024Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Modelcited by 13
- 2024Acceptable Use Policies for Foundation Modelscited by 12
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detectioncited by 11
- 2024Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audiocited by 10
- 2025Survey on the Evaluation of Generative Models in Musiccited by 10
- 2025Music Arena: Live Evaluation for Text-to-Musiccited by 8
- 2025MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AIcited by 7
- 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4
6 more
- 2024Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Musiccited by 3
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Makingcited by 2
- 2024Towards Training Music Taggers on Synthetic Datacited by 1
- 2024Generating Sample-Based Musical Instruments Using Neural Audio Codec Language Modelscited by 1
- 2026MusGU+: Toward a Musician-Centered Evaluation Framework and Discovery Tool for Generative Music AIcited by 1
- 2025Detecting Musical Deepfakescited by 0
- 2026MusGU+: Toward a Musician-Centered Evaluation Framework and Discovery Tool for Generative Music AI31 Aug 2026
- 2025Fit for Purpose? Deepfake Detection in the Real World18 Oct 2025
- 2025Music Arena: Live Evaluation for Text-to-Music28 Jul 2025
- 2025MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AI4 Jul 2025
- 2025Survey on the Evaluation of Generative Models in Music5 Jun 2025
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detection25 May 2025
- 2025Detecting Musical Deepfakes3 May 2025
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Making24 Jan 2025
- 2024Acceptable Use Policies for Foundation Models29 Aug 2024
- 2024Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music31 Jul 2024
- 2024Generating Sample-Based Musical Instruments Using Neural Audio Codec Language Models22 Jul 2024
- 2024Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audio19 Jul 2024
6 more
- 2024Towards Training Music Taggers on Synthetic Data2 Jul 2024
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Review13 Feb 2024
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators25 Jan 2024
- 2024Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Model25 Jan 2024
- 2024Two Types of AI Existential Risk: Decisive and Accumulative15 Jan 2024
- 2023Sociotechnical Safety Evaluation of Generative AI Systems18 Oct 2023
- 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4
- 2025Fit for Purpose? Deepfake Detection in the Real World18 Oct 2025
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
- 2024Two Types of AI Existential Risk: Decisive and Accumulativecited by 22
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generatorscited by 18
- 2024Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Modelcited by 13
- 2024Acceptable Use Policies for Foundation Modelscited by 12
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detectioncited by 11
- 2024Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audiocited by 10
- 2025Survey on the Evaluation of Generative Models in Musiccited by 10
- 2025Music Arena: Live Evaluation for Text-to-Musiccited by 8
- 2025MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AIcited by 7
- 2024Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Musiccited by 3
12 most cited of 17 All 17 (JSON)
- 2026MusGU+: Toward a Musician-Centered Evaluation Framework and Discovery Tool for Generative Music AI31 Aug 2026
- 2025Music Arena: Live Evaluation for Text-to-Music28 Jul 2025
- 2025MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AI4 Jul 2025
- 2025Survey on the Evaluation of Generative Models in Music5 Jun 2025
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detection25 May 2025
- 2025Detecting Musical Deepfakes3 May 2025
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Making24 Jan 2025
- 2024Acceptable Use Policies for Foundation Models29 Aug 2024
- 2024Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music31 Jul 2024
- 2024Generating Sample-Based Musical Instruments Using Neural Audio Codec Language Models22 Jul 2024
- 2024Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audio19 Jul 2024
- 2024Towards Training Music Taggers on Synthetic Data2 Jul 2024
12 newest of 17 All 17 (JSON)