Adversarial Audio Synthesis
Not on the map. Why?
Cited by 41 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales. Generative adversarial networks (GANs) have seen wide success at generating images that are both locally and globally coherent, but they have seen little application to audio generation. In this paper we introduce WaveGAN, a first attempt at applying GANs to unsupervised synthesis of raw-waveform audio. WaveGAN is capable of synthesizing one second slices of audio waveforms with global coherence, suitable for sound effect generation. Our experiments demonstrate that, without labels, WaveGAN learns to produce intelligible words when trained on a small-vocabulary speech dataset, and can also synthesize audio from other domains such as drums, bird vocalizations, and piano. We compare WaveGAN to a method which applies GANs designed for image generation on image-like audio feature representations, finding both approaches to be promising.
Key facts. Cited by 222 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 57; 2022: 45; 2023: 37; 2024: 37; 2025: 36; 2026: 9.
222 papers.
Sort:
By area:
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
- 2022It's Raw! Audio Generation with State-Space Modelscited by 171
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
- 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2022SPECTRE: Spectral Conditioning Helps to Overcome the Expressivity Limits of One-shot Graph Generatorscited by 96
- 2021Noise Estimation for Generative Diffusion Modelscited by 94
38 more
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2023Diffusion Models for Time Series Applications: A Surveycited by 72
- 2022Synthetic Data -- what, why and how?cited by 66
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 66
- 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
- 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 64
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2023SingSong: Generating musical accompaniments from singingcited by 54
- 2023Effectively Modeling Time Series with Simple Discrete State Spacescited by 54
- 2023On the Constrained Time-Series Generation Problemcited by 52
- 2023Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEscited by 48
- 2024Scaling Transformers for Low-Bitrate High-Quality Speech Codingcited by 48
- 2021Learning Signal-Agnostic Manifolds of Neural Fieldscited by 45
- 2021Non Gaussian Denoising Diffusion Modelscited by 43
- 2022GT-GAN: General Purpose Time Series Synthesis with Generative Adversarial Networkscited by 43
- 2022Multi-instrument Music Synthesis with Spectrogram Diffusioncited by 42
- 2024Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Seriescited by 42
- 2022Lip to Speech Synthesis with Visual Context Attentional GANcited by 41
- 2022Data Augmentation techniques in time series domain: A survey and taxonomycited by 41
- 2024A Comprehensive Survey on Data Augmentationcited by 38
- 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesiscited by 37
- 2022SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shapingcited by 37
- 2022Quantized GAN for Complex Music Generation from Dance Videoscited by 37
- 2023SoK: Privacy-Preserving Data Synthesiscited by 37
- 2024A Good Score Does not Lead to A Good Generative Modelcited by 36
- 2022Guided-TTS 2: A Diffusion Model for High-quality Adaptive Text-to-Speech with Untranscribed Datacited by 35
- 2024Time Series Diffusion in the Frequency Domaincited by 35
- 2024Time Weaver: A Conditional Time Series Generation Modelcited by 35
- 2021Image2Reverb: Cross-Modal Reverb Impulse Response Synthesiscited by 34
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 32
- 2022Extreme Generative Image Compression by Learning Text Embedding from Diffusion Modelscited by 30
- 2021Conditional Generative Models for Counterfactual Explanationscited by 28
- 2021End-to-End Video-To-Speech Synthesis using Generative Adversarial Networkscited by 27
- 2021Denoising Diffusion Gamma Modelscited by 27
- 2022Towards Building Text-To-Speech Systems for the Next Billion Userscited by 27
- 2021Towards Generating Real-World Time Series Datacited by 26
50 most cited of 222 All 222 (JSON)
- 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation10 Jun 2026
- 2026LiveBand: Live Accompaniment Generation in the Audio Domain2 Jun 2026
- 2026High-Quality Synthetic Financial Time-Series using a GAN-Diffusion Framework26 May 2026
- 2026DAD4TS: Data-Augmentation-Oriented Diffusion Model for Time-Series Forecasting with Small-Scale Data18 May 2026
- 2026Preserving Temporal Dynamics in Time Series Generation29 Apr 2026
- 2026Prior-Informed Neural Network Initialization: A Spectral Approach for Function Parameterizing Architectures17 Mar 2026
- 2026Complementarity-Preserving Generative Theory for Multimodal ECG Synthesis: A Quantum-Inspired Approach16 Mar 2026
- 2026Synthetic Data Generation for Brain-Computer Interfaces: Overview, Benchmarking, and Future Directions11 Mar 2026
- 2026Benchmarking Language Modeling for Lossless Compression of Full-Fidelity Audio9 Mar 2026
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generation29 Dec 2025
- 2025Improving Cardiac Risk Prediction Using Data Generation Techniques19 Dec 2025
- 2025Advancing Marine Bioacoustics with Deep Generative Models: A Hybrid Augmentation Strategy for Southern Resident Killer Whale Detection26 Nov 2025
38 more
- 2025TSGM: Regular and Irregular Time-series Generation using Score-based Generative Models26 Nov 2025
- 2025AudioScene: Integrating Object-Event Audio into 3D Scenes25 Nov 2025
- 2025Poolformer: Recurrent Networks with Pooling for Long-Sequence Modeling2 Oct 2025
- 2025NGGAN: Noise Generation GAN Based on the Practical Measurement Dataset for Narrowband Powerline Communications2 Oct 2025
- 2025Linear RNNs for autoregressive generation of long music samples1 Oct 2025
- 2025Training-Free Synthetic Data Generation with Dual IP-Adapter Guidance26 Sep 2025
- 2025Causal Time Series Generation via Diffusion Models25 Sep 2025
- 2025DS-Diffusion: Data Style-Guided Diffusion Model for Time-Series Generation23 Sep 2025
- 2025Spectral Bottleneck in Sinusoidal Representation Networks: Noise is All You Need9 Sep 2025
- 2025ArtifactGen: Benchmarking WGAN-GP vs Diffusion for Label-Aware EEG Artifact Synthesis9 Sep 2025
- 2025FlowECG: Using Flow Matching to Create a More Efficient ECG Signal Generator31 Aug 2025
- 2025DLGAN : Time Series Synthesis Based on Dual-Layer Generative Adversarial Networks29 Aug 2025
- 2025GEPD:GAN-Enhanced Generalizable Model for EEG-Based Detection of Parkinson's Disease12 Aug 2025
- 2025Sound Signal Synthesis with Auxiliary Classifier GAN, COVID-19 cough as an example12 Aug 2025
- 2025Inductive transfer learning from regression to classification in ECG analysis5 Aug 2025
- 2025CAK: Emergent Audio Effects from Minimal Deep Learning4 Aug 2025
- 2025CTBench: Cryptocurrency Time Series Generation Benchmark3 Aug 2025
- 2025Unraveling Hidden Representations: A Multi-Modal Layer Analysis for Better Synthetic Content Forensics1 Aug 2025
- 2025CIS-BWE: Chaos-Informed Speech Bandwidth Extension21 Jul 2025
- 2025Stretching Beyond the Obvious: A Gradient-Free Framework to Unveil the Hidden Landscape of Visual Invariance20 Jun 2025
- 2025A Technique for Isolating Lexically-Independent Phonetic Dependencies in Generative CNNs10 Jun 2025
- 2025Explicit Density Approximation for Neural Implicit Samplers Using a Bernstein-Based Convex Divergence5 Jun 2025
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extraction29 May 2025
- 2025Towards Pretraining Robust ASR Foundation Model with Acoustic-Aware Data Augmentation27 May 2025
- 2025Challenges and Limitations of Generative AI in Synthesizing Wearable Sensor Data20 May 2025
- 2025Approximately Equivariant Recurrent Generative Models for Quasi-Periodic Time Series with a Progressive Training Scheme8 May 2025
- 2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond7 May 2025
- 2025Data Cleansing for GANs1 Apr 2025
- 2025AudioX: A Unified Framework for Anything-to-Audio Generation13 Mar 2025
- 2025Conditional Electrocardiogram Generation Using Hierarchical Variational Autoencoders3 Mar 2025
- 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generation21 Feb 2025
- 2025DiffuSETS: 12-lead ECG Generation Conditioned on Clinical Text Reports and Patient-Specific Information10 Jan 2025
- 2025RingFormer: A Neural Vocoder with Ring Attention and Convolution-Augmented Transformer2 Jan 2025
- 2024Interpreting Graphic Notation with MusicLDM: An AI Improvisation of Cornelius Cardew's Treatise12 Dec 2024
- 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Survey9 Dec 2024
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environments2 Dec 2024
- 2024Scaling Transformers for Low-Bitrate High-Quality Speech Coding29 Nov 2024
- 2024VQalAttent: a Transparent Speech Generation Pipeline based on Transformer-learned VQ-VAE Latent Space22 Nov 2024
50 newest of 222 All 222 (JSON)
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
- 2021Noise Estimation for Generative Diffusion Modelscited by 94
- 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
- 2023Diffusion Models for Time Series Applications: A Surveycited by 72
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Datacited by 66
- 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 64
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2021Non Gaussian Denoising Diffusion Modelscited by 43
- 2022Multi-instrument Music Synthesis with Spectrogram Diffusioncited by 42
- 2024Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Seriescited by 42
- 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesiscited by 37
12 most cited of 41 All 41 (JSON)
- 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation10 Jun 2026
- 2026DAD4TS: Data-Augmentation-Oriented Diffusion Model for Time-Series Forecasting with Small-Scale Data18 May 2026
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generation29 Dec 2025
- 2025TSGM: Regular and Irregular Time-series Generation using Score-based Generative Models26 Nov 2025
- 2025Causal Time Series Generation via Diffusion Models25 Sep 2025
- 2025DS-Diffusion: Data Style-Guided Diffusion Model for Time-Series Generation23 Sep 2025
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extraction29 May 2025
- 2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond7 May 2025
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environments2 Dec 2024
- 2024Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series25 Oct 2024
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models18 Sep 2024
- 2024A Survey on Diffusion Models for Time Series and Spatio-Temporal Data29 Apr 2024
12 newest of 41 All 41 (JSON)
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
- 2022It's Raw! Audio Generation with State-Space Modelscited by 171
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2022SPECTRE: Spectral Conditioning Helps to Overcome the Expressivity Limits of One-shot Graph Generatorscited by 96
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2022Synthetic Data -- what, why and how?cited by 66
- 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
- 2023SingSong: Generating musical accompaniments from singingcited by 54
12 most cited of 175 All 175 (JSON)
- 2026LiveBand: Live Accompaniment Generation in the Audio Domain2 Jun 2026
- 2026High-Quality Synthetic Financial Time-Series using a GAN-Diffusion Framework26 May 2026
- 2026Preserving Temporal Dynamics in Time Series Generation29 Apr 2026
- 2026Prior-Informed Neural Network Initialization: A Spectral Approach for Function Parameterizing Architectures17 Mar 2026
- 2026Complementarity-Preserving Generative Theory for Multimodal ECG Synthesis: A Quantum-Inspired Approach16 Mar 2026
- 2026Synthetic Data Generation for Brain-Computer Interfaces: Overview, Benchmarking, and Future Directions11 Mar 2026
- 2026Benchmarking Language Modeling for Lossless Compression of Full-Fidelity Audio9 Mar 2026
- 2025Improving Cardiac Risk Prediction Using Data Generation Techniques19 Dec 2025
- 2025Advancing Marine Bioacoustics with Deep Generative Models: A Hybrid Augmentation Strategy for Southern Resident Killer Whale Detection26 Nov 2025
- 2025AudioScene: Integrating Object-Event Audio into 3D Scenes25 Nov 2025
- 2025Poolformer: Recurrent Networks with Pooling for Long-Sequence Modeling2 Oct 2025
- 2025NGGAN: Noise Generation GAN Based on the Practical Measurement Dataset for Narrowband Powerline Communications2 Oct 2025
12 newest of 175 All 175 (JSON)