mlsanityData to 14 Oct 2026

MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis

arXiv 1910.06711 ↗First posted 8 Oct 2019eess.AS cs.CL cs.LGcited by 354

Not on the map. Why?

Cited by 49 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Previous works (Donahue et al., 2018a; Engel et al., 2019a) have found that generating coherent raw audio waveforms with GANs is challenging. In this paper, we show that it is possible to train GANs reliably to generate high quality coherent waveforms by introducing a set of architectural changes and simple training techniques. Subjective evaluation metric (Mean Opinion Score, or MOS) shows the effectiveness of the proposed approach for high quality mel-spectrogram inversion. To establish the generality of the proposed techniques, we show qualitative results of our model in speech synthesis, music domain translation and unconditional music synthesis. We evaluate the various components of the model through ablation studies and suggest a set of guidelines to design general purpose discriminators and generators for conditional sequence synthesis tasks. Our model is non-autoregressive, fully convolutional, with significantly fewer parameters than competing models and generalizes to unseen speakers for mel-spectrogram inversion. Our pytorch implementation runs at more than 100x faster than realtime on GTX 1080Ti GPU and more than 2x faster than real-time on CPU, without any hardware specific optimization tricks.

Key facts. Cited by 354 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2020: 1; 2021: 88; 2022: 92; 2023: 56; 2024: 55; 2025: 45; 2026: 17.

354 papers.

Sort:

By area:

  1. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  2. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  3. 2022High Fidelity Neural Audio Compressioncited by 687
  4. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  5. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 447
  6. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
  7. 2021Generative Spoken Language Modeling from Raw Audiocited by 340
  8. 2022AudioGen: Textually Guided Audio Generationcited by 295
  9. 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 257
  10. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
  11. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  12. 2021A Survey on Neural Speech Synthesiscited by 184
38 more
  1. 2022Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Qualitycited by 182
  2. 2022It's Raw! Audio Generation with State-Space Modelscited by 171
  3. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
  4. 2021Taming Visually Guided Sound Generationcited by 136
  5. 2023Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Modelscited by 134
  6. 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 113
  7. 2021AdaSpeech: Adaptive Text to Speech for Custom Voicecited by 98
  8. 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
  9. 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
  10. 2024Recent Advances in Speech Language Models: A Surveycited by 87
  11. 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
  12. 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
  13. 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
  14. 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 78
  15. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  16. 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
  17. 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantizationcited by 68
  18. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
  19. 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
  20. 2023Conditional Generation of Audio from Video via Foley Analogiescited by 52
  21. 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
  22. 2022Visual Acoustic Matchingcited by 45
  23. 2022Discrete Contrastive Diffusion for Cross-Modal Music and Image Generationcited by 44
  24. 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
  25. 2022DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANscited by 43
  26. 2025Recent Advances in Discrete Speech Tokens: A Reviewcited by 43
  27. 2021CDPAM: Contrastive learning for perceptual audio similaritycited by 42
  28. 2022Multi-instrument Music Synthesis with Spectrogram Diffusioncited by 42
  29. 2022Lip to Speech Synthesis with Visual Context Attentional GANcited by 41
  30. 2023The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objectscited by 41
  31. 2021Neural Dubber: Dubbing for Videos According to Scriptscited by 39
  32. 2022SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shapingcited by 37
  33. 2022Quantized GAN for Complex Music Generation from Dance Videoscited by 37
  34. 2024Foundation Models for Music: A Surveycited by 37
  35. 2021Bilateral Denoising Diffusion Modelscited by 36
  36. 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 33
  37. 2023FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Corescited by 33
  38. 2021MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modelingcited by 32

50 most cited of 354 All 354 (JSON)