mlsanityData to 7 Oct 2026

GAN Vocoder: Multi-Resolution Discriminator Is All You Need

arXiv 2103.05236 ↗First posted 9 Mar 2021cs.SD cs.LG eess.AScited by 16

Not on the map. Why?

Abstract (arXiv)

Several of the latest GAN-based vocoders show remarkable achievements, outperforming autoregressive and flow-based competitors in both qualitative and quantitative measures while synthesizing orders of magnitude faster. In this work, we hypothesize that the common factor underlying their success is the multi-resolution discriminating framework, not the minute details in architecture, loss function, or training strategy. We experimentally test the hypothesis by evaluating six different generators paired with one shared multi-resolution discriminating framework. For all evaluative measures with respect to text-to-speech syntheses and for all perceptual metrics, their performances are not distinguishable from one another, which supports our hypothesis.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 9 Mar 2021.

Builds on

22 of 30 references.

References · 22

  1. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  3. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  4. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  5. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  6. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  7. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
  8. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
  9. 2020Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Imagescited by 261
  10. 2018Adversarial Audio Synthesiscited by 222
  11. 2018Efficient Neural Audio Synthesiscited by 218
  12. 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 214
10 more
  1. 2018ClariNet: Parallel Wave Generation in End-to-End Text-to-Speechcited by 70
  2. 2020Multi-band MelGAN: Faster Waveform Generation for High-Quality Text-to-Speechcited by 63
  3. 2018FloWaveNet : A Generative Flow for Raw Audiocited by 54
  4. 2020Upsampling artifacts in neural audio synthesiscited by 28
  5. 2020VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial Networkcited by 26
  6. 2019Effective Use of Variational Embedding Capacity in Expressive End-to-End Speech Synthesiscited by 15
  7. 2020Universal MelGAN: A Robust Neural Vocoder for High-Fidelity Waveform Generation in Multiple Domainscited by 9
  8. 2018Conditional WaveGANcited by 7
  9. 2021Improved parallel WaveGAN vocoder with perceptually weighted spectrogram losscited by 6
  10. 2021Axial Residual Networks for CycleGAN-based Voice Conversioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 10; 2023: 2; 2024: 0; 2025: 1; 2026: 1.

16 papers.

Sort:

By area:

  1. 2022High Fidelity Neural Audio Compressioncited by 673
  2. 2022AudioGen: Textually Guided Audio Generationcited by 292
  3. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  4. 2021A Survey on Neural Speech Synthesiscited by 182
  5. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
  6. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 147
  7. 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
  8. 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
  9. 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iterationcited by 20
  10. 2022Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognitioncited by 16
  11. 2022Music Enhancement via Image Translation and Vocodingcited by 11
  12. 2022Unified Source-Filter GAN with Harmonic-plus-Noise Source Excitation Generationcited by 5
4 more
  1. 2021Neural Synthesis of Footsteps Sound Effects with Generative Adversarial Networkscited by 4
  2. 2025Inference-time Scaling for Diffusion-based Audio Super-resolutioncited by 3
  3. 2022Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANscited by 2
  4. 2026Few-shot Acoustic Synthesis with Multimodal Flow Matchingcited by 2