Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram
Not on the map. Why?
Cited by 44 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing multi-resolution spectrogram and adversarial loss functions, which can effectively capture the time-frequency distribution of the realistic speech waveform. As our method does not require density distillation used in the conventional teacher-student framework, the entire model can be easily trained. Furthermore, our model is able to generate high-fidelity speech even with its compact architecture. In particular, the proposed Parallel WaveGAN has only 1.44 M parameters and can generate 24 kHz speech waveform 28.68 times faster than real-time on a single GPU environment. Perceptual listening test results verify that our proposed method achieves 4.16 mean opinion score within a Transformer-based text-to-speech framework, which is comparative to the best distillation-based Parallel WaveNet system.
Key facts. Cited by 340 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 77; 2022: 83; 2023: 54; 2024: 47; 2025: 39; 2026: 39.
340 papers.
Sort:
By area:
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 447
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
- 2022AudioGen: Textually Guided Audio Generationcited by 295
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
- 2021A Survey on Neural Speech Synthesiscited by 184
- 2021SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processingcited by 180
- 2022It's Raw! Audio Generation with State-Space Modelscited by 171
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
38 more
- 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Priorcited by 80
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
- 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantizationcited by 68
- 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
- 2021VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversioncited by 64
- 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
- 2021StarGANv2-VC: A Diverse, Unsupervised, Non-parallel Framework for Natural-Sounding Voice Conversioncited by 58
- 2023Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Biascited by 51
- 2022Visual Acoustic Matchingcited by 45
- 2022A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editingcited by 40
- 2021Neural Dubber: Dubbing for Videos According to Scriptscited by 39
- 2022SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shapingcited by 37
- 2021Bilateral Denoising Diffusion Modelscited by 36
- 2022Emotion Intensity and its Control for Emotional Voice Conversioncited by 35
- 2022SVTS: Scalable Video-to-Speech Synthesiscited by 35
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 33
- 2022iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier Transformcited by 32
- 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
- 2023Controllable Music Production with Diffusion Models and Guidance Gradientscited by 29
- 2021LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Searchcited by 28
- 2022InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Trainingcited by 28
- 2022textless-lib: a Library for Textless Spoken Language Processingcited by 28
- 2023Intelligible Lip-to-Speech Synthesis with Speech Unitscited by 28
- 2021End-to-End Video-To-Speech Synthesis using Generative Adversarial Networkscited by 27
- 2023Imaginary Voice: Face-styled Diffusion Model for Text-to-Speechcited by 27
- 2022JETS: Jointly Training FastSpeech2 and HiFi-GAN for End to End Text to Speechcited by 26
- 2021Universal Neural Vocoding with Parallel WaveNetcited by 25
- 2023VITS2: Improving Quality and Efficiency of Single-Stage Text-to-Speech with Adversarial Learning and Architecture Designcited by 25
- 2021Fre-GAN: Adversarial Frequency-consistent Audio Synthesiscited by 24
- 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 23
- 2021ESPnet2-TTS: Extending the Edge of TTS Researchcited by 22
- 2023Miipher: A Robust Speech Restoration Model Integrating Self-Supervised Speech and Text Representationscited by 22
- 2023Physics-Driven Diffusion Models for Impact Sound Synthesis from Videoscited by 22
- 2023A Representative Study on Human Detection of Artificially Generated Media Across Countriescited by 22
50 most cited of 340 All 340 (JSON)
- 2026Paradee: Distilling Kokoro-82M into an 8M-Parameter Single-Voice Text-to-Speech Model5 Oct 2026
- 2026GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding3 Oct 2026
- 2026Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning1 Oct 2026
- 2026GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code27 Sep 2026
- 2026SAGE: Semantic Audio Generative Encoder26 Sep 2026
- 2026Kraken: LLM-based Speech-to-Speech Translation via Low-bitrate VQ and Dual-path Source Conditioning11 Sep 2026
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoising10 Sep 2026
- 2026TRILOGUE: A Trilingual Spoken Dialogue Fact-Checking Benchmark with Evidence and Paired Audio3 Sep 2026
- 2026Decoupled Latent Flow Matching for Few-Step Joint Vocal-Accompaniment Separation31 Aug 2026
- 2026Parallel Time-Band Mixing with Learned Observation-Adding for Robust ASR Front-Ends31 Aug 2026
- 2026DecoVAE: a Lightweight Interpretable Trend-Seasonal VAE Framework for Efficient Probabilistic Time Series Forecasting20 Aug 2026
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering22 Jul 2026
38 more
- 2026Addressing Limited Data in Auditory Attention Decoding with Diffusion Generative Models20 Jul 2026
- 2026AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation29 Jun 2026
- 2026OLIVE: View-Augmented Latent Prediction with Waveform Reconstruction for Speech SSL29 Jun 2026
- 2026DTT-BSR+: A Generative-Regression Cascade for Music Source Restoration23 Jun 2026
- 2026On the Effect of Segmentation Width and Cluster Size on Speech Resynthesis and Continuation in Generative Spoken Language Models22 Jun 2026
- 2026STAR-VAE: Structured Topology-Aware Regularization for Audio Reconstruction and Generation22 Jun 2026
- 2026Streaming T5-based Text-to-Speech Synthesis with Limited Lookahead20 Jun 2026
- 2026When Do Autoregressive Sequence Models Forecast Physical Wavefields? A Controlled Study on Synthetic Seismograms9 Jun 2026
- 2026BareWave: Waveform-Native Flow-Matching Text-to-Speech8 Jun 2026
- 2026From A to B to A: Palindromic Zero-Shot Voice Conversion with Non-Parallel Data7 Jun 2026
- 2026WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling2 Jun 2026
- 2026Data-Driven Forecasting of three-Component Seismograms Using Transformer Architectures1 Jun 2026
- 2026Quaternion Self-Attention with Shared Scores24 May 2026
- 2026SAME: A Semantically-Aligned Music Autoencoder18 May 2026
- 2026Seconds-Aligned PCA-DAC Latent Diffusion for Symbolic-to-Audio Drum Rendering13 May 2026
- 2026PoDAR: Power-Disentangled Audio Representation for Generative Modeling11 May 2026
- 2026HapticLDM: A Diffusion Model for Text-to-Vibrotactile Generation11 May 2026
- 2026Hearing the Room Through the Shape of the Drum: Modal-Guided Sound Recovery from Multi-Point Surface Vibrations29 Apr 2026
- 2026Spectro-Temporal Modulation Representation Framework for Human-Imitated Speech Detection25 Apr 2026
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos3 Apr 2026
- 2026Few-shot Acoustic Synthesis with Multimodal Flow Matching19 Mar 2026
- 2026Toward Complex-Valued Neural Networks for Waveform Generation12 Mar 2026
- 2026SongSong: A Time Phonograph for Chinese SongCi Music from Thousand of Years Away27 Feb 2026
- 2026SCRAPL: Scattering Transform with Random Paths for Machine Learning11 Feb 2026
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos6 Feb 2026
- 2026Prosody-Guided Harmonic Attention for Phase-Coherent Neural Vocoding in the Complex Spectrum20 Jan 2026
- 2026Gradient-based Optimisation of Modulation Effects8 Jan 2026
- 2025LP-CFM: Perceptual Invariance-Aware Conditional Flow Matching for Speech Modeling23 Dec 2025
- 2025Real-Time Streamable Generative Speech Restoration with Flow Matching22 Dec 2025
- 2025Beyond Unified Models: A Service-Oriented Approach to Low Latency, Context Aware Phonemization for Real Time TTS8 Dec 2025
- 2025JEPA as a Neural Tokenizer: Learning Robust Speech Representations with Density Adaptive Attention8 Dec 2025
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective10 Nov 2025
- 2025SAO-Instruct: Free-form Audio Editing using Natural Language Instructions26 Oct 2025
- 2025Modulation Discovery with Differentiable Digital Signal Processing7 Oct 2025
- 2025WavInWav: Time-domain Speech Hiding via Invertible Neural Network3 Oct 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment2 Oct 2025
- 2025Baseline Systems For The 2025 Low-Resource Audio Codec Challenge30 Sep 2025
- 2025MARS: Sound Generation via Multi-Channel Autoregression on Spectrograms30 Sep 2025
50 newest of 340 All 340 (JSON)
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 447
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
- 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
- 2021PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Priorcited by 80
- 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
- 2022SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shapingcited by 37
- 2021Bilateral Denoising Diffusion Modelscited by 36
- 2023Controllable Music Production with Diffusion Models and Guidance Gradientscited by 29
- 2022InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Trainingcited by 28
- 2023Imaginary Voice: Face-styled Diffusion Model for Text-to-Speechcited by 27
- 2023Physics-Driven Diffusion Models for Impact Sound Synthesis from Videoscited by 22
12 most cited of 44 All 44 (JSON)
- 2026GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code27 Sep 2026
- 2026Decoupled Latent Flow Matching for Few-Step Joint Vocal-Accompaniment Separation31 Aug 2026
- 2026Addressing Limited Data in Auditory Attention Decoding with Diffusion Generative Models20 Jul 2026
- 2026STAR-VAE: Structured Topology-Aware Regularization for Audio Reconstruction and Generation22 Jun 2026
- 2026BareWave: Waveform-Native Flow-Matching Text-to-Speech8 Jun 2026
- 2026WavTTS: Towards High-Quality Zero-Shot TTS via Direct Raw Waveform Modeling2 Jun 2026
- 2026Seconds-Aligned PCA-DAC Latent Diffusion for Symbolic-to-Audio Drum Rendering13 May 2026
- 2026PoDAR: Power-Disentangled Audio Representation for Generative Modeling11 May 2026
- 2026HapticLDM: A Diffusion Model for Text-to-Vibrotactile Generation11 May 2026
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos3 Apr 2026
- 2026Few-shot Acoustic Synthesis with Multimodal Flow Matching19 Mar 2026
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos6 Feb 2026
12 newest of 44 All 44 (JSON)
- 2024TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platformscited by 11
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Modelscited by 9
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
- 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruningcited by 2
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoisingcited by 0
- 2026SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoising10 Sep 2026
- 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning14 Oct 2024
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolution14 Sep 2024
- 2024TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms2 May 2024
- 2023A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Models1 Jun 2023
- 2025Watermarking Autoregressive Image Generationcited by 16
- 2025Watermarking Autoregressive Image Generation19 Jun 2025
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
- 2022AudioGen: Textually Guided Audio Generationcited by 295
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
- 2021A Survey on Neural Speech Synthesiscited by 184
- 2021SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processingcited by 180
- 2022It's Raw! Audio Generation with State-Space Modelscited by 171
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
12 most cited of 288 All 288 (JSON)
- 2026Paradee: Distilling Kokoro-82M into an 8M-Parameter Single-Voice Text-to-Speech Model5 Oct 2026
- 2026GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding3 Oct 2026
- 2026Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning1 Oct 2026
- 2026SAGE: Semantic Audio Generative Encoder26 Sep 2026
- 2026Kraken: LLM-based Speech-to-Speech Translation via Low-bitrate VQ and Dual-path Source Conditioning11 Sep 2026
- 2026TRILOGUE: A Trilingual Spoken Dialogue Fact-Checking Benchmark with Evidence and Paired Audio3 Sep 2026
- 2026Parallel Time-Band Mixing with Learned Observation-Adding for Robust ASR Front-Ends31 Aug 2026
- 2026DecoVAE: a Lightweight Interpretable Trend-Seasonal VAE Framework for Efficient Probabilistic Time Series Forecasting20 Aug 2026
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering22 Jul 2026
- 2026AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation29 Jun 2026
- 2026OLIVE: View-Augmented Latent Prediction with Waveform Reconstruction for Speech SSL29 Jun 2026
- 2026DTT-BSR+: A Generative-Regression Cascade for Music Source Restoration23 Jun 2026
12 newest of 288 All 288 (JSON)