mlsanityData to 7 Oct 2026

Parallel WaveNet: Fast High-Fidelity Speech Synthesis

arXiv 1711.10433 ↗First posted 28 Nov 2017cs.LGcited by 214

Not on the map. Why?

Cited by 33 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The recently-developed WaveNet architecture is the current state of the art in realistic speech synthesis, consistently rated as more natural sounding for many different languages than any previous system. However, because WaveNet relies on sequential generation of one audio sample at a time, it is poorly suited to today's massively parallel computers, and therefore hard to deploy in a real-time production setting. This paper introduces Probability Density Distillation, a new method for training a parallel feed-forward network from a trained WaveNet with no significant difference in quality. The resulting system is capable of generating high-fidelity speech samples at more than 20 times faster than real-time, and is deployed online by Google Assistant, including serving multiple English and Japanese voices.

Key facts. Cited by 214 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 2; 2021: 69; 2022: 62; 2023: 38; 2024: 28; 2025: 12; 2026: 3.

214 papers.

Sort:

By area:

  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  3. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  4. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  5. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  6. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  7. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
  8. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  9. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  10. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 222
  11. 2022Continuous diffusion for categorical datacited by 202
  12. 2021A Survey on Neural Speech Synthesiscited by 182
38 more
  1. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
  2. 2022It's Raw! Audio Generation with State-Space Modelscited by 171
  3. 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
  4. 2023MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformerscited by 164
  5. 2021Instances as Queriescited by 157
  6. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
  7. 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 134
  8. 2023Text-to-3D with Classifier Score Distillationcited by 127
  9. 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
  10. 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
  11. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  12. 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrappingcited by 96
  13. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  14. 2021Guided-TTS: A Diffusion Model for Text-to-Speech via Classifier Guidancecited by 84
  15. 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
  16. 2021Translatotron 2: High-quality direct speech-to-speech translation with voice preservationcited by 69
  17. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
  18. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
  19. 2024Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefitscited by 65
  20. 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
  21. 2022Cross-modal Contrastive Learning for Speech Translationcited by 61
  22. 2024Scaling Transformers for Low-Bitrate High-Quality Speech Codingcited by 48
  23. 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 46
  24. 2023A Comprehensive Survey on Knowledge Distillation of Diffusion Modelscited by 45
  25. 2021Learning Disentangled Representation Implicitly via Transformer for Occluded Person Re-Identificationcited by 44
  26. 2021Resampling Base Distributions of Normalizing Flowscited by 42
  27. 2022A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editingcited by 40
  28. 2022Emotion Intensity and its Control for Emotional Voice Conversioncited by 35
  29. 2021CaloFlow II: Even Faster and Still Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 34
  30. 2024Autoregressive Diffusion Transformer for Text-to-Speech Synthesiscited by 34
  31. 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 32
  32. 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
  33. 2022iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier Transformcited by 30
  34. 2022Universal approximation property of invertible neural networkscited by 30
  35. 2021Knowledge Distillation as Semiparametric Inferencecited by 29
  36. 2022A Review on Methods and Applications in Multimodal Deep Learningcited by 29
  37. 2022InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Trainingcited by 28
  38. 2024Masked Generative Video-to-Audio Transformers with Enhanced Synchronicitycited by 28

50 most cited of 214 All 214 (JSON)