mlsanityData to 14 Oct 2026

ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech

arXiv 1807.07281 ↗First posted 19 Jul 2018cs.CL cs.AI cs.LGcited by 70

Not on the map. Why?

Abstract (arXiv)

In this work, we propose a new solution for parallel wave generation by WaveNet. In contrast to parallel WaveNet (van den Oord et al., 2018), we distill a Gaussian inverse autoregressive flow from the autoregressive WaveNet by minimizing a regularized KL divergence between their highly-peaked output distributions. Our method computes the KL divergence in closed-form, which simplifies the training algorithm and provides very efficient distillation. In addition, we introduce the first text-to-wave neural architecture for speech synthesis, which is fully convolutional and enables fast end-to-end training from scratch. It significantly outperforms the previous pipeline that connects a text-to-spectrogram model to a separately trained WaveNet (Ping et al., 2018). We also successfully distill a parallel waveform synthesizer conditioned on the hidden representation in this end-to-end model.

Key facts. Cited by 70 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Jul 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2020: 1; 2021: 30; 2022: 15; 2023: 11; 2024: 7; 2025: 5; 2026: 1.

70 papers.

Sort:

By area:

  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  3. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
  4. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  5. 2021A Survey on Neural Speech Synthesiscited by 184
  6. 2022It's Raw! Audio Generation with State-Space Modelscited by 171
  7. 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 157
  8. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 150
  9. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  10. 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
  11. 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
  12. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
38 more
  1. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
  2. 2021Neural Dubber: Dubbing for Videos According to Scriptscited by 39
  3. 2023Transformers in Speech Processing: A Surveycited by 39
  4. 2021CaloFlow II: Even Faster and Still Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 34
  5. 2022iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier Transformcited by 32
  6. 2022Learning to Dub Movies via Hierarchical Prosody Modelscited by 29
  7. 2021Universal Neural Vocoding with Parallel WaveNetcited by 25
  8. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  9. 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
  10. 2021High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latencycited by 19
  11. 2021AnyoneNet: Synchronized Speech and Talking Head Generation for Arbitrary Personcited by 17
  12. 2021GAN Vocoder: Multi-Resolution Discriminator Is All You Needcited by 16
  13. 2021Catch-A-Waveform: Learning to Generate Audio from a Single Short Examplecited by 15
  14. 2023The Age of Synthetic Realities: Challenges and Opportunitiescited by 15
  15. 2022Speech Denoising in the Waveform Domain with Self-Attentioncited by 13
  16. 2021VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attentioncited by 12
  17. 2021Emotional Prosody Control for Speech Generationcited by 12
  18. 2024PeriodWave: Multi-Period Flow Matching for High-Fidelity Waveform Generationcited by 12
  19. 2024VNet: A GAN-based Multi-Tier Discriminator Network for Speech Synthesis Vocoderscited by 10
  20. 2021On-device neural speech synthesiscited by 9
  21. 2022Audio representations for deep learning in sound synthesis: A reviewcited by 9
  22. 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
  23. 2021PeriodNet: A non-autoregressive waveform generation model with a structure separating periodic and aperiodic componentscited by 7
  24. 2022Streamable Neural Audio Synthesis With Non-Causal Convolutionscited by 7
  25. 2022A Simple Baseline for Domain Adaptation in End to End ASR Systems Using Synthetic Datacited by 7
  26. 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
  27. 2023BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Networkcited by 6
  28. 2024Improving Generalization for AI-Synthesized Voice Detectioncited by 6
  29. 2024A Survey of Deep Learning Audio Generation Methodscited by 5
  30. 2021Distilling the Knowledge from Conditional Normalizing Flowscited by 4
  31. 2022Nix-TTS: Lightweight and End-to-End Text-to-Speech via Module-wise Distillationcited by 4
  32. 2023Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesiscited by 4
  33. 2023iSTFTNet2: Faster and More Lightweight iSTFT-Based Neural Vocoder Using 1D-2D CNNcited by 4
  34. 2021Unified Source-Filter GAN: Unified Source-filter Network Based On Factorization of Quasi-Periodic Parallel WaveGANcited by 3
  35. 2021On the Interplay Between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesiscited by 3
  36. 2022Improve few-shot voice cloning using multi-modal learningcited by 3
  37. 2022Regotron: Regularizing the Tacotron2 architecture via monotonic alignment losscited by 3
  38. 2022Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue Historycited by 3

50 most cited of 70 All 70 (JSON)