Fast Wavenet Generation Algorithm
Not on the map. Why?
Abstract (arXiv)
This paper presents an efficient implementation of the Wavenet generation process called Fast Wavenet. Compared to a naive implementation that has complexity O(2^L) (L denotes the number of layers in the network), our proposed approach removes redundant convolution operations by caching previous calculations, thereby reducing the complexity to O(L) time. Timing experiments show significant advantages of our fast implementation over a naive one. While this method is presented for Wavenet, the same scheme can be applied anytime one wants to perform autoregressive generation or online prediction using a model with dilated convolution layers. The code for our method is publicly available.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 3; 2024: 2; 2025: 1.
14 papers.
Sort:
By area:
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2021NWT: Towards natural audio-to-video generation with representation learningcited by 14
- 2023Semantic Hearing: Programming Acoustic Scenes with Binaural Hearablescited by 11
- 2021Approximation Theory of Convolutional Architectures for Time Series Modellingcited by 10
- 2022Iterative autoregression: a novel trick to improve your low-latency speech enhancement modelcited by 5
- 2022AdaCat: Adaptive Categorical Discretization for Autoregressive Modelscited by 3
- 2024Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyondcited by 3
- 2024Revealing and Mitigating the Local Pattern Shortcuts of Mambacited by 2
- 2021Non-Autoregressive vs Autoregressive Neural Networks for System Identificationcited by 1
- 2025TinyD'ej`aVu: Smaller RAM and Faster Inference with Neural Networks on MCUs for Sensor Data Streamscited by 1
- 2022Implicit Feature Decoupling with Depthwise Quantizationcited by 0
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunitiescited by 0
- 2025TinyD'ej`aVu: Smaller RAM and Faster Inference with Neural Networks on MCUs for Sensor Data Streams10 Dec 2025
- 2024Revealing and Mitigating the Local Pattern Shortcuts of Mamba21 Oct 2024
- 2024Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond16 Oct 2024
- 2023Semantic Hearing: Programming Acoustic Scenes with Binaural Hearables1 Nov 2023
- 2023Generative Adversarial Training for Text-to-Speech Synthesis Based on Raw Phonetic Input and Explicit Prosody Modelling14 Oct 2023
- 2023Speech Synthesis By Unrolling Diffusion Process using Neural Network Layers18 Sep 2023
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunities26 Nov 2022
- 2022Iterative autoregression: a novel trick to improve your low-latency speech enhancement model3 Nov 2022
- 2022AdaCat: Adaptive Categorical Discretization for Autoregressive Models3 Aug 2022
- 2022Implicit Feature Decoupling with Depthwise Quantization15 Mar 2022
- 2021Approximation Theory of Convolutional Architectures for Time Series Modelling20 Jul 2021
- 2021A Survey on Neural Speech Synthesis29 Jun 2021
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2021NWT: Towards natural audio-to-video generation with representation learningcited by 14
- 2023Semantic Hearing: Programming Acoustic Scenes with Binaural Hearablescited by 11
- 2021Approximation Theory of Convolutional Architectures for Time Series Modellingcited by 10
- 2022Iterative autoregression: a novel trick to improve your low-latency speech enhancement modelcited by 5
- 2022AdaCat: Adaptive Categorical Discretization for Autoregressive Modelscited by 3
- 2024Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyondcited by 3
- 2021Non-Autoregressive vs Autoregressive Neural Networks for System Identificationcited by 1
- 2025TinyD'ej`aVu: Smaller RAM and Faster Inference with Neural Networks on MCUs for Sensor Data Streamscited by 1
- 2022Implicit Feature Decoupling with Depthwise Quantizationcited by 0
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunitiescited by 0
- 2023Speech Synthesis By Unrolling Diffusion Process using Neural Network Layerscited by 0
12 most cited of 13 All 13 (JSON)
- 2025TinyD'ej`aVu: Smaller RAM and Faster Inference with Neural Networks on MCUs for Sensor Data Streams10 Dec 2025
- 2024Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond16 Oct 2024
- 2023Semantic Hearing: Programming Acoustic Scenes with Binaural Hearables1 Nov 2023
- 2023Generative Adversarial Training for Text-to-Speech Synthesis Based on Raw Phonetic Input and Explicit Prosody Modelling14 Oct 2023
- 2023Speech Synthesis By Unrolling Diffusion Process using Neural Network Layers18 Sep 2023
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunities26 Nov 2022
- 2022Iterative autoregression: a novel trick to improve your low-latency speech enhancement model3 Nov 2022
- 2022AdaCat: Adaptive Categorical Discretization for Autoregressive Models3 Aug 2022
- 2022Implicit Feature Decoupling with Depthwise Quantization15 Mar 2022
- 2021Approximation Theory of Convolutional Architectures for Time Series Modelling20 Jul 2021
- 2021A Survey on Neural Speech Synthesis29 Jun 2021
- 2021NWT: Towards natural audio-to-video generation with representation learning8 Jun 2021
12 newest of 13 All 13 (JSON)