Wavenet based low rate speech coding
Not on the map. Why?
Abstract (arXiv)
Traditional parametric coding of speech facilitates low rate but provides poor reconstruction quality because of the inadequacy of the model used. We describe how a WaveNet generative speech model can be used to generate high quality speech from the bit stream of a standard parametric coder operating at 2.4 kb/s. We compare this parametric coder with a waveform coder based on the same generative model and show that approximating the signal waveform incurs a large rate penalty. Our experiments confirm the high performance of the WaveNet based coder and show that the speech produced by the system is able to additionally perform implicit bandwidth extension and does not significantly impair recognition of the original speaker for the human listener, even when that speaker has not been used during the training of the generative model.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 15; 2023: 3; 2024: 4; 2025: 1; 2026: 1.
33 papers.
Sort:
By area:
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
- 2022It's Raw! Audio Generation with State-Space Modelscited by 171
- 2022COIN++: Neural Compression Across Modalitiescited by 82
- 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iterationcited by 20
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual qualitycited by 15
- 2021Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problemcited by 11
- 2022Disentangled Feature Learning for Real-Time Neural Speech Codingcited by 10
- 2023Generative De-Quantization for Neural Speech Codec via Latent Diffusioncited by 9
- 2021Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoderscited by 7
21 more
- 2021WaveNet-Based Deep Neural Networks for the Characterization of Anomalous Diffusion (WADNet)cited by 7
- 2021HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Codingcited by 7
- 2022End-to-End Neural Speech Coding for Real-Time Communicationscited by 7
- 2022Latent-Domain Predictive Neural Speech Codingcited by 7
- 2021Scalable and Efficient Neural Speech Coding: A Hybrid Designcited by 5
- 2021A Streamwise GAN Vocoder for Wideband Speech Coding at Very Low Bit Ratecited by 5
- 2022Ultra-Low-Bitrate Speech Coding with Pretrained Transformerscited by 5
- 2024Gull: A Generative Multifunctional Audio Codeccited by 5
- 2022End-to-End Binaural Speech Synthesiscited by 4
- 2022Cross-Scale Vector Quantization for Scalable Neural Speech Codingcited by 3
- 2022NESC: Robust Neural End-2-End Speech Coding with GANscited by 3
- 2024FlowMAC: Conditional Flow Matching for Audio Coding at Low Bit Ratescited by 3
- 2024Neural Speech and Audio Coding: Modern AI Technology Meets Traditional Codecscited by 2
- 2022Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Datasetcited by 1
- 2022Conditional variational autoencoder to improve neural audio synthesis for polyphonic music soundcited by 1
- 2023MFCCGAN: A Novel MFCC-Based Speech Synthesizer Using Adversarial Learningcited by 1
- 2023AudioFormer: Audio Transformer learns audio feature representations from discrete acoustic codescited by 1
- 2024Audio Decoding by Inverse Problem Solvingcited by 1
- 2021Unified Signal Compression Using a GAN with Iterative Latent Representation Optimizationcited by 0
- 2022Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNetcited by 0
- 2026S-PRESSO: Ultra Low Bitrate Sound Effect Compression With Diffusion Autoencoders And Offline Quantizationcited by 0
- 2026S-PRESSO: Ultra Low Bitrate Sound Effect Compression With Diffusion Autoencoders And Offline Quantization16 Feb 2026
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual quality3 Mar 2025
- 2024FlowMAC: Conditional Flow Matching for Audio Coding at Low Bit Rates26 Sep 2024
- 2024Audio Decoding by Inverse Problem Solving12 Sep 2024
- 2024Neural Speech and Audio Coding: Modern AI Technology Meets Traditional Codecs13 Aug 2024
- 2024Gull: A Generative Multifunctional Audio Codec7 Apr 2024
- 2023Generative De-Quantization for Neural Speech Codec via Latent Diffusion14 Nov 2023
- 2023AudioFormer: Audio Transformer learns audio feature representations from discrete acoustic codes14 Aug 2023
- 2023MFCCGAN: A Novel MFCC-Based Speech Synthesizer Using Adversarial Learning22 Jun 2023
- 2022Disentangled Feature Learning for Real-Time Neural Speech Coding22 Nov 2022
- 2022Conditional variational autoencoder to improve neural audio synthesis for polyphonic music sound16 Nov 2022
- 2022High Fidelity Neural Audio Compression24 Oct 2022
21 more
- 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iteration3 Oct 2022
- 2022Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Dataset14 Sep 2022
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications19 Jul 2022
- 2022Latent-Domain Predictive Neural Speech Coding18 Jul 2022
- 2022End-to-End Binaural Speech Synthesis8 Jul 2022
- 2022NESC: Robust Neural End-2-End Speech Coding with GANs7 Jul 2022
- 2022Cross-Scale Vector Quantization for Scalable Neural Speech Coding7 Jul 2022
- 2022Ultra-Low-Bitrate Speech Coding with Pretrained Transformers5 Jul 2022
- 2022Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNet22 Feb 2022
- 2022It's Raw! Audio Generation with State-Space Models20 Feb 2022
- 2022COIN++: Neural Compression Across Modalities30 Jan 2022
- 2022End-to-End Neural Speech Coding for Real-Time Communications24 Jan 2022
- 2021Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem17 Dec 2021
- 2021Unified Signal Compression Using a GAN with Iterative Latent Representation Optimization23 Sep 2021
- 2021A Streamwise GAN Vocoder for Wideband Speech Coding at Very Low Bit Rate9 Aug 2021
- 2021HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Coding22 Jul 2021
- 2021SoundStream: An End-to-End Neural Audio Codec7 Jul 2021
- 2021WaveNet-Based Deep Neural Networks for the Characterization of Anomalous Diffusion (WADNet)14 Jun 2021
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representations1 Apr 2021
- 2021Scalable and Efficient Neural Speech Coding: A Hybrid Design27 Mar 2021
- 2021Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoders12 Feb 2021
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
- 2022It's Raw! Audio Generation with State-Space Modelscited by 171
- 2022COIN++: Neural Compression Across Modalitiescited by 82
- 2021Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problemcited by 11
- 2022Disentangled Feature Learning for Real-Time Neural Speech Codingcited by 10
- 2021Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoderscited by 7
- 2021WaveNet-Based Deep Neural Networks for the Characterization of Anomalous Diffusion (WADNet)cited by 7
- 2021HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Codingcited by 7
- 2022End-to-End Neural Speech Coding for Real-Time Communicationscited by 7
12 most cited of 30 All 30 (JSON)
- 2026S-PRESSO: Ultra Low Bitrate Sound Effect Compression With Diffusion Autoencoders And Offline Quantization16 Feb 2026
- 2024FlowMAC: Conditional Flow Matching for Audio Coding at Low Bit Rates26 Sep 2024
- 2024Audio Decoding by Inverse Problem Solving12 Sep 2024
- 2024Neural Speech and Audio Coding: Modern AI Technology Meets Traditional Codecs13 Aug 2024
- 2024Gull: A Generative Multifunctional Audio Codec7 Apr 2024
- 2023AudioFormer: Audio Transformer learns audio feature representations from discrete acoustic codes14 Aug 2023
- 2023MFCCGAN: A Novel MFCC-Based Speech Synthesizer Using Adversarial Learning22 Jun 2023
- 2022Disentangled Feature Learning for Real-Time Neural Speech Coding22 Nov 2022
- 2022Conditional variational autoencoder to improve neural audio synthesis for polyphonic music sound16 Nov 2022
- 2022High Fidelity Neural Audio Compression24 Oct 2022
- 2022Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Dataset14 Sep 2022
- 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications19 Jul 2022
12 newest of 30 All 30 (JSON)