LPCNet: Improving Neural Speech Synthesis Through Linear Prediction
Not on the map. Why?
Abstract (arXiv)
Neural speech synthesis models have recently demonstrated the ability to synthesize high quality speech for text-to-speech and compression applications. These new models often require powerful GPUs to achieve real-time operation, so being able to reduce their complexity would open the way for many new applications. We propose LPCNet, a WaveRNN variant that combines linear prediction with recurrent neural networks to significantly improve the efficiency of speech synthesis. We demonstrate that LPCNet can achieve significantly higher quality than WaveRNN for the same network size and that high quality LPCNet speech synthesis is achievable with a complexity under 3 GFLOPS. This makes it easier to deploy neural synthesis applications on lower-power devices, such as embedded systems and mobile phones.
Key facts. Cited by 110 papers in the map (data through 13 Oct 2026). First posted on arXiv 28 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 41; 2023: 11; 2024: 10; 2025: 7; 2026: 2.
110 papers.
Sort:
By area:
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 762
- 2022High Fidelity Neural Audio Compressioncited by 680
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 481
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 235
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 152
- 2022COIN++: Neural Compression Across Modalitiescited by 82
- 2021Neural Analysis and Synthesis: Reconstructing Speech from Self-Supervised Representationscited by 81
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
- 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iterationcited by 20
- 2021High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latencycited by 19
38 more
- 2022SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesiscited by 18
- 2022CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editingcited by 15
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual qualitycited by 15
- 2021Context-Aware Prosody Correction for Text-Based Speech Editingcited by 13
- 2022An Initial Investigation for Detecting Vocoder Fingerprints of Fake Audiocited by 13
- 2021A Light-weight contextual spelling correction model for customizing transducer-based speech recognition systemscited by 11
- 2021Restoring degraded speech via a modified diffusion modelcited by 10
- 2022Fully Automated End-to-End Fake Audio Detectioncited by 10
- 2021On-device neural speech synthesiscited by 9
- 2022Audio representations for deep learning in sound synthesis: A reviewcited by 9
- 2022Lightweight and High-Fidelity End-to-End Text-to-Speech with Multi-Band Generation and Inverse Short-Time Fourier Transformcited by 9
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
- 2021Cross-lingual Low Resource Speaker Adaptation Using Phonological Featurescited by 8
- 2021Prosodic Clustering for Phoneme-level Prosody Control in End-to-End Speech Synthesiscited by 8
- 2021VocBench: A Neural Vocoder Benchmark for Speech Synthesiscited by 8
- 2023Speak While You Think: Streaming Speech Synthesis During Text Generationcited by 8
- 2021Enhancing into the codec: Noise Robust Speech Coding with Vector-Quantized Autoencoderscited by 7
- 2021PeriodNet: A non-autoregressive waveform generation model with a structure separating periodic and aperiodic componentscited by 7
- 2021HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Codingcited by 7
- 2022End-to-End Neural Speech Coding for Real-Time Communicationscited by 7
- 2022WeSinger: Data-augmented Singing Voice Synthesis with Auxiliary Lossescited by 7
- 2022Latent-Domain Predictive Neural Speech Codingcited by 7
- 2023Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesiscited by 7
- 2024Differentiable All-pole Filters for Time-varying Audio Systemscited by 7
- 2024RapVerse: Coherent Vocals and Whole-Body Motions Generations from Textcited by 7
- 2021Review of end-to-end speech synthesis technology based on deep learningcited by 6
- 2021Scalable and Efficient Neural Speech Coding: A Hybrid Designcited by 5
- 2021A Streamwise GAN Vocoder for Wideband Speech Coding at Very Low Bit Ratecited by 5
- 2021Word-Level Style Control for Expressive, Non-attentive Speech Synthesiscited by 5
- 2022Unified Source-Filter GAN with Harmonic-plus-Noise Source Excitation Generationcited by 5
- 2022Ultra-Low-Bitrate Speech Coding with Pretrained Transformerscited by 5
- 2022ParaTTS: Learning Linguistic and Prosodic Cross-sentence Information in Paragraph-based TTScited by 5
- 2022The Sound of Silence: Efficiency of First Digit Features in Synthetic Audio Detectioncited by 5
- 2025From Scores to Preferences: Redefining MOS Benchmarking for Speech Quality Reward Modelingcited by 5
- 2021Learning robust speech representation with an articulatory-regularized variational autoencodercited by 4
- 2022Singing-Tacotron: Global duration control attention and dynamic filter for End-to-end singing voice synthesiscited by 4
- 2024Creating an African American-Sounding TTS: Guidelines, Technical Challenges,and Surprising Evaluationscited by 4
- 2024Decoupled Weight Decay for Any p Normcited by 4
50 most cited of 110 All 110 (JSON)
- 2026GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding3 Oct 2026
- 2026Residual Modeling for High-Fidelity Learned Compression of Scientific Data3 Jun 2026
- 2025Pseudo-Cepstrum: Pitch Modification for Mel-Based Neural Vocoders18 Dec 2025
- 2025DHAuDS: A Dynamic and Heterogeneous Audio Benchmark for Test-Time Adaptation23 Nov 2025
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective10 Nov 2025
- 2025High-Fidelity Speech Enhancement via Discrete Audio Tokens2 Oct 2025
- 2025From Scores to Preferences: Redefining MOS Benchmarking for Speech Quality Reward Modeling1 Oct 2025
- 2025Spiking Vocos: An Energy-Efficient Neural Vocoder16 Sep 2025
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual quality3 Mar 2025
- 2024Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation7 Jul 2024
- 2024RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text30 May 2024
- 2024Decoupled Weight Decay for Any p Norm16 Apr 2024
38 more
- 2024Differentiable All-pole Filters for Time-varying Audio Systems11 Apr 2024
- 2024Creating an African American-Sounding TTS: Guidelines, Technical Challenges,and Surprising Evaluations17 Mar 2024
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstruction8 Mar 2024
- 2024PeriodGrad: Towards Pitch-Controllable Neural Vocoder Based on a Diffusion Probabilistic Model22 Feb 2024
- 2024Low-Resource Cross-Domain Singing Voice Synthesis via Reduced Self-Supervised Speech Representations2 Feb 2024
- 2024Ultra-lightweight Neural Differential DSP Vocoder For High Quality Speech Synthesis19 Jan 2024
- 2024Incremental FastPitch: Chunk-based High Quality Text to Speech3 Jan 2024
- 2023Low-latency Real-time Voice Conversion on CPU1 Nov 2023
- 2023A Discourse-level Multi-scale Prosodic Model for Fine-grained Emotion Analysis21 Sep 2023
- 2023Speak While You Think: Streaming Speech Synthesis During Text Generation20 Sep 2023
- 2023Speech Synthesis By Unrolling Diffusion Process using Neural Network Layers18 Sep 2023
- 2023The FruitShell French synthesis system at the Blizzard 2023 Challenge1 Sep 2023
- 2023MFCCGAN: A Novel MFCC-Based Speech Synthesizer Using Adversarial Learning22 Jun 2023
- 2023ALO-VC: Any-to-any Low-latency One-shot Voice Conversion1 Jun 2023
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis1 Jun 2023
- 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers18 Apr 2023
- 2023Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesis14 Mar 2023
- 2023Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech Recognition20 Feb 2023
- 2022Emotion Selectable End-to-End Text-based Speech Editing20 Dec 2022
- 2022Framewise WaveGAN: High Speed Adversarial Vocoder in Time Domain with Very Low Computational Complexity8 Dec 2022
- 2022Improve Bilingual TTS Using Dynamic Language and Phonology Embedding7 Dec 2022
- 2022Efficient Incremental Text-to-Speech on GPUs25 Nov 2022
- 2022Embedding a Differentiable Mel-cepstral Synthesis Filter to a Neural Speech Synthesis System21 Nov 2022
- 2022Predicting phoneme-level prosody latents using AR and flow-based Prior Networks for expressive speech synthesis2 Nov 2022
- 2022SIMD-size aware weight regularization for fast neural vocoding on CPU2 Nov 2022
- 2022Learning utterance-level representations through token-level acoustic latents prediction for Expressive Speech Synthesis1 Nov 2022
- 2022Generating Multilingual Gender-Ambiguous Text-to-Speech Voices1 Nov 2022
- 2022Cross-lingual Text-To-Speech with Flow-based Voice Conversion for Improved Pronunciation31 Oct 2022
- 2022Lightweight and High-Fidelity End-to-End Text-to-Speech with Multi-Band Generation and Inverse Short-Time Fourier Transform28 Oct 2022
- 2022High Fidelity Neural Audio Compression24 Oct 2022
- 2022The Sound of Silence: Efficiency of First Digit Features in Synthetic Audio Detection6 Oct 2022
- 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iteration3 Oct 2022
- 2022ParaTTS: Learning Linguistic and Prosodic Cross-sentence Information in Paragraph-based TTS14 Sep 2022
- 2022An Initial Investigation for Detecting Vocoder Fingerprints of Fake Audio20 Aug 2022
- 2022Fully Automated End-to-End Fake Audio Detection20 Aug 2022
- 2022Pathway to Future Symbiotic Creativity18 Aug 2022
- 2022Differentiable WORLD Synthesizer-based Neural Vocoder With Application To End-To-End Audio Style Transfer15 Aug 2022
- 2022Latent-Domain Predictive Neural Speech Coding18 Jul 2022
50 newest of 110 All 110 (JSON)
- 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 235
- 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iterationcited by 20
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual qualitycited by 15
- 2021Restoring degraded speech via a modified diffusion modelcited by 10
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
- 2024PeriodGrad: Towards Pitch-Controllable Neural Vocoder Based on a Diffusion Probabilistic Modelcited by 3
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspectivecited by 0
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective10 Nov 2025
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual quality3 Mar 2025
- 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstruction8 Mar 2024
- 2024PeriodGrad: Towards Pitch-Controllable Neural Vocoder Based on a Diffusion Probabilistic Model22 Feb 2024
- 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers18 Apr 2023
- 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iteration3 Oct 2022
- 2021Restoring degraded speech via a modified diffusion model22 Apr 2021
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 762
- 2022High Fidelity Neural Audio Compressioncited by 680
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 481
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 152
- 2022COIN++: Neural Compression Across Modalitiescited by 82
- 2021Neural Analysis and Synthesis: Reconstructing Speech from Self-Supervised Representationscited by 81
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
- 2021High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latencycited by 19
- 2022SOMOS: The Samsung Open MOS Dataset for the Evaluation of Neural Text-to-Speech Synthesiscited by 18
- 2022CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editingcited by 15
12 most cited of 101 All 101 (JSON)
- 2026GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding3 Oct 2026
- 2026Residual Modeling for High-Fidelity Learned Compression of Scientific Data3 Jun 2026
- 2025Pseudo-Cepstrum: Pitch Modification for Mel-Based Neural Vocoders18 Dec 2025
- 2025DHAuDS: A Dynamic and Heterogeneous Audio Benchmark for Test-Time Adaptation23 Nov 2025
- 2025High-Fidelity Speech Enhancement via Discrete Audio Tokens2 Oct 2025
- 2025Spiking Vocos: An Energy-Efficient Neural Vocoder16 Sep 2025
- 2024Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation7 Jul 2024
- 2024RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text30 May 2024
- 2024Decoupled Weight Decay for Any p Norm16 Apr 2024
- 2024Differentiable All-pole Filters for Time-varying Audio Systems11 Apr 2024
- 2024Creating an African American-Sounding TTS: Guidelines, Technical Challenges,and Surprising Evaluations17 Mar 2024
- 2024Low-Resource Cross-Domain Singing Voice Synthesis via Reduced Self-Supervised Speech Representations2 Feb 2024
12 newest of 101 All 101 (JSON)