LDCodec: A high quality neural audio codec with low-complexity decoder
On the map: Speech and audio language models → Vocoders and speech synthesis
Abstract (arXiv)
Neural audio coding has been shown to outperform classical audio coding at extremely low bitrates. However, the practical application of neural audio codecs is still limited by their elevated complexity. To address this challenge, we have developed a high-quality neural audio codec with a low-complexity decoder, named LDCodec (Low-complexity Decoder Neural Audio Codec), specifically designed for on-demand streaming media clients, such as smartphones. Specifically, we introduced a novel residual unit combined with Long-term and Short-term Residual Vector Quantization (LSRVQ), subband-fullband frequency discriminators, and perceptual loss functions. This combination results in high-quality audio reconstruction with lower complexity. Both our subjective and objective tests demonstrated that our proposed LDCodec at 6kbps outperforms Opus at 12kbps.
Key facts. Cited by 1 paper in the map (data through 19 Oct 2026). Placed in Vocoders and speech synthesis, one of 11 directions in Speech and audio language models. Builds on 15 of its 18 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
15 of 18 references.
Closest ancestors · 5
Same direction, newest first
- 2024SNAC: Multi-Scale Neural Audio Codec18 Oct
- 2024An Intra-BRNN and GB-RVQ Based END-TO-END Neural Audio Codec2 Feb
- 2023Fewer-token Neural Speech Codec with Time-invariant Codes15 Sep
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codec14 Sep
- 2021SoundStream: An End-to-End Neural Audio Codec7 Jul
Other references · 10
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,462
- 2022High Fidelity Neural Audio Compressioncited by 917
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 864
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 619
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 425
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 315
- 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 152
- 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 120
- 2021UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generationcited by 107
- 2022Latent-Domain Predictive Neural Speech Codingcited by 14
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024HILCodec: High-Fidelity and Lightweight Neural Audio Codec
- 2023AudioDec: An Open-source Streaming High-fidelity Neural Audio Codec
- 2024APCodec+: A Spectrum-Coding-Based High-Fidelity and High-Compression-Rate Neural Audio Codec with Staged Training Paradigm
- 2026TQCodec: Towards neural audio codec for high-fidelity music streaming ↗
- 2025A Streamable Neural Audio Codec with Residual Scalar-Vector Quantization for Real-Time Communication
- 2026ZipCodec: Ultra-Low-Frame-Rate Streaming Speech Coding
- 2024APCodec: A Neural Audio Codec with Parallel Amplitude and Phase Spectrum Encoding and Decoding
- 2025Low-Resource Audio Codec (LRAC): 2025 Challenge Description