mlsanityData to 14 Oct 2026

End-to-End Neural Speech Coding for Real-Time Communications

arXiv 2201.09429 ↗First posted 24 Jan 2022cs.SD cs.LG eess.AScited by 7

Not on the map. Why?

Abstract (arXiv)

Deep-learning based methods have shown their advantages in audio coding over traditional ones but limited attention has been paid on real-time communications (RTC). This paper proposes the TFNet, an end-to-end neural speech codec with low latency for RTC. It takes an encoder-temporal filtering-decoder paradigm that has seldom been investigated in audio coding. An interleaved structure is proposed for temporal filtering to capture both short-term and long-term temporal dependencies. Furthermore, with end-to-end optimization, the TFNet is jointly optimized with speech enhancement and packet loss concealment, yielding a one-for-all network for three tasks. Both subjective and objective results demonstrate the efficiency of the proposed TFNet.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 24 Jan 2022.

Builds on

17 of 23 references.

References · 17

  1. 2017Neural Discrete Representation Learningcited by 4,712
  2. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  3. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
  4. 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 241
  5. 2018Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separationcited by 162
  6. 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 110
  7. 2019Low Bit-Rate Speech Coding with VQ-VAE and a WaveNet Decodercited by 49
  8. 2018Differentiable Consistency Constraints for Improved Deep Speech Enhancementcited by 35
  9. 2017Wavenet based low rate speech codingcited by 33
  10. 2020ICASSP 2021 Deep Noise Suppression Challengecited by 27
  11. 2021Generative Speech Coding with Predictive Variance Regularizationcited by 18
  12. 2019Cascaded Cross-Module Residual Learning towards Lightweight End-to-End Speech Codingcited by 15
5 more
  1. 2018High-quality speech coding with SampleRNNcited by 14
  2. 2020Interactive Speech and Noise Modeling for Speech Enhancementcited by 13
  3. 2020Learning Disentangled Phone and Speaker Representations in a Semi-Supervised VQ-VAE Paradigmcited by 12
  4. 2019Improving Opus Low Bit Rate Quality with Neural Speech Synthesiscited by 9
  5. 2020Source coding of audio signals with a generative modelcited by 7

Built on by

Cited by year

Citing papers per year: 2022: 5; 2023: 1; 2024: 1.

7 papers.

  1. 2022High Fidelity Neural Audio Compressioncited by 687
  2. 2022CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streamingcited by 23
  3. 2022Disentangled Feature Learning for Real-Time Neural Speech Codingcited by 10
  4. 2022Latent-Domain Predictive Neural Speech Codingcited by 7
  5. 2022Cross-Scale Vector Quantization for Scalable Neural Speech Codingcited by 3
  6. 2024FlowMAC: Conditional Flow Matching for Audio Coding at Low Bit Ratescited by 3
  7. 2023AudioFormer: Audio Transformer learns audio feature representations from discrete acoustic codescited by 1