mlsanityData to 7 Oct 2026

End-to-End Optimized Speech Coding with Deep Neural Networks

arXiv 1710.09064 ↗First posted 25 Oct 2017cs.SD cs.LG eess.AScited by 21

Not on the map. Why?

Abstract (arXiv)

Modern compression algorithms are often the result of laborious domain-specific research; industry standards such as MP3, JPEG, and AMR-WB took years to develop and were largely hand-designed. We present a deep neural network model which optimizes all the steps of a wideband speech coding pipeline (compression, quantization, entropy coding, and decompression) end-to-end directly from raw speech data -- no manual feature engineering necessary, and it trains in hours. In testing, our DNN-based coder performs on par with the AMR-WB standard at a variety of bitrates (~9kbps up to ~24kbps). It also runs in realtime on a 3.8GhZ Intel CPU.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Oct 2017.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 7; 2023: 1; 2024: 7; 2025: 2.

21 papers.

Sort:

By area:

  1. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  2. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  3. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
  4. 2024SNAC: Multi-Scale Neural Audio Codeccited by 42
  5. 2023RepCodec: A Speech Representation Codec for Speech Tokenizationcited by 27
  6. 2022Audio-Visual Speech Codecs: Rethinking Audio-Visual Speech Enhancement by Re-Synthesiscited by 24
  7. 2024A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generationcited by 17
  8. 2025FlowDec: A flow-based full-band general audio codec with high perceptual qualitycited by 15
  9. 2024Low Frame-rate Speech Codec: a Codec Designed for Fast High-quality Speech LLM Training and Inferencecited by 11
  10. 2021HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Codingcited by 7
  11. 2022Disentangling speech from surroundings with neural embeddingscited by 6
  12. 2024Learning Source Disentanglement in Neural Audio Codeccited by 6
9 more
  1. 2021Scalable and Efficient Neural Speech Coding: A Hybrid Designcited by 5
  2. 2024Gull: A Generative Multifunctional Audio Codeccited by 5
  3. 2022Cross-Scale Vector Quantization for Scalable Neural Speech Codingcited by 3
  4. 2022NESC: Robust Neural End-2-End Speech Coding with GANscited by 3
  5. 2024FlowMAC: Conditional Flow Matching for Audio Coding at Low Bit Ratescited by 3
  6. 2024Neural Speech and Audio Coding: Modern AI Technology Meets Traditional Codecscited by 2
  7. 2021Deep Neural Networks and End-to-End Learning for Audio Compressioncited by 1
  8. 2022Conditional variational autoencoder to improve neural audio synthesis for polyphonic music soundcited by 1
  9. 2025EditGen: Harnessing Cross-Attention Control for Instruction-Based Auto-Regressive Audio Editingcited by 0