mlsanityData to 19 Oct 2026

BANC: Towards Efficient Binaural Audio Neural Codec for Overlapping Speech

arXiv 2309.07416 ↗First posted 14 Sep 2023cs.SD eess.AScited by 2

On the map: Speech and audio language models → Vocoders and speech synthesis

Abstract (arXiv)

We introduce BANC, a neural binaural audio codec designed for efficient speech compression in single and two-speaker scenarios while preserving the spatial location information of each speaker. Our key contributions are as follows: 1) The ability of our proposed model to compress and decode overlapping speech. 2) A novel architecture that compresses speech content and spatial cues separately, ensuring the preservation of each speaker's spatial context after decoding. 3) BANC's proficiency in reducing the bandwidth required for compressing binaural speech by 48% compared to compressing individual binaural channels. In our evaluation, we employed speech enhancement, room acoustics, and perceptual metrics to assess the accuracy of BANC's clean speech and spatial cue estimates.

Key facts. Cited by 2 papers in the map (data through 19 Oct 2026). Placed in Vocoders and speech synthesis, one of 11 directions in Speech and audio language models. Builds on 18 of its 30 references that are in the map. First posted on arXiv 14 Sep 2023.

Builds on

18 of 30 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023AudioDec: An Open-source Streaming High-fidelity Neural Audio Codec26 May
  2. 2023HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codec4 May
  3. 2021SoundStream: An End-to-End Neural Audio Codec7 Jul

Other references · 15

  1. 2017Neural Discrete Representation Learningcited by 4,843
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,462
  3. 2022High Fidelity Neural Audio Compressioncited by 917
  4. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 596
  5. 2021FAST-RIR: Fast neural diffuse room impulse response generatorcited by 36
  6. 2022Audio-Visual Speech Codecs: Rethinking Audio-Visual Speech Enhancement by Re-Synthesiscited by 29
  7. 2022MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenescited by 24
  8. 2018High-quality speech coding with SampleRNNcited by 23
  9. 2020Real-time binaural speech separation with preserved spatial cuescited by 22
  10. 2021Filtered Noise Shaping for Time Domain Room Impulse Response Estimation From Reverberant Speechcited by 17
  11. 2019Improving Opus Low Bit Rate Quality with Neural Speech Synthesiscited by 14
  12. 2019Improving Reverberant Speech Training Using Diffuse Acoustic Simulationcited by 13
3 more
  1. 2021TS-RIR: Translated synthetic room impulse responses for speech augmentationcited by 13
  2. 2020Source coding of audio signals with a generative modelcited by 11
  3. 2022Towards Improved Room Impulse Response Estimation for Speech Recognitioncited by 11

Built on by

Cited by year (2026 to 19 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.

  1. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 107
  2. 2026VCNAC: A Variable-Channel Neural Audio Codec for Mono, Stereo, and Surround Soundcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Audio Codec-based Speech Separation
  2. 2024A Lightweight and Real-Time Binaural Speech Enhancement Model with Spatial Cues Preservation
  3. 2025BSCodec: A Band-Split Neural Codec for High-Quality Universal Audio Reconstruction
  4. 2024End-to-end multi-channel speaker extraction and binaural speech synthesis
  5. 2026A Novel Binaural Cue Preservation Loss for DNN-Based Binaural Speech Enhancement
  6. 2024HILCodec: High-Fidelity and Lightweight Neural Audio Codec
  7. 2025FOA Tokenizer: Low-bitrate Neural Codec for First Order Ambisonics with Spatial Consistency Loss
  8. 2026VoCodec: An Efficient Lightweight Low-Bitrate Speech Codec