Real-time Speech Frequency Bandwidth Extension
Not on the map. Why?
Abstract (arXiv)
In this paper we propose a lightweight model for frequency bandwidth extension of speech signals, increasing the sampling frequency from 8kHz to 16kHz while restoring the high frequency content to a level almost indistinguishable from the 16kHz ground truth. The model architecture is based on SEANet (Sound EnhAncement Network), a wave-to-wave fully convolutional model, which uses a combination of feature losses and adversarial losses to reconstruct an enhanced version of the input speech. In addition, we propose a variant of SEANet that can be deployed on-device in streaming mode, achieving an architectural latency of 16ms. When profiled on a single core of a mobile CPU, processing one 16ms frame takes only 1.5ms. The low latency makes it viable for bi-directional voice communication systems.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 4; 2024: 4; 2025: 5; 2026: 2.
22 papers.
Sort:
By area:
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2022AudioGen: Textually Guided Audio Generationcited by 295
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
- 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
- 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
- 2024StreamVC: Real-Time Low-Latency Voice Conversioncited by 15
- 2025Neural Codecs as Biosignal Tokenizerscited by 14
- 2024TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platformscited by 11
10 more
- 2024Gull: A Generative Multifunctional Audio Codeccited by 5
- 2022Differentiable WORLD Synthesizer-based Neural Vocoder With Application To End-To-End Audio Style Transfercited by 3
- 2024SoundLoCD: An Efficient Conditional Discrete Contrastive Latent Diffusion Model for Text-to-Sound Generationcited by 3
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matchingcited by 3
- 2023Guided Speech Enhancement Networkcited by 1
- 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Losscited by 1
- 2026Do Neural Codecs Generalize? A Controlled Study Across Unseen Languages and Non-Speech Taskscited by 1
- 2025Neural Spectral Band Generation for Audio Codingcited by 0
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsamplingcited by 0
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifierscited by 0
- 2026Do Neural Codecs Generalize? A Controlled Study Across Unseen Languages and Non-Speech Tasks18 Jan 2026
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifiers6 Jan 2026
- 2025Neural Codecs as Biosignal Tokenizers10 Oct 2025
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching1 Oct 2025
- 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Loss30 Jun 2025
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsampling27 Jun 2025
- 2025Neural Spectral Band Generation for Audio Coding7 Jun 2025
- 2024SoundLoCD: An Efficient Conditional Discrete Contrastive Latent Diffusion Model for Text-to-Sound Generation24 May 2024
- 2024TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms2 May 2024
- 2024Gull: A Generative Multifunctional Audio Codec7 Apr 2024
- 2024StreamVC: Real-Time Low-Latency Voice Conversion5 Jan 2024
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimation30 Nov 2023
10 more
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codec14 Sep 2023
- 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approach2 Jun 2023
- 2023Guided Speech Enhancement Network13 Mar 2023
- 2022AERO: Audio Super Resolution in the Spectral Domain22 Nov 2022
- 2022High Fidelity Neural Audio Compression24 Oct 2022
- 2022AudioGen: Textually Guided Audio Generation30 Sep 2022
- 2022Differentiable WORLD Synthesizer-based Neural Vocoder With Application To End-To-End Audio Style Transfer15 Aug 2022
- 2022Universal Speech Enhancement with Score-based Diffusion7 Jun 2022
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancement24 Mar 2022
- 2021SoundStream: An End-to-End Neural Audio Codec7 Jul 2021
- 2024SoundLoCD: An Efficient Conditional Discrete Contrastive Latent Diffusion Model for Text-to-Sound Generationcited by 3
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matchingcited by 3
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifierscited by 0
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifiers6 Jan 2026
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching1 Oct 2025
- 2024SoundLoCD: An Efficient Conditional Discrete Contrastive Latent Diffusion Model for Text-to-Sound Generation24 May 2024
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2022AudioGen: Textually Guided Audio Generationcited by 295
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
- 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
- 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
- 2024StreamVC: Real-Time Low-Latency Voice Conversioncited by 15
- 2025Neural Codecs as Biosignal Tokenizerscited by 14
- 2024Gull: A Generative Multifunctional Audio Codeccited by 5
12 most cited of 18 All 18 (JSON)
- 2026Do Neural Codecs Generalize? A Controlled Study Across Unseen Languages and Non-Speech Tasks18 Jan 2026
- 2025Neural Codecs as Biosignal Tokenizers10 Oct 2025
- 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Loss30 Jun 2025
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsampling27 Jun 2025
- 2025Neural Spectral Band Generation for Audio Coding7 Jun 2025
- 2024Gull: A Generative Multifunctional Audio Codec7 Apr 2024
- 2024StreamVC: Real-Time Low-Latency Voice Conversion5 Jan 2024
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimation30 Nov 2023
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codec14 Sep 2023
- 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approach2 Jun 2023
- 2023Guided Speech Enhancement Network13 Mar 2023
- 2022AERO: Audio Super Resolution in the Spectral Domain22 Nov 2022
12 newest of 18 All 18 (JSON)