Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Speech bandwidth expansion is crucial for expanding the frequency range of low-bandwidth speech signals, thereby improving audio quality, clarity and perceptibility in digital applications. Its applications span telephony, compression, text-to-speech synthesis, and speech recognition. This paper presents a novel approach using a high-fidelity generative adversarial network, unlike cascaded systems, our system is trained end-to-end on paired narrowband and wideband speech signals. Our method integrates various bandwidth upsampling ratios into a single unified model specifically designed for speech bandwidth expansion applications. Our approach exhibits robust performance across various bandwidth expansion factors, including those not encountered during training, demonstrating zero-shot capability. To the best of our knowledge, this is the first work to showcase this capability. The experimental results demonstrate that our method outperforms previous end-to-end approaches, as well as interpolation and traditional techniques, showcasing its effectiveness in practical speech enhancement applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 26 Jul 2024.
Builds on
22 of 49 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Segment Anythingcited by 8,158
- 2022Generative Adversarial Networkscited by 5,603
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2016Colorful Image Colorizationcited by 1,113
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
- 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
10 more
- 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
- 2022Neural Vocoder is All You Need for Speech Super-resolutioncited by 37
- 2019Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulationscited by 36
- 2017Audio Super Resolution using Neural Networkscited by 26
- 2018Improved Speech Enhancement with the Wave-U-Netcited by 23
- 2021WSRGlow: A Glow-based Waveform Generative Model for Audio Super-Resolutioncited by 19
- 2020NU-GAN: High resolution neural upsampling with GANcited by 11
- 2019Bandwidth Extension on Raw Audio via Generative Adversarial Networkscited by 10
- 2021Self-Attention for Audio Super-Resolutioncited by 9
- 2021TUNet: A Block-online Bandwidth Extension Model based on Transformers and Self-supervised Pretrainingcited by 8
Built on by
Not cited yet.