mlsanityData to 7 Oct 2026

Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks

arXiv 2407.18571 ↗First posted 26 Jul 2024cs.SD cs.AI eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Speech bandwidth expansion is crucial for expanding the frequency range of low-bandwidth speech signals, thereby improving audio quality, clarity and perceptibility in digital applications. Its applications span telephony, compression, text-to-speech synthesis, and speech recognition. This paper presents a novel approach using a high-fidelity generative adversarial network, unlike cascaded systems, our system is trained end-to-end on paired narrowband and wideband speech signals. Our method integrates various bandwidth upsampling ratios into a single unified model specifically designed for speech bandwidth expansion applications. Our approach exhibits robust performance across various bandwidth expansion factors, including those not encountered during training, demonstrating zero-shot capability. To the best of our knowledge, this is the first work to showcase this capability. The experimental results demonstrate that our method outperforms previous end-to-end approaches, as well as interpolation and traditional techniques, showcasing its effectiveness in practical speech enhancement applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 26 Jul 2024.

Builds on

22 of 49 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023Segment Anythingcited by 8,158
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  6. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  7. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  8. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  9. 2016Colorful Image Colorizationcited by 1,113
  10. 2016Least Squares Generative Adversarial Networkscited by 1,000
  11. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  12. 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
10 more
  1. 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
  2. 2022Neural Vocoder is All You Need for Speech Super-resolutioncited by 37
  3. 2019Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulationscited by 36
  4. 2017Audio Super Resolution using Neural Networkscited by 26
  5. 2018Improved Speech Enhancement with the Wave-U-Netcited by 23
  6. 2021WSRGlow: A Glow-based Waveform Generative Model for Audio Super-Resolutioncited by 19
  7. 2020NU-GAN: High resolution neural upsampling with GANcited by 11
  8. 2019Bandwidth Extension on Raw Audio via Generative Adversarial Networkscited by 10
  9. 2021Self-Attention for Audio Super-Resolutioncited by 9
  10. 2021TUNet: A Block-online Bandwidth Extension Model based on Transformers and Self-supervised Pretrainingcited by 8

Built on by

Not cited yet.