mlsanityData to 7 Oct 2026

A Dual-Branch Parallel Network for Speech Enhancement and Restoration

arXiv 2409.08702 ↗First posted 13 Sep 2024eess.AS cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a novel general speech restoration model, DBP-Net (dual-branch parallel network), designed to effectively handle complex real-world distortions including noise, reverberation, and bandwidth degradation. Unlike prior approaches that rely on a single processing path or separate models for enhancement and restoration, DBP-Net introduces a unified architecture with dual parallel branches-a masking-based branch for distortion suppression and a mapping-based branch for spectrum reconstruction. A key innovation behind DBP-Net lies in the parameter sharing between the two branches and a cross-branch skip fusion, where the output of the masking branch is explicitly fused into the mapping branch. This design enables DBP-Net to simultaneously leverage complementary learning strategies-suppression and generation-within a lightweight framework. Experimental results show that DBP-Net significantly outperforms existing baselines in comprehensive speech restoration tasks while maintaining a compact model size. These findings suggest that DBP-Net offers an effective and scalable solution for unified speech enhancement and restoration in diverse distortion scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 13 Sep 2024.

Builds on

15 of 31 references.

References · 15

  1. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 400
  2. 2017Supervised Speech Separation Based on Deep Learning: An Overviewcited by 213
  3. 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 195
  4. 2020Real Time Speech Enhancement in the Waveform Domaincited by 183
  5. 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
  6. 2023MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectracited by 51
  7. 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
  8. 2022VoiceFixer: A Unified Framework for High-Fidelity Speech Restorationcited by 37
  9. 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restorationcited by 34
  10. 2016A Fully Convolutional Neural Network for Speech Enhancementcited by 23
  11. 2024Universal Score-based Speech Enhancement with High Content Preservationcited by 23
  12. 2018Speech Dereverberation Using Fully Convolutional Networkscited by 14
3 more
  1. 2021TUNet: A Block-online Bandwidth Extension Model based on Transformers and Self-supervised Pretrainingcited by 8
  2. 2023An empirical study on speech restoration guided by self supervised speech representationcited by 2
  3. 2023HD-DEMUCS: General Speech Restoration with Heterogeneous Decoderscited by 2

Built on by

Not cited yet.