Performance optimizations on deep noise suppression models
Not on the map. Why?
Abstract (arXiv)
We study the role of magnitude structured pruning as an architecture search to speed up the inference time of a deep noise suppression (DNS) model. While deep learning approaches have been remarkably successful in enhancing audio quality, their increased complexity inhibits their deployment in real-time applications. We achieve up to a 7.25X inference speedup over the baseline, with a smooth model performance degradation. Ablation studies indicate that our proposed network re-parameterization (i.e., size per layer) is the major driver of the speedup, and that magnitude structured pruning does comparably to directly training a model in the smaller size. We report inference speed because a parameter reduction does not necessitate speedup, and we measure model quality using an accurate non-intrusive objective speech quality metric.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 8 Oct 2021.
Builds on
12 of 25 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2018Rethinking the Value of Network Pruningcited by 595
- 2019The State of Sparsity in Deep Neural Networkscited by 471
- 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 235
- 2021Interspeech 2021 Deep Noise Suppression Challengecited by 43
- 2018Differentiable Consistency Constraints for Improved Deep Speech Enhancementcited by 35
- 2020A Survey on Deep Neural Network Compression: Challenges, Overview, and Solutionscited by 32
- 2021Towards efficient models for real-time deep noise suppressioncited by 28
- 2021PQK: Model Compression via Pruning, Quantization, and Knowledge Distillationcited by 19
- 2020Weighted Speech Distortion Losses for Neural-network-based Real-time Speech Enhancementcited by 18
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning
- 2026Deterministic Differentiable Structured Pruning for Large Language Models
- 2025MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
- 2026Efficient Text-to-Audio Generation via Pruning
- 2025Segmentwise Pruning in Audio-Language Models
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separation
- 2026Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement
- 2024Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement