From Diet to Free Lunch: Estimating Auxiliary Signal Properties using Dynamic Pruning Masks in Speech Enhancement Networks
Not on the map. Why?
Abstract (arXiv)
Speech Enhancement (SE) in audio devices is often supported by auxiliary modules for Voice Activity Detection (VAD), SNR estimation, or Acoustic Scene Classification to ensure robust context-aware behavior and seamless user experience. Just like SE, these tasks often employ deep learning; however, deploying additional models on-device is computationally impractical, whereas cloud-based inference would introduce additional latency and compromise privacy. Prior work on SE employed Dynamic Channel Pruning (DynCP) to reduce computation by adaptively disabling specific channels based on the current input. In this work, we investigate whether useful signal properties can be estimated from these internal pruning masks, thus removing the need for separate models. We show that simple, interpretable predictors achieve up to 93% accuracy on VAD, 84% on noise classification, and an R2 of 0.86 on F0 estimation. With binary masks, predictions reduce to weighted sums, inducing negligible overhead. Our contribution is twofold: on one hand, we examine the emergent behavior of DynCP models through the lens of downstream prediction tasks, to reveal what they are learning; on the other, we repurpose and re-propose DynCP as a holistic solution for efficient SE and simultaneous estimation of signal properties.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
23 of 36 references.
References · 23
- 2018SDR - half-baked or well done?cited by 420
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2020FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancementcited by 66
- 2023TorchAudio-Squim: Reference-less Speech Quality and Intelligibility measures in TorchAudiocited by 56
- 2021Deep Learning-based Non-Intrusive Multi-Objective Speech Assessment Model with Cross-Domain Featurescited by 32
- 2023DeepFilterNet: Perceptually Motivated Real-Time Speech Enhancementcited by 25
- 2020A Perceptually-Motivated Approach for Low-Complexity, Real-Time Enhancement of Fullband Speechcited by 23
- 2021DCCRN+: Channel-wise Subband DCCRN with SNR Estimation for Speech Enhancementcited by 22
- 2020Sparse Mixture of Local Experts for Efficient Speech Enhancementcited by 8
- 2020Speech Enhancement with Zero-Shot Model Selectioncited by 5
- 2024Dynamic Gated Recurrent Neural Network for Compute-efficient Speech Enhancementcited by 5
- 2024Scalable Speech Enhancement with Dynamic Channel Pruningcited by 5
11 more
- 2025Adaptive Slimming for Scalable and Efficient Speech Enhancementcited by 4
- 2025Investigating the Sensitivity of Pre-trained Audio Embeddings to Common Effectscited by 3
- 2025Dynamic Slimmable Networks for Efficient Speech Separationcited by 3
- 2014Understanding Locally Competitive Networkscited by 2
- 2020Speech enhancement aided end-to-end multi-task learning for voice activity detectioncited by 2
- 2022PercepNet+: A Phase and SNR Aware PercepNet for Real-Time Speech Enhancementcited by 2
- 2024Resource-Efficient Speech Quality Prediction through Quantization Aware Training and Binary Activation Mapscited by 2
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separationcited by 2
- 2023VSANet: Real-time Speech Enhancement Based on Voice Activity Detection and Causal Spatial Attentioncited by 1
- 2025Impairments are Clustered in Latents of Deep Neural Network-based Speech Quality Modelscited by 1
- 2025TGIF: Talker Group-Informed Familiarization of Target Speaker Extractioncited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.