Rethinking Batch Composition: Promoting Feature Diversity for Speech Enhancement
On the map: Speech and audio language models → Speech enhancement and noise suppression
Abstract (arXiv)
Speech enhancement systems are commonly trained using randomly sampled mini-batches, which may contain limited diversity in intrinsic acoustic characteristics of the clean speech signals. Motivated by previous findings linking clean speech characteristics to enhancement performance, we propose a feature-stratified mini-batch sampling strategy that divides training examples into quantiles according to a clean-speech characteristic and enforces equal representation within each mini-batch. Experiments across two large-scale English and Spanish speech datasets and a smaller dataset containing neurotypical and pathological speech demonstrate improvements over standard random mini-batch sampling across multiple objective enhancement metrics. Ablation studies demonstrate that the gains are robust across training runs, while their magnitude depends on the acoustic characteristic used for stratification. The proposed strategy requires no modification to the enhancement model or training objective, providing a simple and complementary approach to speech enhancement training.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 20 of its 35 references that are in the map. First posted on arXiv 15 Oct 2026.
Builds on
20 of 35 references.
Closest ancestors · 14
Same direction, newest first
- 2026Rethinking Training Targets, Architectures and Data Quality for Universal Speech Enhancement3 Mar
- 2025Influence of Clean Speech Characteristics on Speech Enhancement Performance23 Sep
- 2025FlowSE: Flow Matching-based Speech Enhancement9 Aug
- 2025Improving Speech Enhancement with Multi-Metric Supervision from Learned Quality Assessment13 Jun
- 2025Lessons Learned from the URGENT 2024 Speech Enhancement Challenge2 Jun
- 2025FUSE: Universal Speech Enhancement using Multi-Stage Fusion of Sparse Compression and Token Generation Models for the URGENT 2025 Challenge1 Jun
- 2025Interspeech 2025 URGENT Speech Enhancement Challenge29 May
- 2025Universal Speech Enhancement with Regression and Generative Mamba27 May
- 2024Schr"odinger Bridge for Generative Speech Enhancement22 Jul
- 2024Personalized Speech Enhancement Without a Separate Speaker Embedding Model14 Jun
- 2023Assessing the Generalization Gap of Learning-Based Speech Enhancement Systems in Noisy and Reverberant Environments12 Sep
- 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restoration4 Nov
2 more
Other references · 6
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,295
- 2018SDR - half-baked or well done?cited by 626
- 2020A consolidated view of loss functions for supervised deep learning-based speech enhancementcited by 43
- 2020Sparse Mixture of Local Experts for Efficient Speech Enhancementcited by 11
- 2025Variational Autoencoder for Personalized Pathological Speech Enhancementcited by 4
- 2025Navigating PESQ: Up-to-Date Versions and Open Implementationscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Scale This, Not That: Investigating Key Dataset Attributes for Efficient Speech Enhancement Scaling
- 2023On Batching Variable Size Inputs for Training End-to-End Speech Enhancement Systems
- 2025Less is More: Data Curation Matters in Scaling Speech Enhancement
- 2023Toward Universal Speech Enhancement for Diverse Input Conditions
- 2022A Systematic Comparison of Phonetic Aware Techniques for Speech Enhancement
- 2024Pre-training Feature Guided Diffusion Model for Speech Enhancement
- 2022A Training and Inference Strategy Using Noisy and Enhanced Speech as Target for Speech Enhancement without Clean Speech
- 2022Improving Speech Enhancement through Fine-Grained Speech Characteristics