WHAMR!: Noisy and Reverberant Single-Channel Speech Separation
Not on the map. Why?
Abstract (arXiv)
While significant advances have been made with respect to the separation of overlapping speech signals, studies have been largely constrained to mixtures of clean, near anechoic speech, not representative of many real-world scenarios. Although the WHAM! dataset introduced noise to the ubiquitous wsj0-2mix dataset, it did not include reverberation, which is generally present in indoor recordings outside of recording studios. The spectral smearing caused by reverberation can result in significant performance degradation for standard deep learning-based speech separation systems, which rely on spectral structure and the sparsity of speech signals to tease apart sources. To address this, we introduce WHAMR!, an augmented version of WHAM! with synthetic reverberated sources, and provide a thorough baseline analysis of current techniques as well as novel cascaded architectures on the newly introduced conditions.
Key facts. Cited by 61 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 12; 2023: 10; 2024: 15; 2025: 13; 2026: 4.
61 papers.
Sort:
By area:
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2023MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentionscited by 27
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2024Cross-Domain Audio Deepfake Detection: Dataset and Analysiscited by 11
- 2024TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separationcited by 11
- 2024BSS-CFFMA: Cross-Domain Feature Fusion and Multi-Attention Speech Enhancement Network based on Self-Supervised Embeddingcited by 10
- 2024Advancing Multi-talker ASR Performance with Large Language Modelscited by 10
- 2021Teacher-Student MixIT for Unsupervised and Semi-supervised Speech Separationcited by 9
- 2023Diffusion Posterior Sampling for Informed Single-Channel Dereverberationcited by 9
- 2024Noise-robust Speech Separation with Fast Generative Correctioncited by 9
- 2023Perceive and predict: self-supervised speech representation based loss functions for speech enhancementcited by 8
- 2021REAL-M: Towards Speech Separation on Real Mixturescited by 7
38 more
- 2022Improving the Naturalness of Simulated Conversations for End-to-End Neural Diarizationcited by 7
- 2022Receptive Field Analysis of Temporal Convolutional Networks for Monaural Speech Dereverberationcited by 6
- 2024Joint Semantic Knowledge Distillation and Masked Acoustic Modeling for Full-band Speech Restoration with Improved Intelligibilitycited by 5
- 2021Stepwise-Refining Speech Separation Network via Fine-Grained Encoding in High-order Latent Domaincited by 4
- 2022Exploring Self-Attention Mechanisms for Speech Separationcited by 4
- 2024Knowledge boosting during low-latency inferencecited by 4
- 2024LibriheavyMix: A 20,000-Hour Dataset for Single-Channel Reverberant Multi-Talker Speech Separation, ASR and Speaker Diarizationcited by 4
- 2024SonicSim: A customizable simulation platform for speech processing in moving sound source scenarioscited by 4
- 2025A Study of the Scale Invariant Signal to Distortion Ratio in Speech Separation with Noisy Referencescited by 4
- 2022Disentangling the Impacts of Language and Channel Variability on Speech Separation Networkscited by 3
- 2022Utterance Weighted Multi-Dilation Temporal Convolutional Networks for Monaural Speech Dereverberationcited by 3
- 2022Deformable Temporal Convolutional Networks for Monaural Noisy Reverberant Speech Separationcited by 3
- 2023The Effect of Spoken Language on Speech Enhancement using Self-Supervised Speech Representation Loss Functionscited by 3
- 2023On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environmentscited by 3
- 2024Improving Generalization of Speech Separation in Real-World Scenarios: Strategies in Simulation, Optimization, and Evaluationcited by 3
- 2021Time-Domain Speech Extraction with Spatial Information and Multi Speaker Conditioning Mechanismcited by 2
- 2022CasNet: Investigating Channel Robustness for Speech Separationcited by 2
- 2022Reverberation as Supervision for Speech Separationcited by 2
- 2023A Multi-Stage Triple-Path Method for Speech Separation in Noisy and Reverberant Environmentscited by 2
- 2023On Data Sampling Strategies for Training Neural Network Speech Separation Modelscited by 2
- 2024U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separationcited by 2
- 2025SepALM: Audio Language Models Are Error Correctors for Robust Speech Separationcited by 2
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separationcited by 2
- 2026SpurAudio: A Benchmark for Studying Shortcut Learning in Few-Shot Audio Classificationcited by 2
- 2022Customizable End-to-end Optimization of Online Neural Network-supported Dereverberation for Hearing Devicescited by 1
- 2022Neural Network-augmented Kalman Filtering for Robust Online Speech Dereverberation in Noisy Reverberant Environmentscited by 1
- 2022Analysis of impact of emotions on target speech extraction and speech separationcited by 1
- 2023A Comparison of Speech Data Augmentation Methods Using S3PRL Toolkitcited by 1
- 2024Transcription-Free Fine-Tuning of Speech Separation Models for Noisy and Reverberant Multi-Speaker Automatic Speech Recognitioncited by 1
- 2024Speech Separation with Pretrained Frontend to Minimize Domain Mismatchcited by 1
- 2025Time-Frequency-Based Attention Cache Memory Model for Real-Time Speech Separationcited by 1
- 2025Training-Free Multi-Step Audio Source Separationcited by 1
- 2025GenTSE: Enhancing Target Speaker Extraction via a Coarse-to-Fine Generative Language Modelcited by 1
- 2026Improving multichannel speech enhancement through accurate room-acoustic simulationscited by 1
- 2026Training DeepFilterNet with Accurate Room Acoustic Simulations Improves Single-Channel Speech Enhancementcited by 1
- 2021Online Self-Attentive Gated RNNs for Real-Time Speaker Separationcited by 0
- 2022A neural network-supported two-stage algorithm for lightweight dereverberation on hearing devicescited by 0
- 2023Speech Separation based on Contrastive Learning and Deep Modularizationcited by 0
50 most cited of 61 All 61 (JSON)
- 2026Training DeepFilterNet with Accurate Room Acoustic Simulations Improves Single-Channel Speech Enhancement21 Aug 2026
- 2026Improving multichannel speech enhancement through accurate room-acoustic simulations30 Jun 2026
- 2026SpurAudio: A Benchmark for Studying Shortcut Learning in Few-Shot Audio Classification13 May 2026
- 2026Predictive-Generative Drift Decomposition for Speech Enhancement and Separation7 May 2026
- 2025GenTSE: Enhancing Target Speaker Extraction via a Coarse-to-Fine Generative Language Model24 Dec 2025
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025Better audio representations are more brain-like: linking model-brain alignment with performance in downstream auditory tasks20 Nov 2025
- 2025TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separation19 Sep 2025
- 2025SpeechOp: Inference-Time Task Composition for Generative Speech Processing17 Sep 2025
- 2025A Study of the Scale Invariant Signal to Distortion Ratio in Speech Separation with Noisy References20 Aug 2025
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separation13 Jul 2025
- 2025GRAM: Spatial general-purpose audio representation models for real-world applications1 Jun 2025
38 more
- 2025Training-Free Multi-Step Audio Source Separation26 May 2025
- 2025Time-Frequency-Based Attention Cache Memory Model for Real-Time Speech Separation19 May 2025
- 2025SepALM: Audio Language Models Are Error Correctors for Robust Speech Separation6 May 2025
- 2025How much to Dereverberate? Low-Latency Single-Channel Speech Enhancement in Distant Microphone Scenarios2 May 2025
- 2025Magnitude-Phase Dual-Path Speech Enhancement Network based on Self-Supervised Embedding and Perceptual Contrast Stretch Boosting27 Mar 2025
- 2024U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separation24 Dec 2024
- 2024Speech Separation with Pretrained Frontend to Minimize Domain Mismatch5 Nov 2024
- 2024SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios2 Oct 2024
- 2024TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separation2 Oct 2024
- 2024Joint Semantic Knowledge Distillation and Masked Acoustic Modeling for Full-band Speech Restoration with Improved Intelligibility14 Sep 2024
- 2024LibriheavyMix: A 20,000-Hour Dataset for Single-Channel Reverberant Multi-Talker Speech Separation, ASR and Speaker Diarization1 Sep 2024
- 2024Advancing Multi-talker ASR Performance with Large Language Models30 Aug 2024
- 2024Improving Generalization of Speech Separation in Real-World Scenarios: Strategies in Simulation, Optimization, and Evaluation28 Aug 2024
- 2024BSS-CFFMA: Cross-Domain Feature Fusion and Multi-Attention Speech Enhancement Network based on Self-Supervised Embedding13 Aug 2024
- 2024Survey: Transformer-based Models in Data Modality Conversion8 Aug 2024
- 2024Knowledge boosting during low-latency inference9 Jul 2024
- 2024Transcription-Free Fine-Tuning of Speech Separation Models for Noisy and Reverberant Multi-Speaker Automatic Speech Recognition13 Jun 2024
- 2024Noise-robust Speech Separation with Fast Generative Correction11 Jun 2024
- 2024Effects of Dataset Sampling Rate for Noise Cancellation through Deep Learning30 May 2024
- 2024Cross-Domain Audio Deepfake Detection: Dataset and Analysis7 Apr 2024
- 2023On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environments9 Oct 2023
- 2023The Effect of Spoken Language on Speech Enhancement using Self-Supervised Speech Representation Loss Functions27 Jul 2023
- 2023Exploring the Integration of Speech Separation and Recognition with Self-Supervised Learning Representation23 Jul 2023
- 2023Diffusion Posterior Sampling for Informed Single-Channel Dereverberation21 Jun 2023
- 2023Speech Separation based on Contrastive Learning and Deep Modularization18 May 2023
- 2023On Data Sampling Strategies for Training Neural Network Speech Separation Models14 Apr 2023
- 2023A Multi-Stage Triple-Path Method for Speech Separation in Noisy and Reverberant Environments7 Mar 2023
- 2023A Comparison of Speech Data Augmentation Methods Using S3PRL Toolkit27 Feb 2023
- 2023MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentions23 Feb 2023
- 2023Perceive and predict: self-supervised speech representation based loss functions for speech enhancement11 Jan 2023
- 2022Reverberation as Supervision for Speech Separation15 Nov 2022
- 2022CasNet: Investigating Channel Robustness for Speech Separation27 Oct 2022
- 2022Deformable Temporal Convolutional Networks for Monaural Noisy Reverberant Speech Separation27 Oct 2022
- 2022Analysis of impact of emotions on target speech extraction and speech separation15 Aug 2022
- 2022Utterance Weighted Multi-Dilation Temporal Convolutional Networks for Monaural Speech Dereverberation17 May 2022
- 2022Improving the Naturalness of Simulated Conversations for End-to-End Neural Diarization24 Apr 2022
- 2022Receptive Field Analysis of Temporal Convolutional Networks for Monaural Speech Dereverberation13 Apr 2022
- 2022A neural network-supported two-stage algorithm for lightweight dereverberation on hearing devices6 Apr 2022
50 newest of 61 All 61 (JSON)
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2023MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentionscited by 27
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
- 2024Cross-Domain Audio Deepfake Detection: Dataset and Analysiscited by 11
- 2024TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separationcited by 11
- 2024BSS-CFFMA: Cross-Domain Feature Fusion and Multi-Attention Speech Enhancement Network based on Self-Supervised Embeddingcited by 10
- 2024Advancing Multi-talker ASR Performance with Large Language Modelscited by 10
- 2023Perceive and predict: self-supervised speech representation based loss functions for speech enhancementcited by 8
- 2021REAL-M: Towards Speech Separation on Real Mixturescited by 7
- 2022Improving the Naturalness of Simulated Conversations for End-to-End Neural Diarizationcited by 7
- 2022Receptive Field Analysis of Temporal Convolutional Networks for Monaural Speech Dereverberationcited by 6
- 2021Stepwise-Refining Speech Separation Network via Fine-Grained Encoding in High-order Latent Domaincited by 4
12 most cited of 55 All 55 (JSON)
- 2026Training DeepFilterNet with Accurate Room Acoustic Simulations Improves Single-Channel Speech Enhancement21 Aug 2026
- 2026Improving multichannel speech enhancement through accurate room-acoustic simulations30 Jun 2026
- 2026SpurAudio: A Benchmark for Studying Shortcut Learning in Few-Shot Audio Classification13 May 2026
- 2026Predictive-Generative Drift Decomposition for Speech Enhancement and Separation7 May 2026
- 2025GenTSE: Enhancing Target Speaker Extraction via a Coarse-to-Fine Generative Language Model24 Dec 2025
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
- 2025Better audio representations are more brain-like: linking model-brain alignment with performance in downstream auditory tasks20 Nov 2025
- 2025TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separation19 Sep 2025
- 2025SpeechOp: Inference-Time Task Composition for Generative Speech Processing17 Sep 2025
- 2025A Study of the Scale Invariant Signal to Distortion Ratio in Speech Separation with Noisy References20 Aug 2025
- 2025GRAM: Spatial general-purpose audio representation models for real-world applications1 Jun 2025
- 2025Training-Free Multi-Step Audio Source Separation26 May 2025
12 newest of 55 All 55 (JSON)