mlsanityData to 19 Oct 2026

Where Speech Enhancement Hurts Recognition: An Inference Time Polar Projection Diagnosis

arXiv 2607.11157 ↗First posted 13 Jul 2026eess.AScited by 0

On the map: Speech and audio language models → Speech enhancement and noise suppression

Abstract (arXiv)

Speech enhancement (SE) can substantially improve perceptual quality, yet enhanced speech does not necessarily improve automatic speech recognition (ASR). Common explanations such as enhancement artifacts and over-suppression remain qualitative and do not localize which enhancement component affects recognition. We study inference-time polar projection, which transforms an STFT mask M=Aejφ into Mα,γ=Aα ejγφ and independently varies magnitude strength and estimated phase correction with frozen SE and ASR models. The resulting response curves separate effects that are coupled in ordinary enhanced-vs-noisy comparisons. On VoiceBank+DEMAND with FRCRN, wav2vec2.0 improves from 17.13 to 10.20 WER near full magnitude correction (α=.85), while Whisper reaches its best WER under much weaker correction, improving from 6.44 to 5.57 at α=.25 and returning to 6.46 at full magnitude. A second enhancer, a robustness-oriented ASR model, and a reverberant WSJ0 mixture set generalize the pattern and show that the preferred magnitude region depends on the recognizer and acoustic condition. Estimated phase correction is not a stable ASR lever in these evaluations: its effect is smaller, setting-dependent, and provides no consistent gain once magnitude strength is fixed.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 28 of its 47 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

28 of 47 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026Too Good to Be True: A Study on Modern Automatic Speech Recognition for the Evaluation of Speech Enhancement12 May
  2. 2026Training-Free Intelligibility-Guided Observation Addition for Noisy ASR24 Feb
  3. 2025When De-noising Hurts: A Systematic Study of Speech Enhancement Effects on Modern Medical ASR Systems19 Dec
  4. 2025MeanFlowSE: one-step generative speech enhancement via conditional mean flow18 Sep
  5. 2025FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching26 May
  6. 2024Rethinking Processing Distortions: Disentangling the Impact of Speech Enhancement Errors on Speech Recognition Performance23 Apr
  7. 2023How does end-to-end speech recognition training impact speech enhancement artifacts?20 Nov
  8. 2022FRCRN: Boosting Feature Representation using Frequency Recurrence for Monaural Speech Enhancement15 Jun
  9. 2022Mask scalar prediction for improving robust automatic speech recognition26 Apr
  10. 2022How Bad Are Artifacts?: Analyzing the Impact of Speech Enhancement Errors on ASR18 Jan
  11. 2022Learning to Enhance or Not: Neural Network-Based Switching of Enhanced and Observed Signals for Overlapping Speech Recognition11 Jan
  12. 2021Effect of noise suppression losses on speech distortion and ASR performance23 Nov
6 more
  1. 2021SNRi Target Training for Joint Speech Enhancement and Recognition1 Nov
  2. 2021Interactive Feature Fusion for End-to-End Noise-Robust Speech Recognition11 Oct
  3. 2021Task-aware Warping Factors in Mask-based Speech Enhancement27 Aug
  4. 2021On The Compensation Between Magnitude and Phase in Speech Separation11 Aug
  5. 2021Should We Always Separate?: Switching Between Enhanced and Observed Signals for Overlapping Speech Recognition2 Jun
  6. 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancement8 Apr

Other references · 10

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,661
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 4,385
  3. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 596
  4. 2019WHAM!: Extending Speech Separation to Noisy Environmentscited by 246
  5. 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 183
  6. 2017A Wavenet for Speech Denoisingcited by 69
  7. 2023MossFormer2: Combining Transformer and RNN-Free Recurrent Network for Enhanced Time-Domain Monaural Speech Separationcited by 51
  8. 2020Dual Application of Speech Enhancement for Automatic Speech Recognitioncited by 18
  9. 2025ClearerVoice-Studio: Bridging Advanced Speech Processing Research and Practical Deploymentcited by 17
  10. 2018End-to-End Speech Separation with Unfolded Iterative Phase Reconstructioncited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Mitigating Over-Suppression in Speech Enhancement via Inference-Time Rethink-and-Refine Correction Module
  2. 2021Learning to Inference with Early Exit in the Progressive Speech Enhancement
  3. 2026Perceptually Better, Semantically Worse: Measuring Speech Enhancement Impact on LLM-Based Voice Systems
  4. 2026Rethinking Training Targets, Architectures and Data Quality for Universal Speech Enhancement
  5. 2025Probing Layer-Wise Robustness and Sensitivity of Speech Enhancement Models
  6. 2026Test-Time Adaptation For Speech Enhancement Via Mask Polarization
  7. 2023Naaloss: Rethinking the objective of speech enhancement
  8. 2023PAAPLoss: A Phonetic-Aligned Acoustic Parameter Loss for Speech Enhancement