mlsanityData to 19 Oct 2026

Navigating Speech Enhancement for Real-Time MRI: A Systematic Assessment of Signal Quality, Source Preservation, and Downstream Tasks

arXiv 2608.16125 ↗First posted 17 Aug 2026eess.AS eess.SPcited by 0

On the map: Speech and audio language models → Speech enhancement and noise suppression

Abstract (arXiv)

Audio recorded during real-time magnetic resonance imaging (rtMRI) is heavily contaminated by scanner noise, but it remains unclear whether general-purpose speech enhancement improves the signal for speech research and downstream processing. Three off-the-shelf systems---Denoiser, PASE, and RE-USE---are evaluated across five rtMRI corpora using naturally recorded inputs, a clean-input probe, and an archived paired additive-noise probe. The multi-task evaluation spans learned quality predictors, speaker and phone representations, reference-based intelligibility and quality measures, acoustic--phonetic probes, automatic speech recognition (ASR), and paralinguistic tasks. The central result is that enhancement effects are endpoint dependent: higher predicted-quality scores do not reliably imply better ASR performance or greater source fidelity. Across 15 corpus--recognizer comparisons using corpus-provided processed inputs, RE-USE yielded lower word-error-rate point estimates in 11, whereas Denoiser yielded higher estimates in 13. In the paired additive-noise probe, PASE and RE-USE improved recognized-phone agreement, intelligibility, and perceptual-quality point estimates. Denoiser improved recognized-phone agreement and short-time objective intelligibility (STOI) but reduced speaker-embedding similarity. No system was uniformly best across corpora, recognizers, and endpoints. Enhanced rtMRI audio should therefore be treated as a task-specific transformed derivative rather than a universally improved replacement for the original or DSP-processed waveform.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 15 of its 49 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

15 of 49 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Rethinking Training Targets, Architectures and Data Quality for Universal Speech Enhancement3 Mar
  2. 2025PASE: Leveraging the Phonological Prior of WavLM for Low-Hallucination Generative Speech Enhancement17 Nov

Other references · 13

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,661
  2. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 552
  3. 2020Real Time Speech Enhancement in the Waveform Domaincited by 282
  4. 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 263
  5. 2026Qwen3-ASR Technical Reportcited by 162
  6. 2024The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speechcited by 118
  7. 2022Pushing the limits of raw waveform speaker recognitioncited by 73
  8. 2021A multispeaker dataset of raw and reconstructed speech production real-time MRI video and 3D volumetric imagescited by 24
  9. 2023Speech-based Age and Gender Prediction with Transformerscited by 20
  10. 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speechcited by 15
  11. 2025SHEET: A Multi-purpose Open-source Speech Human Evaluation Estimation Toolkitcited by 8
  12. 2023Refining a Deep Learning-based Formant Tracker using Linear Prediction Methodscited by 3
1 more
  1. 2025A long-form single-speaker real-time MRI speech dataset and benchmarkcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025When De-noising Hurts: A Systematic Study of Speech Enhancement Effects on Modern Medical ASR Systems
  2. 2026Perceptually Better, Semantically Worse: Measuring Speech Enhancement Impact on LLM-Based Voice Systems
  3. 2023Naaloss: Rethinking the objective of speech enhancement
  4. 2024MRI2Speech: Speech Synthesis from Articulatory Movements Recorded by Real-time MRI
  5. 2026Where Speech Enhancement Hurts Recognition: An Inference Time Polar Projection Diagnosis
  6. 2025Lessons Learned from the URGENT 2024 Speech Enhancement Challenge
  7. 2025Probing Layer-Wise Robustness and Sensitivity of Speech Enhancement Models
  8. 2026Too Good to Be True: A Study on Modern Automatic Speech Recognition for the Evaluation of Speech Enhancement