mlsanityData to 14 Oct 2026

NOPE-HYPE: A Structured Simulation Workflow for Robust Speech-to-Text Across Diverse Acoustic Environments

arXiv 2609.10058 ↗First posted 9 Sep 2026cs.SD cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Robust speech-to-text translation systems should perform reliably across diverse acoustic conditions, yet practical pipelines lack controllable tools for systematic environment exploration. Large speech models remain sensitive to unseen acoustic conditions, as training data rarely cover the full range of real environments.We present NOPEHYPE, a structured training workflow that combines a controllable environment simulator, coverage-optimal environment reduction on Power Spectral Density (PSD) templates, and a small, interpretable hyperparameter search over simulator knobs. We show that simulator-generated noise achieves performance comparable to balanced realnoise training across Whisper and SeamlessM4T models, provide principled environment prototype sets, and identify practical default simulator configurations from a structured 27-run hyperparameter sweep.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

12 of 18 references.

References · 12

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  3. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  4. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  5. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  6. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 354
  7. 2023SeamlessM4T: Massively Multilingual & Multimodal Machine Translationcited by 125
  8. 2021SynthASR: Unlocking Synthetic Data for Speech Recognitioncited by 34
  9. 2021SpecMix : A Mixed Sample Data Augmentation method for Training withTime-Frequency Domain Featurescited by 31
  10. 2021SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classificationcited by 12
  11. 2022ASR data augmentation in low-resource settings using cross-lingual multi-speaker TTS and cross-lingual voice conversioncited by 10
  12. 2025Towards Pretraining Robust ASR Foundation Model with Acoustic-Aware Data Augmentationcited by 1

Built on by

Not cited yet.