mlsanityData to 7 Oct 2026

WST: Weakly Supervised Transducer for Automatic Speech Recognition

arXiv 2511.04035 ↗First posted 6 Nov 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

The Recurrent Neural Network-Transducer (RNN-T) is widely adopted in end-to-end (E2E) automatic speech recognition (ASR) tasks but depends heavily on large-scale, high-quality annotated data, which are often costly and difficult to obtain. To mitigate this reliance, we propose a Weakly Supervised Transducer (WST), which integrates a flexible training graph designed to robustly handle errors in the transcripts without requiring additional confidence estimation or auxiliary pre-trained models. Empirical evaluations on synthetic and industrial datasets reveal that WST effectively maintains performance even with transcription error rates of up to 70%, consistently outperforming existing Connectionist Temporal Classification (CTC)-based weakly supervised approaches, such as Bypass Temporal Classification (BTC) and Omni-Temporal Classification (OTC). These results demonstrate the practical utility and robustness of WST in realistic ASR settings. The implementation will be publicly available.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 6 Nov 2025.

Builds on

15 of 22 references.

References · 15

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2015Listen, Attend and Spellcited by 542
  5. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  6. 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
  7. 2020On the Comparison of Popular End-to-End Models for Large Scale Speech Recognitioncited by 62
  8. 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
  9. 2020Exploring Transformers for Large-Scale Speech Recognitioncited by 24
  10. 2020Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applicationscited by 11
  11. 2022Star Temporal Classification: Sequence Classification with Partially Labeled Datacited by 10
  12. 2023Bypass Temporal Classification: Weakly Supervised Automatic Speech Recognition with Imperfect Transcriptscited by 10
3 more
  1. 2023Learning from Flawed Data: Weakly Supervised Automatic Speech Recognitioncited by 8
  2. 2023Powerful and Extensible WFST Framework for RNN-Transducer Lossescited by 7
  3. 2024Token-Weighted RNN-T for Learning from Flawed Datacited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.