WST: Weakly Supervised Transducer for Automatic Speech Recognition
Not on the map. Why?
Abstract (arXiv)
The Recurrent Neural Network-Transducer (RNN-T) is widely adopted in end-to-end (E2E) automatic speech recognition (ASR) tasks but depends heavily on large-scale, high-quality annotated data, which are often costly and difficult to obtain. To mitigate this reliance, we propose a Weakly Supervised Transducer (WST), which integrates a flexible training graph designed to robustly handle errors in the transcripts without requiring additional confidence estimation or auxiliary pre-trained models. Empirical evaluations on synthetic and industrial datasets reveal that WST effectively maintains performance even with transcription error rates of up to 70%, consistently outperforming existing Connectionist Temporal Classification (CTC)-based weakly supervised approaches, such as Bypass Temporal Classification (BTC) and Omni-Temporal Classification (OTC). These results demonstrate the practical utility and robustness of WST in realistic ASR settings. The implementation will be publicly available.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 6 Nov 2025.
Builds on
15 of 22 references.
References · 15
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2015Listen, Attend and Spellcited by 542
- 2023Scaling Speech Technology to 1,000+ Languagescited by 401
- 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
- 2020On the Comparison of Popular End-to-End Models for Large Scale Speech Recognitioncited by 62
- 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
- 2020Exploring Transformers for Large-Scale Speech Recognitioncited by 24
- 2020Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applicationscited by 11
- 2022Star Temporal Classification: Sequence Classification with Partially Labeled Datacited by 10
- 2023Bypass Temporal Classification: Weakly Supervised Automatic Speech Recognition with Imperfect Transcriptscited by 10
3 more
Built on by
Citing papers per year: 2026: 1.
1 paper.