Open Source State-Of-the-Art Solution for Romanian Speech Recognition
Not on the map. Why?
Abstract (arXiv)
In this work, we present a new state-of-the-art Romanian Automatic Speech Recognition (ASR) system based on NVIDIA's FastConformer architecture--explored here for the first time in the context of Romanian. We train our model on a large corpus of, mostly, weakly supervised transcriptions, totaling over 2,600 hours of speech. Leveraging a hybrid decoder with both Connectionist Temporal Classification (CTC) and Token-Duration Transducer (TDT) branches, we evaluate a range of decoding strategies including greedy, ALSD, and CTC beam search with a 6-gram token-level language model. Our system achieves state-of-the-art performance across all Romanian evaluation benchmarks, including read, spontaneous, and domain-specific speech, with up to 27% relative WER reduction compared to previous best-performing systems. In addition to improved transcription accuracy, our approach demonstrates practical decoding efficiency, making it suitable for both research and deployment in low-latency ASR applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 5 Nov 2025.
Builds on
20 of 33 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
- 2015MUSAN: A Music, Speech, and Noise Corpuscited by 400
- 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 230
8 more
- 2023End-to-End Speech Recognition: A Surveycited by 127
- 2019End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architecturescited by 120
- 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 120
- 2024A Survey on Speech Large Language Models for Understandingcited by 71
- 2018Pre-training on high-resource speech recognition improves low-resource speech-to-text translationcited by 70
- 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 56
- 2023Stateful Conformer with Cache-based Inference for Streaming Automatic Speech Recognitioncited by 20
- 2023Towards Improving the Performance of Pre-Trained Speech Models for Low-Resource Languages Through Lateral Inhibitioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.