mlsanityData to 7 Oct 2026

Open Source State-Of-the-Art Solution for Romanian Speech Recognition

arXiv 2511.03361 ↗First posted 5 Nov 2025eess.AS cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

In this work, we present a new state-of-the-art Romanian Automatic Speech Recognition (ASR) system based on NVIDIA's FastConformer architecture--explored here for the first time in the context of Romanian. We train our model on a large corpus of, mostly, weakly supervised transcriptions, totaling over 2,600 hours of speech. Leveraging a hybrid decoder with both Connectionist Temporal Classification (CTC) and Token-Duration Transducer (TDT) branches, we evaluate a range of decoding strategies including greedy, ALSD, and CTC beam search with a 6-gram token-level language model. Our system achieves state-of-the-art performance across all Romanian evaluation benchmarks, including read, spontaneous, and domain-specific speech, with up to 27% relative WER reduction compared to previous best-performing systems. In addition to improved transcription accuracy, our approach demonstrates practical decoding efficiency, making it suitable for both research and deployment in low-latency ASR applications.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 5 Nov 2025.

Builds on

20 of 33 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2020Longformer: The Long-Document Transformercited by 3,362
  5. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  6. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  7. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  8. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  9. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  10. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  11. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 400
  12. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 230
8 more
  1. 2023End-to-End Speech Recognition: A Surveycited by 127
  2. 2019End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architecturescited by 120
  3. 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 120
  4. 2024A Survey on Speech Large Language Models for Understandingcited by 71
  5. 2018Pre-training on high-resource speech recognition improves low-resource speech-to-text translationcited by 70
  6. 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 56
  7. 2023Stateful Conformer with Cache-based Inference for Streaming Automatic Speech Recognitioncited by 20
  8. 2023Towards Improving the Performance of Pre-Trained Speech Models for Low-Resource Languages Through Lateral Inhibitioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.