mlsanityData to 7 Oct 2026

Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Model

arXiv 1909.05330 ↗First posted 11 Sep 2019eess.AS cs.LG cs.SDcited by 92

Not on the map. Why?

Abstract (arXiv)

Multilingual end-to-end (E2E) models have shown great promise in expansion of automatic speech recognition (ASR) coverage of the world's languages. They have shown improvement over monolingual systems, and have simplified training and serving by eliminating language-specific acoustic, pronunciation, and language models. This work presents an E2E multilingual system which is equipped to operate in low-latency interactive applications, as well as handle a key challenge of real world data: the imbalance in training data across languages. Using nine Indic languages, we compare a variety of techniques, and find that a combination of conditioning on a language vector and training language-specific adapter layers produces the best model. The resulting E2E multilingual model achieves a lower word error rate (WER) than both monolingual E2E models (eight of nine languages) and monolingual conventional systems (all nine languages).

Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 20; 2022: 22; 2023: 23; 2024: 18; 2025: 5; 2026: 4.

92 papers.

Sort:

By area:

  1. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  2. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 147
  3. 2021Recent Advances in End-to-End Automatic Speech Recognitioncited by 138
  4. 2023End-to-End Speech Recognition: A Surveycited by 127
  5. 2022mSLAM: Massively multilingual joint pre-training for speech and textcited by 108
  6. 2023Modular Deep Learningcited by 82
  7. 2021Scaling End-to-End Models for Large-Scale Multilingual ASRcited by 61
  8. 2021Lightweight Adapter Tuning for Multilingual Speech Translationcited by 53
  9. 2021Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASRcited by 40
  10. 2024LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASRcited by 35
  11. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  12. 2021Exploiting Adapters for Cross-lingual Low-resource Speech Recognitioncited by 33
38 more
  1. 2022Efficient Adapter Transfer of Self-Supervised Speech Models for Automatic Speech Recognitioncited by 31
  2. 2023MoLE : Mixture of Language Experts for Multi-Lingual Automatic Speech Recognitioncited by 31
  3. 2021Residual Adapters for Parameter-Efficient ASR Adaptation to Atypical and Accented Speechcited by 30
  4. 2021A Configurable Multilingual Model is All You Need to Recognize All Languagescited by 28
  5. 2023Improving Continuous Sign Language Recognition with Cross-Lingual Signscited by 27
  6. 2023Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognitioncited by 26
  7. 2021Pseudo-Labeling for Massively Multilingual Speech Recognitioncited by 23
  8. 2023From English to More Languages: Parameter-Efficient Model Reprogramming for Cross-Lingual Speech Recognitioncited by 23
  9. 2022A Survey of Multilingual Models for Automatic Speech Recognitioncited by 21
  10. 2021Improved Language Identification Through Cross-Lingual Self-Supervised Learningcited by 20
  11. 2021EmoNet: A Transfer Learning Framework for Multi-Corpus Speech Emotion Recognitioncited by 17
  12. 2023Mixture-of-Expert Conformer for Streaming Multilingual ASRcited by 17
  13. 2021Building a great multi-lingual teacher with sparsely-gated mixture of experts for speech recognitioncited by 16
  14. 2022Massively Multilingual ASR on 70 Languages: Tokenization, Architecture, and Generalization Capabilitiescited by 16
  15. 2023ArTST: Arabic Text and Speech Transformercited by 14
  16. 2022Maestro-U: Leveraging joint speech-text representation learning for zero supervised speech ASRcited by 13
  17. 2021Efficient Weight factorization for Multilingual Speech Recognitioncited by 12
  18. 2021Magic dust for cross-lingual adaptation of monolingual wav2vec-2.0cited by 12
  19. 2022Learning ASR pathways: A sparse multilingual ASR modelcited by 12
  20. 2022A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capabilitycited by 12
  21. 2022Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translationcited by 11
  22. 2022SQuId: Measuring Speech Naturalness in Many Languagescited by 10
  23. 2022Adaptive multilingual speech recognition with pretrained modelscited by 9
  24. 2022A Language Agnostic Multilingual Streaming On-Device ASR Systemcited by 9
  25. 2021Improving Punctuation Restoration for Speech Transcripts via External Datacited by 8
  26. 2023Unified model for code-switching speech recognition and language identification based on a concatenated tokenizercited by 8
  27. 2024Scaling A Simple Approach to Zero-Shot Speech Recognitioncited by 8
  28. 2025OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Modelcited by 8
  29. 2022Distilling a Pretrained Language Model to a Multilingual ASR Modelcited by 7
  30. 2022Scaling Up Deliberation for Multilingual ASRcited by 6
  31. 2025Low-Rank and Sparse Model Merging for Multi-Lingual Speech Recognition and Translationcited by 6
  32. 2022Discovering Phonetic Inventories with Crosslingual Automatic Speech Recognitioncited by 5
  33. 2022Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generationcited by 5
  34. 2023Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understandingcited by 5
  35. 2023Learning Cross-lingual Visual Speech Representationscited by 5
  36. 2025Efficient Multilingual ASR Finetuning via LoRA Language Expertscited by 5
  37. 2021A Study of Multilingual End-to-End Speech Recognition for Kazakh, Russian, and Englishcited by 4
  38. 2021Multilingual Speech Recognition using Knowledge Transfer across Learning Processescited by 4

50 most cited of 92 All 92 (JSON)