mlsanityData to 14 Oct 2026

A Survey of Multilingual Models for Automatic Speech Recognition

arXiv 2202.12576 ↗First posted 25 Feb 2022cs.CL cs.SD eess.AScited by 21

Not on the map. Why?

Abstract (arXiv)

Although Automatic Speech Recognition (ASR) systems have achieved human-like performance for a few languages, the majority of the world's languages do not have usable systems due to the lack of large speech datasets to train these models. Cross-lingual transfer is an attractive solution to this problem, because low-resource languages can potentially benefit from higher-resource languages either through transfer learning, or being jointly trained in the same multilingual model. The problem of cross-lingual transfer has been well studied in ASR, however, recent advances in Self Supervised Learning are opening up avenues for unlabeled speech data to be used in multilingual ASR models, which can pave the way for improved performance on low-resource languages. In this paper, we survey the state of the art in multilingual ASR models that are built with cross-lingual transfer in mind. We present best practices for building multilingual models from research across diverse languages and techniques, discuss open questions and provide recommendations for future work.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 28 of its 51 references that are in the map. First posted on arXiv 25 Feb 2022.

Builds on

28 of 51 references.

References · 28

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  5. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  6. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  7. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
  8. 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 451
  9. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  10. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
  11. 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
  12. 2019Self-Training for End-to-End Speech Recognitioncited by 129
16 more
  1. 2019End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architecturescited by 120
  2. 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
  3. 2020ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Contextcited by 97
  4. 2019Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Modelcited by 93
  5. 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
  6. 2021UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Datacited by 77
  7. 2019Jasper: An End-to-End Convolutional Neural Acoustic Modelcited by 76
  8. 2016Achieving Human Parity in Conversational Speech Recognitioncited by 63
  9. 2021Towards Building ASR Systems for the Next Billion Userscited by 47
  10. 2018Multilingual End-to-End Speech Recognition with A Single Transformer on Low-Resource Languagescited by 26
  11. 2021CLSRIL-23: Cross Lingual Speech Representations for Indic Languagescited by 22
  12. 2021XLST: Cross-lingual Self-training to Learn Multilingual Representation for Low Resource Speech Recognitioncited by 11
  13. 2021Acoustic Data-Driven Subword Modeling for End-to-End Speech Recognitioncited by 11
  14. 2017Multilingual Training and Cross-lingual Adaptation on CTC-based Acoustic Modelcited by 6
  15. 2017Phonemic and Graphemic Multilingual CTC Based Speech Recognitioncited by 3
  16. 2021Improving low-resource ASR performance with untranscribed out-of-domain datacited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 4; 2024: 10; 2025: 4; 2026: 2.

21 papers.

Sort:

By area:

  1. 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
  2. 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Biascited by 84
  3. 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating Itcited by 45
  4. 2023Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributescited by 13
  5. 2023Master-ASR: Achieving Multilingual Scalability and Low-Resource Adaptation in ASR with Modular Learningcited by 9
  6. 2024Africa-Centric Self-Supervised Pre-Training for Multilingual Speech Representation in a Sub-Saharan Contextcited by 8
  7. 2024How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenariocited by 5
  8. 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
  9. 2022Annotated Speech Corpus for Low Resource Indian Languages: Awadhi, Bhojpuri, Braj and Magahicited by 3
  10. 2024A Parameter-efficient Language Extension Framework for Multilingual ASRcited by 3
  11. 2024HebDB: a Weakly Supervised Dataset for Hebrew Speech Processingcited by 3
  12. 2023Adaptation and Optimization of Automatic Speech Recognition (ASR) for the Maritime Domain in the Field of VHF Communicationcited by 1
9 more
  1. 2024A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspectivecited by 1
  2. 2025Sagalee: an Open Source Automatic Speech Recognition Dataset for Oromo Languagecited by 1
  3. 2024Towards a World-English Language Model for On-Device Virtual Assistantscited by 0
  4. 2024Survey: Transformer-based Models in Data Modality Conversioncited by 0
  5. 2024Parameter-efficient Adaptation of Multilingual Multimodal Models for Low-resource ASRcited by 0
  6. 2024Evaluating Automatic Speech Recognition Systems for Korean Meteorological Expertscited by 0
  7. 2025SAGE-LD: Towards Scalable and Generalizable End-to-End Language Diarization via Simulated Data Augmentationcited by 0
  8. 2026Continual Adaptation for Pacific Indigenous Speech Recognitioncited by 0
  9. 2026Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seekingcited by 0