Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languages
Not on the map. Why?
Abstract (arXiv)
Automatic speech recognition (ASR) has advanced in high-resource languages, but most of the world's 7,000+ languages remain unsupported, leaving thousands of long-tail languages behind. Expanding ASR coverage has been costly and limited by architectures that restrict language support, making extension inaccessible to most--all while entangled with ethical concerns when pursued without community collaboration. To transcend these limitations, we introduce Omnilingual ASR, the first large-scale ASR system designed for extensibility. Omnilingual ASR enables communities to introduce unserved languages with only a handful of data samples. It scales self-supervised pre-training to 7B parameters to learn robust speech representations and introduces an encoder-decoder architecture designed for zero-shot generalization, leveraging a LLM-inspired decoder. This capability is grounded in a massive and diverse training corpus; by combining breadth of coverage with linguistic variety, the model learns representations robust enough to adapt to unseen languages. Incorporating public resources with community-sourced recordings gathered through compensated local partnerships, Omnilingual ASR expands coverage to over 1,600 languages, the largest such effort to date--including over 500 never before served by ASR. Automatic evaluations show substantial gains over prior systems, especially in low-resource conditions, and strong generalization. We release Omnilingual ASR as a family of models, from 300M variants for low-power devices to 7B for maximum accuracy. We reflect on the ethical considerations shaping this design and conclude by discussing its societal impact. In particular, we highlight how open-sourcing models and tools can lower barriers for researchers and communities, inviting new forms of participation. Open-source artifacts are available at https://github.com/facebookresearch/omnilingual-asr.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Nov 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 2; 2026: 30.
32 papers.
Sort:
By area:
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Modelscited by 22
- 2026HuPER: A Human-Inspired Framework for Phonetic Perceptioncited by 3
- 2026Benchmarking Multilingual Speech Models on Pashto: Zero-Shot ASR, Script Failure, and Cross-Domain Evaluationcited by 2
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Modelscited by 1
- 2026Adapting Where It Matters: Depth-Aware Adaptation for Efficient Multilingual Speech Recognition in Low-Resource Languagescited by 1
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognitioncited by 1
- 2026Ethio-ASR: Joint Multilingual Speech Recognition and Language Identification for Ethiopian Languagescited by 1
- 2026Harf-Speech: A Clinically Aligned Framework for Arabic Phoneme-Level Speech Assessmentcited by 1
- 2026The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Modelscited by 1
- 2025Zero-Shot Context-Aware ASR for Diverse Arabic Varietiescited by 0
- 2025Opportunities and Challenges of Natural Language Processing for Low-Resource Senegalese Languages in Social Science Researchcited by 0
- 2026BYOL: Bring Your Own Language Into LLMscited by 0
20 more
- 2026Continual Adaptation for Pacific Indigenous Speech Recognitioncited by 0
- 2026Bolbosh: Script-Aware Flow Matching for Kashmiri Text-to-Speechcited by 0
- 2026FLEURS-Kobani: Extending the FLEURS Dataset for Northern Kurdishcited by 0
- 2026AfriVox-v2: A Domain-Verticalized Benchmark for In-the-Wild African Speech Recognitioncited by 0
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraintscited by 0
- 2026FSA-GRPO: Teaching Auditory LLMs to Use Few-Shot Demonstrationscited by 0
- 2026Pretrained self-supervised speech models can recognize unseen consonantscited by 0
- 2026UR-BERT: Scaling Text Encoders for Massively Multilingual TTS Through Universal Romanization and Speech Token Predictioncited by 0
- 2026Comparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case Studycited by 0
- 2026S-DiverSe: Spanish Diverse Speechcited by 0
- 2026GigaAM Multilingual: Foundation Model for Underrepresented Languagescited by 0
- 2026An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challengecited by 0
- 2026MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognitioncited by 0
- 2026Easper: An Accessible ASR Pipeline for Language Documentationcited by 0
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesiscited by 0
- 2026YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speechcited by 0
- 2026In-Context Adaptation of Encoder-Decoder Models in Speech Recognitioncited by 0
- 2026CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASRcited by 0
- 2026Benchmarking Automatic Speech Recognition Tools for Iberian Languagescited by 0
- 2026Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Studycited by 0
- 2026Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Study8 Oct 2026
- 2026Benchmarking Automatic Speech Recognition Tools for Iberian Languages29 Sep 2026
- 2026CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASR28 Sep 2026
- 2026In-Context Adaptation of Encoder-Decoder Models in Speech Recognition27 Sep 2026
- 2026YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech24 Sep 2026
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis3 Sep 2026
- 2026Easper: An Accessible ASR Pipeline for Language Documentation12 Aug 2026
- 2026MoLGE: Mixture of Language Group Experts for Efficient Scaling of Massively Multilingual Speech Recognition27 Jul 2026
- 2026An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge14 Jul 2026
- 2026GigaAM Multilingual: Foundation Model for Underrepresented Languages11 Jul 2026
- 2026S-DiverSe: Spanish Diverse Speech3 Jul 2026
- 2026Comparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case Study29 Jun 2026
20 more
- 2026UR-BERT: Scaling Text Encoders for Massively Multilingual TTS Through Universal Romanization and Speech Token Prediction10 Jun 2026
- 2026Pretrained self-supervised speech models can recognize unseen consonants10 Jun 2026
- 2026FSA-GRPO: Teaching Auditory LLMs to Use Few-Shot Demonstrations26 May 2026
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints18 May 2026
- 2026AfriVox-v2: A Domain-Verticalized Benchmark for In-the-Wild African Speech Recognition5 May 2026
- 2026The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models22 Apr 2026
- 2026Benchmarking Multilingual Speech Models on Pashto: Zero-Shot ASR, Script Failure, and Cross-Domain Evaluation6 Apr 2026
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models1 Apr 2026
- 2026FLEURS-Kobani: Extending the FLEURS Dataset for Northern Kurdish31 Mar 2026
- 2026Ethio-ASR: Joint Multilingual Speech Recognition and Language Identification for Ethiopian Languages24 Mar 2026
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognition18 Mar 2026
- 2026Harf-Speech: A Clinically Aligned Framework for Arabic Phoneme-Level Speech Assessment11 Mar 2026
- 2026Bolbosh: Script-Aware Flow Matching for Kashmiri Text-to-Speech8 Mar 2026
- 2026Continual Adaptation for Pacific Indigenous Speech Recognition6 Mar 2026
- 2026HuPER: A Human-Inspired Framework for Phonetic Perception2 Feb 2026
- 2026Adapting Where It Matters: Depth-Aware Adaptation for Efficient Multilingual Speech Recognition in Low-Resource Languages1 Feb 2026
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Models20 Jan 2026
- 2026BYOL: Bring Your Own Language Into LLMs15 Jan 2026
- 2025Opportunities and Challenges of Natural Language Processing for Low-Resource Senegalese Languages in Social Science Research24 Dec 2025
- 2025Zero-Shot Context-Aware ASR for Diverse Arabic Varieties24 Nov 2025
- 2026HuPER: A Human-Inspired Framework for Phonetic Perceptioncited by 3
- 2026Benchmarking Multilingual Speech Models on Pashto: Zero-Shot ASR, Script Failure, and Cross-Domain Evaluationcited by 2
- 2026Kakugo: Distillation of Low-Resource Languages into Small Language Modelscited by 1
- 2026Adapting Where It Matters: Depth-Aware Adaptation for Efficient Multilingual Speech Recognition in Low-Resource Languagescited by 1
- 2026Zipper-LoRA: Dynamic Parameter Decoupling for Speech-LLM based Multilingual Speech Recognitioncited by 1
- 2026Ethio-ASR: Joint Multilingual Speech Recognition and Language Identification for Ethiopian Languagescited by 1
- 2026Harf-Speech: A Clinically Aligned Framework for Arabic Phoneme-Level Speech Assessmentcited by 1
- 2026The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Modelscited by 1
- 2025Zero-Shot Context-Aware ASR for Diverse Arabic Varietiescited by 0
- 2025Opportunities and Challenges of Natural Language Processing for Low-Resource Senegalese Languages in Social Science Researchcited by 0
- 2026BYOL: Bring Your Own Language Into LLMscited by 0
- 2026Continual Adaptation for Pacific Indigenous Speech Recognitioncited by 0
12 most cited of 28 All 28 (JSON)
- 2026Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Study8 Oct 2026
- 2026Benchmarking Automatic Speech Recognition Tools for Iberian Languages29 Sep 2026
- 2026CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASR28 Sep 2026
- 2026In-Context Adaptation of Encoder-Decoder Models in Speech Recognition27 Sep 2026
- 2026YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech24 Sep 2026
- 2026Easper: An Accessible ASR Pipeline for Language Documentation12 Aug 2026
- 2026An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge14 Jul 2026
- 2026GigaAM Multilingual: Foundation Model for Underrepresented Languages11 Jul 2026
- 2026S-DiverSe: Spanish Diverse Speech3 Jul 2026
- 2026Comparing Human and Automatic Recognition of Dutch Dysarthric Continuous Speech: A Case Study29 Jun 2026
- 2026UR-BERT: Scaling Text Encoders for Massively Multilingual TTS Through Universal Romanization and Speech Token Prediction10 Jun 2026
- 2026Pretrained self-supervised speech models can recognize unseen consonants10 Jun 2026
12 newest of 28 All 28 (JSON)