mlsanityData to 7 Oct 2026

FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech

arXiv 2205.12446 ↗First posted 25 May 2022cs.CL cs.LG cs.SDcited by 458

Not on the map. Why?

Abstract (arXiv)

We introduce FLEURS, the Few-shot Learning Evaluation of Universal Representations of Speech benchmark. FLEURS is an n-way parallel speech dataset in 102 languages built on top of the machine translation FLoRes-101 benchmark, with approximately 12 hours of speech supervision per language. FLEURS can be used for a variety of speech tasks, including Automatic Speech Recognition (ASR), Speech Language Identification (Speech LangID), Translation and Retrieval. In this paper, we provide baselines for the tasks based on multilingual pre-trained models like mSLAM. The goal of FLEURS is to enable speech technology in more languages and catalyze research in low-resource speech understanding.

Key facts. Cited by 458 papers in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 25 May 2022.

Builds on

24 of 46 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  4. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  5. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  6. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  7. 2020Language-agnostic BERT Sentence Embeddingcited by 621
  8. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  9. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  10. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  11. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 496
  12. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 467
12 more
  1. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  2. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 340
  3. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  4. 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
  5. 2022mSLAM: Massively multilingual joint pre-training for speech and textcited by 108
  6. 2021The Multilingual TEDx Corpus for Speech Recognition and Translationcited by 101
  7. 2020Self-training and Pre-training are Complementary for Speech Recognitioncited by 98
  8. 2021BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognitioncited by 88
  9. 2020Universal Phone Recognition with a Multilingual Allophone Systemcited by 81
  10. 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
  11. 2021Scaling End-to-End Models for Large-Scale Multilingual ASRcited by 61
  12. 2019Improving Multilingual Sentence Embedding using Bi-directional Dual Encoder with Additive Margin Softmaxcited by 58

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 53; 2024: 105; 2025: 133; 2026: 161.

458 papers.

Sort:

By area:

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2024Qwen2-Audio Technical Reportcited by 543
  3. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  4. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
  5. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  6. 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
  7. 2025Kimi-Audio Technical Reportcited by 210
  8. 2026Gemma 4 Technical Reportcited by 187
  9. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 149
  10. 2025Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters Morecited by 149
  11. 2026Qwen3.5-Omni Technical Reportcited by 146
  12. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 142
38 more
  1. 2023Hallucinations in Large Multilingual Translation Modelscited by 126
  2. 2023SONAR: Sentence-Level Multimodal and Language-Agnostic Representationscited by 105
  3. 2026Qwen3-ASR Technical Reportcited by 105
  4. 2023Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speechcited by 99
  5. 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
  6. 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 74
  7. 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
  8. 2023ML-SUPERB: Multilingual Speech Universal PERformance Benchmarkcited by 70
  9. 2025Baichuan-Audio: A Unified Framework for End-to-End Speech Interactioncited by 68
  10. 2023SLM: Bridge the thin gap between speech and text foundation modelscited by 67
  11. 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 64
  12. 2025HumanOmni: A Large Vision-Speech Language Model for Human-Centric Video Understandingcited by 58
  13. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
  14. 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?cited by 53
  15. 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 51
  16. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
  17. 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
  18. 2024Baichuan-Omni Technical Reportcited by 42
  19. 2025Voxtralcited by 41
  20. 2024IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languagescited by 39
  21. 2024A Large-Scale Evaluation of Speech Foundation Modelscited by 38
  22. 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 38
  23. 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
  24. 2024LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASRcited by 35
  25. 2023XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languagescited by 34
  26. 2024OWSM-CTC: An Open Encoder-Only Speech Foundation Model for Speech Recognition, Translation, and Language Identificationcited by 34
  27. 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 34
  28. 2023Improving Massively Multilingual ASR With Auxiliary CTC Objectivescited by 31
  29. 2023COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learningcited by 30
  30. 2025VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Modelcited by 30
  31. 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 30
  32. 2025Shifting AI Efficiency From Model-Centric to Data-Centric Compressioncited by 29
  33. 2025OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaningcited by 27
  34. 2025InteractiveOmni: A Unified Omni-modal Model for Audio-Visual Multi-turn Dialoguecited by 27
  35. 2024ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasetscited by 26
  36. 2024Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gapscited by 24
  37. 2024Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing?cited by 23
  38. 2025LongCat-Flash-Omni Technical Reportcited by 23

50 most cited of 458 All 458 (JSON)