mlsanityData to 7 Oct 2026

MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages

arXiv 2204.08582 ↗First posted 18 Apr 2022cs.CL cs.AI cs.LGcited by 142

Not on the map. Why?

Abstract (arXiv)

We present the MASSIVE dataset--Multilingual Amazon Slu resource package (SLURP) for Slot-filling, Intent classification, and Virtual assistant Evaluation. MASSIVE contains 1M realistic, parallel, labeled virtual assistant utterances spanning 51 languages, 18 domains, 60 intents, and 55 slots. MASSIVE was created by tasking professional translators to localize the English-only SLURP dataset into 50 typologically diverse languages from 29 genera. We also present modeling results on XLM-R and mT5, including exact match accuracy, intent classification accuracy, and slot-filling F1 score. We have released our dataset, modeling code, and models publicly.

Key facts. Cited by 142 papers in the map (data through 7 Oct 2026). Builds on 36 of its 68 references that are in the map. First posted on arXiv 18 Apr 2022.

Builds on

36 of 68 references.

References · 36

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  6. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  8. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  9. 2019How multilingual is Multilingual BERT?cited by 642
  10. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
  11. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  12. 2018Tune: A Research Platform for Distributed Model Selection and Trainingcited by 395
24 more
  1. 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 376
  2. 2020SLURP: A Spoken Language Understanding Resource Packagecited by 197
  3. 2019BERT for Joint Intent Classification and Slot Fillingcited by 195
  4. 2019Speech Model Pre-training for End-to-End Spoken Language Understandingcited by 191
  5. 2019Cross-Lingual Ability of Multilingual BERT: An Empirical Studycited by 182
  6. 2019Benchmarking Natural Language Understanding Services for building Conversational Agentscited by 166
  7. 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 156
  8. 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 124
  9. 2018Semantic Parsing for Task Oriented Dialog using Hierarchical Representationscited by 101
  10. 2020Pre-training via Paraphrasingcited by 92
  11. 2020Low-resource Languages: A Review of Past Work and Future Challengescited by 90
  12. 2020End-to-End Slot Alignment and Recognition for Cross-Lingual NLUcited by 82
  13. 2020Don't Parse, Generate! A Sequence to Sequence Architecture for Task-Oriented Semantic Parsingcited by 59
  14. 2018Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systemscited by 46
  15. 2018Neural Cross-Lingual Named Entity Recognition with Minimal Resourcescited by 44
  16. 2020ParsiNLU: A Suite of Language Understanding Challenges for Persiancited by 42
  17. 2018Spoken Language Understanding on the Edgecited by 27
  18. 2018Zero-Shot Cross-lingual Classification Using Multilingual Neural Machine Translationcited by 19
  19. 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17
  20. 2020Investigating an approach for low resource language dataset creation, curation and classification: Setswana and Sepedicited by 15
  21. 2020Low Resource Neural Machine Translation: A Benchmark for Five African Languagescited by 15
  22. 2020Establishing Baselines for Text Classification in Low-Resource Languagescited by 14
  23. 2020Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarizationcited by 11
  24. 2020STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++cited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 11; 2023: 31; 2024: 28; 2025: 33; 2026: 39.

142 papers.

Sort:

By area:

  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  2. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
  3. 2022Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languagescited by 99
  4. 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
  5. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  6. 2025KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Modelcited by 35
  7. 2024Serial Position Effects of Large Language Modelscited by 30
  8. 2022LINGUIST: Language Model Instruction Tuning to Generate Annotated Utterances for Intent Classification and Slot Taggingcited by 29
  9. 2022Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Taskscited by 28
  10. 2023DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domainscited by 27
  11. 2023Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learningcited by 27
  12. 2023Primacy Effect of ChatGPTcited by 27
38 more
  1. 2024Goldfish: Monolingual Language Models for 350 Languagescited by 27
  2. 2024Prompt Perturbation Consistency Learning for Robust Language Modelscited by 26
  3. 2024The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embeddingcited by 26
  4. 2025Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representationcited by 25
  5. 2023mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinationscited by 24
  6. 2023Exploring Zero and Few-shot Techniques for Intent Classificationcited by 21
  7. 2024ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Modelscited by 20
  8. 2024Speech-MASSIVE: A Multilingual Speech Dataset for SLU and Beyondcited by 20
  9. 2023Sabi'a: Portuguese Large Language Modelscited by 19
  10. 2023A Material Lens on Coloniality in NLPcited by 19
  11. 2024PL-MTEB: Polish Massive Text Embedding Benchmarkcited by 19
  12. 2024Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystackcited by 19
  13. 2025Sparse Autoencoder Features for Classifications and Transferabilitycited by 19
  14. 2023PRESTO: A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogscited by 16
  15. 2023Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systemscited by 16
  16. 2024Text Clustering as Classification with LLMscited by 16
  17. 2022Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systemscited by 15
  18. 2022MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 15
  19. 2023Unsupervised Layer-wise Score Aggregation for Textual OOD Detectioncited by 15
  20. 2023BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamscited by 15
  21. 2024Learning to Poison Large Language Models for Downstream Manipulationcited by 15
  22. 2022A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialogcited by 14
  23. 2023CWCL: Cross-Modal Transfer with Continuously Weighted Contrastive Losscited by 12
  24. 2023Language Models are Universal Embedderscited by 11
  25. 2024MINERS: Multilingual Language Models as Semantic Retrieverscited by 11
  26. 2023ITALIC: An Italian Intent Classification Datasetcited by 10
  27. 2024Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarkscited by 10
  28. 2026F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual Worldcited by 10
  29. 2024Calibrating Verbalized Probabilities for Large Language Modelscited by 9
  30. 2024Length-Induced Embedding Collapse in PLM-based Modelscited by 9
  31. 2024A review of faithfulness metrics for hallucination assessment in Large Language Modelscited by 9
  32. 2025Rethinking Tokenization for Rich Morphology: The Dominance of Unigram over BPE and Morphological Alignmentcited by 9
  33. 2026Massive Sound Embedding Benchmark (MSEB)cited by 9
  34. 2024From Instructions to Constraints: Language Model Alignment with Automatic Constraint Verificationcited by 8
  35. 2024IntentGPT: Few-shot Intent Discovery with Large Language Modelscited by 8
  36. 2025F2LLM Technical Report: Matching SOTA Embedding Performance with 6 Million Open-Source Datacited by 8
  37. 2023Backward Compatibility During Data Updates by Weight Interpolationcited by 7
  38. 2023Code-Switched Text Synthesis in Unseen Language Pairscited by 7

50 most cited of 142 All 142 (JSON)