mlsanityData to 7 Oct 2026

NusaCrowd: Open Source Initiative for Indonesian NLP Resources

arXiv 2212.09648 ↗First posted 19 Dec 2022cs.CL cs.AIcited by 38

Not on the map. Why?

Abstract (arXiv)

We present NusaCrowd, a collaborative initiative to collect and unify existing resources for Indonesian languages, including opening access to previously non-public resources. Through this initiative, we have brought together 137 datasets and 118 standardized data loaders. The quality of the datasets has been assessed manually and automatically, and their value is demonstrated through multiple experiments. NusaCrowd's data collection enables the creation of the first zero-shot benchmarks for natural language understanding and generation in Indonesian and the local languages of Indonesia. Furthermore, NusaCrowd brings the creation of the first multilingual automatic speech recognition benchmark in Indonesian and the local languages of Indonesia. Our work strives to advance natural language processing (NLP) research for languages that are under-represented despite being widely spoken.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 70 of its 200 references that are in the map. First posted on arXiv 19 Dec 2022.

Builds on

70 of 200 references.

References · 70

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  6. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  7. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  8. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  9. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  10. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  11. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  12. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
38 more
  1. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  2. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  3. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  4. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
  5. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
  6. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 443
  7. 2019Q-BERT: Hessian Based Ultra Low Precision Quantization of BERTcited by 355
  8. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  9. 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 330
  10. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  11. 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 277
  12. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  13. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 221
  14. 2021Visually Grounded Reasoning across Languages and Culturescited by 188
  15. 2020BinaryBERT: Pushing the Limit of BERT Quantizationcited by 175
  16. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  17. 2020WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarizationcited by 154
  18. 2020PhoBERT: Pre-trained language models for Vietnamesecited by 148
  19. 2020TernaryBERT: Distillation-aware Ultra-low Bit BERTcited by 145
  20. 2022Lifting the Curse of Multilinguality by Pre-training Modular Transformerscited by 145
  21. 2018When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?cited by 125
  22. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  23. 2020IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understandingcited by 108
  24. 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 90
  25. 2021NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentationcited by 72
  26. 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
  27. 2022Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillationcited by 70
  28. 2020TICO-19: the Translation Initiative for Covid-19cited by 67
  29. 2022NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languagescited by 67
  30. 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 65
  31. 2020IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLPcited by 57
  32. 2019Lightweight and Efficient End-to-End Speech Recognition Using Low-Rank Transformercited by 47
  33. 2022IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languagescited by 42
  34. 2021Multimodal End-to-End Sparse Model for Emotion Recognitioncited by 40
  35. 2020English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Toocited by 39
  36. 2020XPersona: Evaluating Multilingual Personalized Chatbotcited by 36
  37. 2022GEMv2: Multilingual NLG Benchmarking in a Single Line of Codecited by 36
  38. 2021IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initializationcited by 25

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 11; 2024: 14; 2025: 9; 2026: 4.

38 papers.

Sort:

By area:

  1. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  2. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
  3. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
  4. 2024CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmarkcited by 118
  5. 2024LLaMA Beyond English: An Empirical Study on Language Capability Transfercited by 94
  6. 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 78
  7. 2024LLMs Are Few-Shot In-Context Low-Resource Language Learnerscited by 68
  8. 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 50
  9. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  10. 2023Lost in Translation: Large Language Models in Non-English Content Analysiscited by 34
  11. 2024ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasetscited by 26
  12. 2024Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languagescited by 18
26 more
  1. 2024The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resourcescited by 11
  2. 2023Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyondcited by 10
  3. 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Datacited by 9
  4. 2023GlobalBench: A Benchmark for Global Progress in Natural Language Processingcited by 8
  5. 2025Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asiacited by 8
  6. 2024Multilingual Arbitrage: Optimizing Data Pools to Accelerate Multilingual Progresscited by 6
  7. 2023Enriching the NArabizi Treebank: A Multifaceted Approach to Supporting an Under-Resourced Languagecited by 4
  8. 2023NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languagescited by 4
  9. 2024Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesiacited by 4
  10. 2025Assessing Thai Dialect Performance in LLMs with Automatic Benchmarks and Human Evaluationcited by 4
  11. 2023IndoToD: A Multi-Domain Indonesian Benchmark For End-to-End Task-Oriented Dialogue Systemscited by 2
  12. 2025Inclusivity of AI Speech in Healthcare: A Decade Look Backcited by 2
  13. 2025What Do Indonesians Really Need from Language Technology? A Nationwide Surveycited by 2
  14. 2023Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion Recognitioncited by 1
  15. 2024Crowdsourcing Lexical Diversitycited by 1
  16. 2025IndoPref: A Multi-Domain Pairwise Preference Dataset for Indonesiancited by 1
  17. 2025ASR Under Noise: Exploring Robustness for Sundanese and Javanesecited by 1
  18. 2023Utilizing Weak Supervision To Generate Indonesian Conservation Datasetcited by 0
  19. 2023Replicable Benchmarking of Neural Machine Translation (NMT) on Low-Resource Local Languages in Indonesiacited by 0
  20. 2024NusaBERT: Teaching IndoBERT to be Multilingual and Multiculturalcited by 0
  21. 2025Making Sense of Korean Sentences: A Comprehensive Evaluation of LLMs through KoSEnd Datasetcited by 0
  22. 2025Entropy2Vec: Crosslingual Language Modeling Entropy as End-to-End Learnable Language Representationscited by 0
  23. 2026Beyond Transfer Accuracy: Mechanism-Guided Controlled Adaptation for Low-Resource Languagescited by 0
  24. 2026Sentiment Analysis of AI Adoption in Indonesian Higher Education Using Machine Learning and Transformer-Based Modelscited by 0
  25. 2026Beyond Catalogue Counts: the Dataset Visibility Asymmetry in Low-Resource Multilingual NLPcited by 0
  26. 2026SEATauBench: Progressively Adapting Tool-Agent-User Evaluation Into Low-Resource Southeast Asian Languagescited by 0