mlsanityData to 14 Oct 2026

SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages

arXiv 2406.10118 ↗First posted 14 Jun 2024cs.CLcited by 43

Not on the map. Why?

Abstract (arXiv)

Southeast Asia (SEA) is a region rich in linguistic diversity and cultural variety, with over 1,300 indigenous languages and a population of 671 million people. However, prevailing AI models suffer from a significant lack of representation of texts, images, and audio datasets from SEA, compromising the quality of AI models for SEA languages. Evaluating models for SEA languages is challenging due to the scarcity of high-quality datasets, compounded by the dominance of English training data, raising concerns about potential cultural misrepresentation. To address these challenges, we introduce SEACrowd, a collaborative initiative that consolidates a comprehensive resource hub that fills the resource gap by providing standardized corpora in nearly 1,000 SEA languages across three modalities. Through our SEACrowd benchmarks, we assess the quality of AI models on 36 indigenous languages across 13 tasks, offering valuable insights into the current AI landscape in SEA. Furthermore, we propose strategies to facilitate greater AI advancements, maximizing potential utility and resource equity for the future of AI in SEA.

Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 76 of its 143 references that are in the map. First posted on arXiv 14 Jun 2024.

Builds on

76 of 143 references.

References · 76

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  8. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  9. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  10. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  11. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  12. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
38 more
  1. 2018Datasheets for Datasetscited by 1,386
  2. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  3. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  4. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  5. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  6. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  7. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 578
  8. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
  9. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  10. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  11. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  12. 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 333
  13. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
  14. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
  15. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  16. 2023MultiModal-GPT: A Vision and Language Model for Dialogue with Humanscited by 255
  17. 2023Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedbackcited by 190
  18. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 181
  19. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
  20. 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 174
  21. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
  22. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  23. 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 153
  24. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
  25. 2021Systematic Inequalities in Language Technology Performance across the World's Languagescited by 120
  26. 2020IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understandingcited by 109
  27. 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
  28. 2022Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Datasetcited by 100
  29. 2023SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoningcited by 94
  30. 2018Rapid Adaptation of Neural Machine Translation to New Languagescited by 82
  31. 2023Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptationcited by 81
  32. 2023The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AIcited by 73
  33. 2022NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languagescited by 68
  34. 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 66
  35. 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
  36. 2021IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generationcited by 57
  37. 2023Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLUcited by 53
  38. 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 51

50 most cited of 76 All 76 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 23; 2026: 12.

43 papers.

Sort:

By area:

  1. 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 301
  2. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  3. 2024Preference Tuning with Human Feedback on Language, Speech, and Vision Tasks: A Surveycited by 23
  4. 2025Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMscited by 18
  5. 2025Hire Your Anthropologist! Rethinking Culture Benchmarks Through an Anthropological Lenscited by 14
  6. 2025The Multilingual Divide and Its Impact on Global AI Safetycited by 10
  7. 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Datacited by 10
  8. 2024Leveraging Synthetic Audio Data for End-to-End Low-Resource Speech Translationcited by 9
  9. 2025mSTEB: Massively Multilingual Evaluation of LLMs on Speech and Text Taskscited by 7
  10. 2025LoraxBench: A Multitask, Multilingual Benchmark Suite for 20 Indonesian Languagescited by 6
  11. 2024Marco-LLM: Bridging Languages via Massive Multilingual Training for Cross-Lingual Enhancementcited by 4
  12. 2025Large Multimodal Models for Low-Resource Languages: A Surveycited by 4
31 more
  1. 2025What Do Indonesians Really Need from Language Technology? A Nationwide Surveycited by 3
  2. 2025MELAC: Massive Evaluation of Large Language Models with Alignment of Culture in Persian Languagecited by 3
  3. 2025FilBench: Can LLMs Understand and Generate Filipino?cited by 3
  4. 2025WangchanThaiInstruct: An instruction-following Dataset for Culture-Aware, Multitask, and Multi-domain Evaluation in Thaicited by 3
  5. 2025Vision Language Models are Confused Touristscited by 3
  6. 2026OpenSeal: Good, Fast, and Cheap Construction of an Open-Source Southeast Asian LLM via Parallel Datacited by 3
  7. 2024Neuron Empirical Gradient: Discovering and Quantifying Neurons Global Linear Controllabilitycited by 2
  8. 2025Enhancing NER Performance in Low-Resource Pakistani Languages using Cross-Lingual Data Augmentationcited by 2
  9. 2025Mangosteen: An Open Thai Corpus for Language Model Pretrainingcited by 2
  10. 2025Rice-VL: Evaluating Vision-Language Models for Cultural Understanding Across ASEAN Countriescited by 2
  11. 2026SEA-Guard: Culturally Grounded Multilingual Safeguard for Southeast Asiacited by 2
  12. 2024Eir: Thai Medical Large Language Modelscited by 1
  13. 2024A Multi-Agent Dual Dialogue System to Support Mental Health Care Providerscited by 1
  14. 2025Bemba Speech Translation: Exploring a Low-Resource African Languagecited by 1
  15. 2025MultiGen: Child-Friendly Multilingual Speech Generator with LLMscited by 1
  16. 2025Scaling, Simplification, and Adaptation: Lessons from Pretraining on Machine-Translated Textcited by 1
  17. 2026Beyond Many-Shot Translation: Scaling In-Context Demonstrations For Low-Resource Machine Translationcited by 1
  18. 2026BURMESE-SAN: Burmese NLP Benchmark for Evaluating Large Language Modelscited by 1
  19. 2025Uncertainty-driven Embedding Convolutioncited by 0
  20. 2025Entropy2Vec: Crosslingual Language Modeling Entropy as End-to-End Learnable Language Representationscited by 0
  21. 2025HiligayNER: A Baseline Named Entity Recognition Model for Hiligaynoncited by 0
  22. 2025Bridging Language Gaps with Adaptive RAG: Improving Indonesian Language Question Answeringcited by 0
  23. 2025SEA-SafeguardBench: Evaluating AI Safety in SEA Languages and Culturescited by 0
  24. 2026COMPASS: COntinual Multilingual PEFT with Adaptive Semantic Samplingcited by 0
  25. 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraintscited by 0
  26. 2026Not What, But How: A Framework for Auditing LLM Responses across Positioning, Generalization, Anthropomorphism, and Maximscited by 0
  27. 2026Culturally-Adapted Red-Teaming Across East and Southeast Asian Contexts: A Methodological and Comparative Analysiscited by 0
  28. 2026Equity with Efficiency: An Empirical Study of Tokenizers for Multilingual Large Language Modelscited by 0
  29. 2026SEATauBench: Progressively Adapting Tool-Agent-User Evaluation Into Low-Resource Southeast Asian Languagescited by 0
  30. 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0
  31. 2026Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sitescited by 0