mlsanityData to 7 Oct 2026

IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP

arXiv 2011.00677 ↗First posted 2 Nov 2020cs.CLcited by 57

Not on the map. Why?

Abstract (arXiv)

Although the Indonesian language is spoken by almost 200 million people and the 10th most spoken language in the world, it is under-represented in NLP research. Previous work on Indonesian has been hampered by a lack of annotated datasets, a sparsity of language resources, and a lack of resource standardization. In this work, we release the IndoLEM dataset comprising seven tasks for the Indonesian language, spanning morpho-syntax, semantics, and discourse. We additionally release IndoBERT, a new pre-trained language model for Indonesian, and evaluate it over IndoLEM, in addition to benchmarking it against existing resources. Our experiments show that IndoBERT achieves state-of-the-art performance over most of the tasks in IndoLEM.

Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 6; 2022: 11; 2023: 14; 2024: 15; 2025: 8; 2026: 3.

57 papers.

Sort:

By area:

  1. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
  2. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  3. 2023Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptationcited by 79
  4. 2022NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languagescited by 67
  5. 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 65
  6. 2021IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generationcited by 57
  7. 2023Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLUcited by 53
  8. 2021Discourse Probing of Pretrained Language Modelscited by 38
  9. 2022NusaCrowd: Open Source Initiative for Indonesian NLP Resourcescited by 38
  10. 2022KinyaBERT: a Morphology-aware Kinyarwanda Language Modelcited by 27
  11. 2021IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initializationcited by 25
  12. 2021IndoNLI: A Natural Language Inference Dataset for Indonesiancited by 24
38 more
  1. 2022GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Costcited by 24
  2. 2023InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction Tuningcited by 21
  3. 2024Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languagescited by 18
  4. 2023ScandEval: A Benchmark for Scandinavian Natural Language Processingcited by 16
  5. 2021Evaluating the Efficacy of Summarization Evaluation across Languagescited by 14
  6. 2023QASiNa: Religious Domain Question Answering using Sirah Nabawiyahcited by 14
  7. 2022This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polishcited by 13
  8. 2022CINO: A Chinese Minority Pre-trained Language Modelcited by 11
  9. 2023Bridging the Digital Divide: Performance Variation across Socio-Economic Factors in Vision-Language Modelscited by 11
  10. 2025Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindicited by 10
  11. 2023NLEBench+NorGLM: A Comprehensive Empirical Analysis and Benchmark Dataset for Generative Language Models in Norwegiancited by 9
  12. 2023A Comprehensive Analysis of Adapter Efficiencycited by 8
  13. 2025Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asiacited by 8
  14. 2024Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexiconcited by 7
  15. 2025The State of Large Language Models for African Languages: Progress and Challengescited by 7
  16. 2022Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Modelscited by 5
  17. 2023GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmarkcited by 5
  18. 2023IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languagescited by 5
  19. 2023bgGLUE: A Bulgarian General Language Understanding Evaluation Benchmarkcited by 4
  20. 2023NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languagescited by 4
  21. 2024Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesiacited by 4
  22. 2022MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplificationcited by 3
  23. 2023MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in Indonesiancited by 3
  24. 2024Generating bilingual example sentences with large language models as lexicography assistantscited by 3
  25. 2024Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impactcited by 3
  26. 2024SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languagescited by 3
  27. 2024Investigating Text Shortening Strategy in BERT: Truncation vs Summarizationcited by 2
  28. 2025What Do Indonesians Really Need from Language Technology? A Nationwide Surveycited by 2
  29. 2025SEA-BED: How Do Embedding Models Represent Southeast Asian Languages?cited by 2
  30. 2022Location-based Twitter Filtering for the Creation of Low-Resource Language Datasets in Indonesian Local Languagescited by 1
  31. 2022Rethinking Annotation: Can Language Learners Contribute?cited by 1
  32. 2024Few-Shot Cross-Lingual Transfer for Prompting Large Language Models in Low-Resource Languagescited by 1
  33. 2024MasonTigers at SemEval-2024 Task 1: An Ensemble Approach for Semantic Textual Relatednesscited by 1
  34. 2024Enhancing Natural Language Inference Performance with Knowledge Graph for COVID-19 Automated Fact-Checking in Indonesian Languagecited by 1
  35. 2024VL-GLUE: A Suite of Fundamental yet Challenging Visuo-Linguistic Reasoning Taskscited by 1
  36. 2024Crowdsourcing Lexical Diversitycited by 1
  37. 2025IndoPref: A Multi-Domain Pairwise Preference Dataset for Indonesiancited by 1
  38. 2023Sejarah dan Perkembangan Teknik Natural Language Processing (NLP) Bahasa Indonesia: Tinjauan tentang sejarah, perkembangan teknologi, dan aplikasi NLP dalam bahasa Indonesiacited by 0

50 most cited of 57 All 57 (JSON)