mlsanityData to 7 Oct 2026

Taxi1500: A Multilingual Dataset for Text Classification in 1500 Languages

arXiv 2305.08487 ↗First posted 15 May 2023cs.CLcited by 23

Not on the map. Why?

Abstract (arXiv)

While natural language processing tools have been developed extensively for some of the world's languages, a significant portion of the world's over 7000 languages are still neglected. One reason for this is that evaluation datasets do not yet cover a wide range of languages, including low-resource and endangered ones. We aim to address this issue by creating a text classification dataset encompassing a large number of languages, many of which currently have little to no annotated data available. We leverage parallel translations of the Bible to construct such a dataset by first developing applicable topics and employing a crowdsourcing tool to collect annotated data. By annotating the English side of the data and projecting the labels onto other languages through aligned verses, we generate text classification datasets for more than 1500 languages. We extensively benchmark several existing multilingual language models using our dataset. To facilitate the advancement of research in this area, we will release our dataset and code.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 15 May 2023.

Builds on

19 of 44 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  6. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  7. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  8. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  9. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
  10. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  11. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
  12. 2022Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuningcited by 149
7 more
  1. 2017The IIT Bombay English-Hindi Parallel Corpuscited by 74
  2. 2018Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processingcited by 63
  3. 2018A Corpus for Multilingual Document Classification in Eight Languagescited by 42
  4. 2022SERENGETI: Massively Multilingual Language Models for Africacited by 40
  5. 2019MultiFiT: Efficient Multi-lingual Language Model Fine-tuningcited by 31
  6. 2022KinyaBERT: a Morphology-aware Kinyarwanda Language Modelcited by 27
  7. 2020Six Attributes of Unhealthy Conversationcited by 19

Built on by

Cited by year

Citing papers per year: 2023: 5; 2024: 14; 2025: 4.

23 papers.

Sort:

By area:

  1. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 149
  2. 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
  3. 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Biascited by 82
  4. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  5. 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
  6. 2023OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretrainingcited by 37
  7. 2024EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Modelscited by 16
  8. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
  9. 2024Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignmentcited by 14
  10. 2024MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructionscited by 12
  11. 2023Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphscited by 11
  12. 2024TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Datacited by 9
11 more
  1. 2024Exploring the Role of Transliteration in In-Context Learning for Low-resource Languages Written in Non-Latin Scriptscited by 8
  2. 2023Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understandingcited by 7
  3. 2024ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Taskscited by 7
  4. 2024Uhura: A Benchmark for Evaluating Scientific Question Answering and Truthfulness in Low-Resource African Languagescited by 7
  5. 2024SpeechTaxi: On Multilingual Semantic Speech Classificationcited by 6
  6. 2025MiLiC-Eval: Benchmarking Multilingual LLMs for China's Minority Languagescited by 4
  7. 2024TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Modelscited by 3
  8. 2024ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Modelcited by 2
  9. 2024LangSAMP: Language-Script Aware Multilingual Pretrainingcited by 2
  10. 2025Beyond Weaponization: NLP Security for Medium and Lower-Resourced Languages in Their Own Rightcited by 2
  11. 2025GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Modelscited by 0