mlsanityData to 7 Oct 2026

The WiLI benchmark dataset for written language identification

arXiv 1801.07779 ↗First posted 23 Jan 2018cs.CV cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

This paper describes the WiLI-2018 benchmark dataset for monolingual written natural language identification. WiLI-2018 is a publicly available, free of charge dataset of short text extracts from Wikipedia. It contains 1000 paragraphs of 235 languages, totaling in 23500 paragraphs. WiLI is a classification dataset: Given an unknown paragraph written in one dominant language, it has to be decided which language it is.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jan 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 1; 2023: 2; 2024: 0; 2025: 1; 2026: 3.

8 papers.

  1. 2023An Open Dataset and Model for Language Identificationcited by 49
  2. 2023GlotLID: Language Identification for Low-Resource Languagescited by 37
  3. 2022Out of Distribution Data Detection Using Dropout Bayesian Neural Networkscited by 15
  4. 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 4
  5. 2025DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switchingcited by 3
  6. 2026What Language is This? Ask Your Tokenizercited by 1
  7. 2026Understanding LLM Performance Degradation in Multi-Instance Processing: The Roles of Instance Count and Context Lengthcited by 1
  8. 2021Additive Feature Hashingcited by 0