# Approaches to Corpus Creation for Low-Resource Language Technology: the Case of Southern Kurdish and Laki

arXiv: https://arxiv.org/abs/2304.01319 · HTML: https://mlsanity.com/paper/2304.01319/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 56 references that are in the map.
- First posted on arXiv 3 Apr 2023.

## Builds on (most cited first, 7 of 7)

- [Enriching Word Vectors with Subword Information](https://mlsanity.com/paper/1607.04606/) (2016)
- [No Language Left Behind: Scaling Human-Centered Machine Translation](https://mlsanity.com/paper/2207.04672/) (2022)
- [The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation](https://mlsanity.com/paper/2106.03193/) (2021)
- [A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios](https://mlsanity.com/paper/2010.12309/) (2020)
- [A Rule-based Kurdish Text Transliteration System](https://mlsanity.com/paper/1811.10278/) (2018)
- [Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus](https://mlsanity.com/paper/2010.01554/) (2020)
- [Bianet: A Parallel News Corpus in Turkish, Kurdish and English](https://mlsanity.com/paper/1805.05095/) (2018)

## Built on by (most cited first, 2 of 2)

- [CODET: A Benchmark for Contrastive Dialectal Evaluation of Machine Translation](https://mlsanity.com/paper/2305.17267/) (2023)
- [Language and Speech Technology for Central Kurdish Varieties](https://mlsanity.com/paper/2403.01983/) (2024)

## Abstract (arXiv)

One of the major challenges that under-represented and endangered language communities face in language technology is the lack or paucity of language data. This is also the case of the Southern varieties of the Kurdish and Laki languages for which very limited resources are available with insubstantial progress in tools. To tackle this, we provide a few approaches that rely on the content of local news websites, a local radio station that broadcasts content in Southern Kurdish and fieldwork for Laki. In this paper, we describe some of the challenges of such under-represented languages, particularly in writing and standardization, and also, in retrieving sources of data and retro-digitizing handwritten content to create a corpus for Southern Kurdish and Laki. In addition, we study the task of language identification in light of the other variants of Kurdish and Zaza-Gorani languages.