mlsanityData to 14 Oct 2026

Diacritic Restoration for Low-Resource Indigenous Languages: Case Study with Bribri and Cook Islands M=aori

arXiv 2512.19630 ↗First posted 22 Dec 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We present experiments on diacritic restoration, a form of text normalization essential for natural language processing (NLP) tasks. Our study focuses on two extremely under-resourced languages: Bribri, a Chibchan language spoken in Costa Rica, and Cook Islands M=aori, a Polynesian language spoken in the Cook Islands. Specifically, this paper: (i) compares algorithms for diacritics restoration in under-resourced languages, including tonal diacritics, (ii) examines the amount of data required to achieve target performance levels, (iii) contrasts results across varying resource conditions, and (iv) explores the related task of diacritic correction. We find that fine-tuned, character-level LLMs perform best, likely due to their ability to decompose complex characters into their UTF-8 byte representations. In contrast, massively multilingual models perform less effectively given our data constraints. Across all models, reliable performance begins to emerge with data budgets of around 10,000 words. Zero-shot approaches perform poorly in all cases. This study responds both to requests from the language communities and to broader NLP research questions concerning model performance and generalization in under-resourced contexts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 63 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

10 of 63 references.

References · 10

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  3. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  4. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 509
  5. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
  6. 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
  7. 2022How can NLP Help Revitalize Endangered Languages? A Case Study and Roadmap for the Cherokee Languagecited by 19
  8. 2020A Multitask Learning Approach for Diacritic Restorationcited by 12
  9. 2024Evaluating Pixel Language Models on Non-Standardized Languagescited by 10
  10. 2024Don't Touch My Diacriticscited by 7

Built on by

Not cited yet.