NagaNLP: Bootstrapping NLP for Low-Resource Nagamese Creole with Human-in-the-Loop Synthetic Data
On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation
Abstract (arXiv)
The vast majority of the world's languages, particularly creoles like Nagamese, remain severely under-resourced in Natural Language Processing (NLP), creating a significant barrier to their representation in digital technology. This paper introduces NagaNLP, a comprehensive open-source toolkit for Nagamese, bootstrapped through a novel methodology that relies on LLM-driven but human-validated synthetic data generation. We detail a multi-stage pipeline where an expert-guided LLM (Gemini) generates a candidate corpus, which is then refined and annotated by native speakers. This synthetic-hybrid approach yielded a 10K pair conversational dataset and a high-quality annotated corpus for foundational tasks. To assess the effectiveness of our methodology, we trained both discriminative and generative models. Our fine-tuned XLM-RoBERTa-base model establishes a new benchmark for Nagamese, achieving a 93.81% accuracy (0.90 F1-Macro) on Part-of-Speech tagging and a 0.75 F1-Macro on Named Entity Recognition, massively outperforming strong zero-shot baselines. Furthermore, we fine-tuned a Llama-3.2-3B Instruct model, named NagaLLaMA, which demonstrates superior performance on conversational tasks, achieving a Perplexity of 3.85, an order of magnitude improvement over its few-shot counterpart (96.76). We release the NagaNLP toolkit, including all datasets, models, and code, providing a foundational resource for a previously underserved language and a reproducible framework for reducing data scarcity in other low-resource contexts.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 21 of its 54 references that are in the map. First posted on arXiv 14 Dec 2025.
Builds on
21 of 54 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 271
- 2021Generating Datasets with Pretrained Language Modelscited by 193
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2020LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluationcited by 93
- 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
- 2025Myanmar XNLI: Building a Dataset and Exploring Low-resource Approaches to Natural Language Inference with Myanmarcited by 8
9 more
- 2022AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognitioncited by 6
- 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
- 2024Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translationcited by 4
- 2024Turkronicles: Diachronic Resources for the Fast Evolving Turkish Languagecited by 4
- 2024Extending LLMs to New Languages: A Case Study of Llama and Persian Adaptationcited by 3
- 2024Part-of-Speech Tagger for Bodo Language using Deep Learning approachcited by 2
- 2025BBPOS: BERT-based Part-of-Speech Tagging for Uzbekcited by 2
- 2024Enhancing Assamese NLP Capabilities: Introducing a Centralized Dataset Repositorycited by 1
- 2025Part-of-speech tagging for Nagamese Language using CRFcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognition
- 2026Better as Generators Than Classifiers: Leveraging LLMs and Synthetic Data for Low-Resource Multilingual Classification
- 2023Aligning Large Language Models with Human: A Survey
- 2026SemBench: A Universal Semantic Framework for LLM Evaluation
- 2024A synthetic data approach for domain generalization of NLI models
- 2025Synthetic Data Generation for Phrase Break Prediction with Large Language Model
- 2024Efficacy of Synthetic Data as a Benchmark
- 2025Synthetic bootstrapped pretraining