mlsanityData to 14 Oct 2026

NagaNLP: Bootstrapping NLP for Low-Resource Nagamese Creole with Human-in-the-Loop Synthetic Data

arXiv 2512.12537 ↗First posted 14 Dec 2025cs.CLcited by 1

On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation

Abstract (arXiv)

The vast majority of the world's languages, particularly creoles like Nagamese, remain severely under-resourced in Natural Language Processing (NLP), creating a significant barrier to their representation in digital technology. This paper introduces NagaNLP, a comprehensive open-source toolkit for Nagamese, bootstrapped through a novel methodology that relies on LLM-driven but human-validated synthetic data generation. We detail a multi-stage pipeline where an expert-guided LLM (Gemini) generates a candidate corpus, which is then refined and annotated by native speakers. This synthetic-hybrid approach yielded a 10K pair conversational dataset and a high-quality annotated corpus for foundational tasks. To assess the effectiveness of our methodology, we trained both discriminative and generative models. Our fine-tuned XLM-RoBERTa-base model establishes a new benchmark for Nagamese, achieving a 93.81% accuracy (0.90 F1-Macro) on Part-of-Speech tagging and a 0.75 F1-Macro on Named Entity Recognition, massively outperforming strong zero-shot baselines. Furthermore, we fine-tuned a Llama-3.2-3B Instruct model, named NagaLLaMA, which demonstrates superior performance on conversational tasks, achieving a Perplexity of 3.85, an order of magnitude improvement over its few-shot counterpart (96.76). We release the NagaNLP toolkit, including all datasets, models, and code, providing a foundational resource for a previously underserved language and a reproducible framework for reducing data scarcity in other low-resource contexts.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 21 of its 54 references that are in the map. First posted on arXiv 14 Dec 2025.

Builds on

21 of 54 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  3. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  4. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  5. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
  6. 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
  7. 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 271
  8. 2021Generating Datasets with Pretrained Language Modelscited by 193
  9. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  10. 2020LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluationcited by 93
  11. 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
  12. 2025Myanmar XNLI: Building a Dataset and Exploring Low-resource Approaches to Natural Language Inference with Myanmarcited by 8
9 more
  1. 2022AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognitioncited by 6
  2. 2024Synthetic Data Generation and Joint Learning for Robust Code-Mixed Translationcited by 5
  3. 2024Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translationcited by 4
  4. 2024Turkronicles: Diachronic Resources for the Fast Evolving Turkish Languagecited by 4
  5. 2024Extending LLMs to New Languages: A Case Study of Llama and Persian Adaptationcited by 3
  6. 2024Part-of-Speech Tagger for Bodo Language using Deep Learning approachcited by 2
  7. 2025BBPOS: BERT-based Part-of-Speech Tagging for Uzbekcited by 2
  8. 2024Enhancing Assamese NLP Capabilities: Introducing a Centralized Dataset Repositorycited by 1
  9. 2025Part-of-speech tagging for Nagamese Language using CRFcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognition
  2. 2026Better as Generators Than Classifiers: Leveraging LLMs and Synthetic Data for Low-Resource Multilingual Classification
  3. 2023Aligning Large Language Models with Human: A Survey
  4. 2026SemBench: A Universal Semantic Framework for LLM Evaluation
  5. 2024A synthetic data approach for domain generalization of NLI models
  6. 2025Synthetic Data Generation for Phrase Break Prediction with Large Language Model
  7. 2024Efficacy of Synthetic Data as a Benchmark
  8. 2025Synthetic bootstrapped pretraining