mlsanityData to 7 Oct 2026

TurkicNLP: An NLP Toolkit for Turkic Languages

arXiv 2602.19174 ↗First posted 22 Feb 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Natural language processing for the Turkic language family, spoken by over 200 million people across Eurasia, remains fragmented, with most languages lacking unified tooling and resources. We present TurkicNLP, an open-source Python library providing a single, consistent NLP pipeline for Turkic languages across four script families: Latin, Cyrillic, Perso-Arabic, and Old Turkic Runic. The library covers tokenization, morphological analysis, part-of-speech tagging, dependency parsing, named entity recognition, bidirectional script transliteration, cross-lingual sentence embeddings, and machine translation through one language-agnostic API. A modular multi-backend architecture integrates rule-based finite-state transducers and neural models transparently, with automatic script detection and routing between script variants. Outputs follow the CoNLL-U standard for full interoperability and extension. Code and documentation are hosted at https://github.com/turkic-nlp/turkicnlp .

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 102 references that are in the map. First posted on arXiv 22 Feb 2026.

Builds on

35 of 102 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  4. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  5. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  6. 2020Language-agnostic BERT Sentence Embeddingcited by 621
  7. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  8. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  9. 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
  10. 2021Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processingcited by 68
  11. 2022Bitext Mining Using Distilled Sentence Representations for Low-Resource Languagescited by 48
  12. 2024TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkishcited by 31
23 more
  1. 2023PyThaiNLP: Thai Natural Language Processing in Pythoncited by 27
  2. 2021A Large-Scale Study of Machine Translation in the Turkic Languagescited by 21
  3. 2013Polyglot: Distributed Word Representations for Multilingual NLPcited by 19
  4. 2021KazNERD: Kazakh Named Entity Recognition Datasetcited by 15
  5. 2024TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generationcited by 13
  6. 2020Cross-Lingual Word Embeddings for Turkic Languagescited by 12
  7. 2024Setting Standards in Turkish NLP: TR-MMLU for Large Language Model Evaluationcited by 11
  8. 2022KazakhTTS2: Extending the Open-Source Kazakh TTS Corpus With More Data, Speakers, and Topicscited by 10
  9. 2022Mukayese: Turkish NLP Strikes Backcited by 9
  10. 2021Evaluating Multiway Multilingual NMT in the Turkic Languagescited by 8
  11. 2025TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languagescited by 8
  12. 2024KazQAD: Kazakh Open-Domain Question Answering Datasetcited by 7
  13. 2025Cetvel: A Unified Benchmark for Evaluating Language Understanding, Generation and Cultural Capacity of LLMs for Turkishcited by 7
  14. 2024Recent Advancements and Challenges of Turkic Central Asian Language Processingcited by 6
  15. 2024KazParC: Kazakh Parallel Corpus for Machine Translationcited by 5
  16. 2024KyrgyzNLP: Challenges, Progress, and Futurecited by 4
  17. 2026TurkBench: A Benchmark for Evaluating Turkish Large Language Modelscited by 4
  18. 2017Automatically Annotated Turkish Corpus for Named Entity Recognition and Text Categorization using Large-Scale Gazetteerscited by 3
  19. 2024Dependency Annotation of Ottoman Turkish with Multilingual BERTcited by 3
  20. 2023Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliterationcited by 2
  21. 2023calamanCy: A Tagalog Natural Language Processing Toolkitcited by 2
  22. 2024Open foundation models for Azerbaijani languagecited by 2
  23. 2025Human-Annotated NER Dataset for the Kyrgyz Languagecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Universal or Language-Family-Specific Script Unification for Cross-Lingual Transfer? A Case Study on Turkic Languagescited by 0