mlsanityData to 7 Oct 2026

Mukayese: Turkish NLP Strikes Back

arXiv 2203.01215 ↗First posted 2 Mar 2022cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Having sufficient resources for language X lifts it from the under-resourced languages class, but not necessarily from the under-researched class. In this paper, we address the problem of the absence of organized benchmarks in the Turkish language. We demonstrate that languages such as Turkish are left behind the state-of-the-art in NLP applications. As a solution, we present Mukayese, a set of NLP benchmarks for the Turkish language that contains several NLP tasks. We work on one or more datasets for each benchmark and present two or more baselines. Moreover, we present four new benchmarking datasets in Turkish for language modeling, sentence segmentation, and spell checking. All datasets and baselines are available under: https://github.com/alisafaya/mukayese

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 30 of its 87 references that are in the map. First posted on arXiv 2 Mar 2022.

Builds on

30 of 87 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  7. 2016Pointer Sentinel Mixture Modelscited by 2,992
  8. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  9. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  10. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  11. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  12. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
18 more
  1. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  2. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  3. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  4. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
  5. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  6. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
  7. 2017Convolutional Sequence to Sequence Learningcited by 550
  8. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
  9. 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
  10. 2019Adaptive Attention Span in Transformerscited by 148
  11. 2020MLSUM: The Multilingual Summarization Corpuscited by 121
  12. 2020How Can We Accelerate Progress Towards Human-like Linguistic Generalization?cited by 114
  13. 2020KLEJ: Comprehensive Benchmark for Polish Language Understandingcited by 51
  14. 2021When Attention Meets Fast Recurrence: Training Language Models with Reduced Computecited by 34
  15. 2018Simple Fusion: Return of the Language Modelcited by 30
  16. 2020Utility is in the Eye of the User: A Critique of NLP Leaderboardscited by 28
  17. 2019Single Headed Attention RNN: Stop Thinking With Your Headcited by 25
  18. 2019One-To-Many Multilingual End-to-end Speech Translationcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 2; 2024: 3; 2025: 1; 2026: 1.

9 papers.

  1. 2023ScandEval: A Benchmark for Scandinavian Natural Language Processingcited by 16
  2. 2022This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polishcited by 13
  3. 2024Bridging the Bosphorus: Advancing Turkish Large Language Models through Strategies for Low-Resource Language Adaptation and Benchmarkingcited by 10
  4. 2024Introducing cosmosGPT: Monolingual Training for Turkish Language Modelscited by 8
  5. 2022Resources for Turkish Natural Language Processing: A critical surveycited by 6
  6. 2023Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkishcited by 5
  7. 2024GECTurk WEB: An Explainable Online Platform for Turkish Grammatical Error Detection and Correctioncited by 1
  8. 2025TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkishcited by 1
  9. 2026TurkicNLP: An NLP Toolkit for Turkic Languagescited by 1