mlsanityData to 14 Oct 2026

A Systematic Survey of Natural Language Processing for the Greek Language

arXiv 2407.09861 ↗First posted 13 Jul 2024cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Comprehensive monolingual Natural Language Processing (NLP) surveys are essential for assessing language-specific challenges, resource availability, and research gaps. However, existing surveys often lack standardized methodologies, leading to selection bias and fragmented coverage of NLP tasks and resources. This study introduces a generalizable framework for systematic monolingual NLP surveys. Our approach integrates a structured search protocol to minimize bias, an NLP task taxonomy for classification, and language resource taxonomies to identify potential benchmarks and highlight opportunities for improving resource availability. We apply this framework to Greek NLP (2012-2023), providing an in-depth analysis of its current state, task-specific progress, and resource gaps. The survey results are publicly available (https://doi.org/10.5281/zenodo.15314882) and are regularly updated to provide an evergreen resource. This systematic survey of Greek NLP serves as a case study, demonstrating the effectiveness of our framework and its potential for broader application to other not so well-resourced languages as regards NLP.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 90 of its 378 references that are in the map. First posted on arXiv 13 Jul 2024.

Builds on

90 of 378 references.

References · 90

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  8. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  10. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  12. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
38 more
  1. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  2. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  3. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  4. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  5. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  6. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  7. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  8. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  9. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  10. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  11. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  12. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  13. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
  14. 2019How multilingual is Multilingual BERT?cited by 645
  15. 2024Large Language Models: A Surveycited by 525
  16. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
  17. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
  18. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  19. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 271
  20. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
  21. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 222
  22. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 221
  23. 2016A Decomposable Attention Model for Natural Language Inferencecited by 215
  24. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 207
  25. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  26. 2021Challenges in Detoxifying Language Modelscited by 169
  27. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  28. 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
  29. 2019Fine-tune BERT for Extractive Summarizationcited by 122
  30. 2021Systematic Inequalities in Language Technology Performance across the World's Languagescited by 120
  31. 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 118
  32. 2020Toxicity Detection: Does Context Really Matter?cited by 93
  33. 2021Survey of Low-Resource Machine Translationcited by 92
  34. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  35. 2021Mitigating Language-Dependent Ethnic Bias in BERTcited by 87
  36. 2016Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Changecited by 63
  37. 2018A Survey on Semantic Parsingcited by 62
  38. 2020Offensive Language Identification in Greekcited by 50

50 most cited of 90 All 90 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.