mlsanityData to 7 Oct 2026

A Comprehensive Analysis of Static Word Embeddings for Turkish

arXiv 2405.07778 ↗First posted 13 May 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Word embeddings are fixed-length, dense and distributed word representations that are used in natural language processing (NLP) applications. There are basically two types of word embedding models which are non-contextual (static) models and contextual models. The former method generates a single embedding for a word regardless of its context, while the latter method produces distinct embeddings for a word based on the specific contexts in which it appears. There are plenty of works that compare contextual and non-contextual embedding models within their respective groups in different languages. However, the number of studies that compare the models in these two groups with each other is very few and there is no such study in Turkish. This process necessitates converting contextual embeddings into static embeddings. In this paper, we compare and evaluate the performance of several contextual and non-contextual models in both intrinsic and extrinsic evaluation settings for Turkish. We make a fine-grained comparison by analyzing the syntactic and semantic capabilities of the models separately. The results of the analyses provide insights about the suitability of different embedding models in different types of NLP tasks. We also build a Turkish word embedding repository comprising the embedding models used in this work, which may serve as a valuable resource for researchers and practitioners in the field of Turkish NLP. We make the word embeddings, scripts, and evaluation datasets publicly available.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 60 references that are in the map. First posted on arXiv 13 May 2024.

Builds on

24 of 60 references.

References · 24

  1. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  2. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  3. 2018Deep contextualized word representationscited by 2,285
  4. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  5. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  6. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  7. 2018Learning Word Vectors for 157 Languagescited by 279
  8. 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
  9. 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 251
  10. 2019Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddingscited by 146
  11. 2017Learned in Translation: Contextualized Word Vectorscited by 104
  12. 2019Gender-preserving Debiasing for Pre-trained Word Embeddingscited by 61
12 more
  1. 2016Dynamic Coattention Networks For Question Answeringcited by 49
  2. 2019Evaluating Word Embedding Models: Methods and Experimental Resultscited by 37
  3. 2020Are All Good Word Vector Spaces Isomorphic?cited by 36
  4. 2018A Comparison of Word Embeddings for the Biomedical Natural Language Processingcited by 29
  5. 2016Problems With Evaluation of Word Embeddings Using Word Similarity Taskscited by 25
  6. 2018Towards Better UD Parsing: Deep Contextualized Word Embeddings, Ensemble, and Treebank Concatenationcited by 21
  7. 2021Obtaining Better Static Word Embeddings Using Contextual Embedding Modelscited by 18
  8. 2023Evaluation of GPT and BERT-based models on identifying protein-protein interactions in biomedical textcited by 9
  9. 2020Resources for Turkish Dependency Parsing: Introducing the BOUN Treebank and the BoAT Annotation Toolcited by 7
  10. 2017A Morphology-aware Network for Morphological Disambiguationcited by 3
  11. 2018Improving Named Entity Recognition by Jointly Learning to Disambiguate Morphological Tagscited by 2
  12. 2020Comparison of Turkish Word Representations Trained on Different Morphological Formscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

  1. 2025A Comparative Analysis of Static Word Embeddings for Hungariancited by 0
  2. 2025TurkEmbed: Turkish Embedding Model on NLI & STS Taskscited by 0