mlsanityData to 7 Oct 2026

Tracking Semantic Change in Slovene: A Novel Dataset and Optimal Transport-Based Distance

arXiv 2402.16596 ↗First posted 26 Feb 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we focus on the detection of semantic changes in Slovene, a less resourced Slavic language with two million speakers. Detecting and tracking semantic changes provides insight into the evolution of language caused by changes in society and culture. We present the first Slovene dataset for evaluating semantic change detection systems, which contains aggregated semantic change scores for 104 target words obtained from more than 3,000 manually annotated sentence pairs. We analyze an important class of measures of semantic change metrics based on the Average pairwise distance and identify several limitations. To address these limitations, we propose a novel metric based on regularized optimal transport, which offers a more robust framework for quantifying semantic change. We provide a comprehensive evaluation of various existing semantic change detection methods and associated semantic change measures on our dataset. Through empirical testing, we demonstrate that our proposed approach, leveraging regularized optimal transport, achieves either matching or improved performance compared to baseline approaches.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 87 references that are in the map. First posted on arXiv 26 Feb 2024.

Builds on

41 of 87 references.

References · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  6. 2020AdapterHub: A Framework for Adapting Transformerscited by 441
  7. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  8. 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 382
  9. 2018WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representationscited by 370
  10. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
  11. 2019Visualizing and Measuring the Geometry of BERTcited by 215
  12. 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 105
29 more
  1. 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
  2. 2018Diachronic word embeddings and semantic shifts: a surveycited by 90
  3. 2016Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Changecited by 63
  4. 2018Survey of Computational Approaches to Lexical Semantic Changecited by 60
  5. 2014Temporal Analysis of Language through Neural Language Modelscited by 53
  6. 2021Time Masking for Temporal Language Modelscited by 46
  7. 2018Diachronic Usage Relatedness (DURel): A Framework for the Annotation of Lexical Semantic Changecited by 35
  8. 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 33
  9. 2020UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detectioncited by 32
  10. 2019A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domainscited by 31
  11. 2020Capturing Evolution in Word Usage: Just Add More Clusters?cited by 22
  12. 2021Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corporacited by 21
  13. 2023A Survey on Contextualised Semantic Shift Detectioncited by 21
  14. 2020Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transportcited by 20
  15. 2020RuSemShift: a dataset of historical lexical semantic change in Russiancited by 16
  16. 2018A State-of-the-Art of Semantic Change Computationcited by 14
  17. 2022Toward Interpretable Semantic Textual Similarity via Optimal Transport-based Contrastive Sentence Learningcited by 13
  18. 2020Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddingscited by 12
  19. 2021Three-part diachronic semantic change dataset for Russiancited by 11
  20. 2022LSCDiscovery: A shared task on semantic change discovery and detection in Spanishcited by 11
  21. 2020CIRCE at SemEval-2020 Task 1: Ensembling Context-Free and Context-Dependent Word Representationscited by 9
  22. 2023Substitution-based Semantic Change Detection using Contextual Embeddingscited by 9
  23. 2020ELMo and BERT in semantic change detection for Russiancited by 8
  24. 2020Improving Text Generation with Student-Forcing Optimal Transportcited by 8
  25. 2017Measuring, Predicting and Visualizing Short-Term Change in Word Representation and Usage in VKontakte Social Networkcited by 7
  26. 2019Simple dynamic word embeddings for mapping perceptions in the public spherecited by 7
  27. 2022Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Changecited by 7
  28. 2023CLASSLA-Stanza: The Next Step for Linguistic Processing of South Slavic Languagescited by 7
  29. 2018The Global Anchor Method for Quantifying Linguistic Shifts and Domain Adaptationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026DHPLT: large-scale multilingual diachronic corpora and word representations for semantic change modellingcited by 1