mlsanityData to 14 Oct 2026

Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala

arXiv 2609.08609 ↗First posted 8 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Tracking semantic change in low-resource languages across extensive historical timelines presents significant challenges due to data scarcity and the limitations of static embedding alignments. This study investigates the diachronic evolution of the Sinhala language from the 13th to the 20th century using a multi-stage computational framework. We first align century-specific Word2Vec and FastText embeddings using Similarity Matrix Based Alignment (SMA) and Orthogonal Procrustes (OP) techniques, finding that OP alignment provides more stable neighbourhood tracking for identifying temporal similarity dips. To move beyond aggregate measures, we introduce a Bidirectional Semantic Impact Pruning approach using contextualised embeddings from a fine-tuned Llama-3.1-8B. By applying Leave-One-Out (LOO) diagnostics, we attempt to isolate influential sentences to distinguish between systemic semantic shifts and transient polysemic expansion. Our results show that semantic drift in the fine-tuned Llama-3.1-8B is not evenly distributed across all usages. Instead, a significant part of the change is driven by a smaller set of high-impact contextual instances, rather than gradual and uniform change across all occurrences. This work provides a preliminary framework for low-resource Sinhala diachronic analysis, highlighting the trade-offs between model sensitivity and data availability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 154 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

32 of 154 references.

References · 32

  1. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  2. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  3. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 221
  4. 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 108
  5. 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
  6. 2016Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Changecited by 63
  7. 2018Survey of Computational Approaches to Lexical Semantic Changecited by 62
  8. 2022Some Languages are More Equal than Others: Probing Deeper into the Linguistic Disparity in the NLP Worldcited by 55
  9. 2014Temporal Analysis of Language through Neural Language Modelscited by 54
  10. 2017Dynamic Word Embeddingscited by 51
  11. 2018On the Dimensionality of Word Embeddingcited by 46
  12. 2019Survey on Publicly Available Sinhala Natural Language Processing Tools and Researchcited by 46
20 more
  1. 2019Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shiftcited by 37
  2. 2018Diachronic Usage Relatedness (DURel): A Framework for the Annotation of Lexical Semantic Changecited by 35
  3. 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
  4. 2020RuSemShift: a dataset of historical lexical semantic change in Russiancited by 16
  5. 2022Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slangcited by 15
  6. 2017High-risk learning: acquiring new word vectors from tiny datacited by 13
  7. 2019Semantic Drift in Multilingual Representationscited by 13
  8. 2021Three-part diachronic semantic change dataset for Russiancited by 11
  9. 2020CIRCE at SemEval-2020 Task 1: Ensembling Context-Free and Context-Dependent Word Representationscited by 9
  10. 2025Zero-shot OCR Accuracy of Low-Resourced Languages: A Comparative Analysis on Sinhala and Tamilcited by 9
  11. 2025SinLlama -- A Large Language Model for Sinhalacited by 9
  12. 2020ELMo and BERT in semantic change detection for Russiancited by 8
  13. 2020UWB at SemEval-2020 Task 1: Lexical Semantic Change Detectioncited by 7
  14. 2017Dynamic Bernoulli Embeddings for Language Evolutioncited by 6
  15. 2021Lexical semantic change for Ancient Greek and Latincited by 4
  16. 2013An open diachronic corpus of historical Spanish: annotation criteria and automatic modernisation of spellingcited by 2
  17. 2019Empirical Study of Diachronic Word Embeddings for Scarce Datacited by 2
  18. 2019Invariance and identifiability issues for word embeddingscited by 2
  19. 2023Semantic Change Detection for the Romanian Languagecited by 1
  20. 2026Entropy, Disagreement, and the Limits of Foundation Models in Genomicscited by 1

Built on by

Not cited yet.