mlsanityData to 7 Oct 2026

UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection

arXiv 2005.00050 ↗First posted 30 Apr 2020cs.CLcited by 32

Not on the map. Why?

Abstract (arXiv)

We apply contextualised word embeddings to lexical semantic change detection in the SemEval-2020 Shared Task 1. This paper focuses on Subtask 2, ranking words by the degree of their semantic drift over time. We analyse the performance of two contextualising architectures (BERT and ELMo) and three change detection algorithms. We find that the most effective algorithms rely on the cosine similarity between averaged token embeddings and the pairwise distances between token embeddings. They outperform strong baselines by a large margin (in the post-evaluation phase, we have the best Subtask 2 submission for SemEval-2020 Task 1), but interestingly, the choice of a particular algorithm depends on the distribution of gold scores in the test set.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 6; 2023: 4; 2024: 9; 2025: 3; 2026: 3.

32 papers.

Sort:

  1. 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 33
  2. 2023A Survey on Contextualised Semantic Shift Detectioncited by 21
  3. 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
  4. 2022Contextualized language models for semantic change detection: lessons learnedcited by 20
  5. 2021Statistically significant detection of semantic shifts using contextual word embeddingscited by 14
  6. 2022Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slangcited by 14
  7. 2021Lexical Semantic Change Discoverycited by 13
  8. 2022LSCDiscovery: A shared task on semantic change discovery and detection in Spanishcited by 11
  9. 2023Can Word Sense Distribution Detect Semantic Changes of Words?cited by 10
  10. 2024Graph-based Clustering for Detecting Semantic Change Across Time and Languagescited by 10
  11. 2023Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddingscited by 8
  12. 2022Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Changecited by 7
20 more
  1. 2024Analyzing Semantic Change through Lexical Replacementscited by 7
  2. 2023textitSwap and Predict -- Predicting the Semantic Changes in Words across Corpora by Context Swappingcited by 6
  3. 2024A Semantic Distance Metric Learning approach for Lexical Semantic Change Detectioncited by 5
  4. 2021Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detectioncited by 4
  5. 2022A Greek Parliament Proceedings Dataset for Computational Linguistics and Political Analysiscited by 4
  6. 2024Investigating the Contextualised Word Embedding Dimensions Specified for Contextual and Temporal Semantic Changescited by 4
  7. 2025SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detectioncited by 4
  8. 2021Monitoring geometrical properties of word embeddings for detecting the emergence of new topicscited by 3
  9. 2022Predicting Long-Term Citations from Short-Term Linguistic Influencecited by 3
  10. 2024To Word Senses and Beyond: Inducing Concepts with Contextualized Language Modelscited by 3
  11. 2024The LSCD Benchmark: a Testbed for Diachronic Word Meaning Taskscited by 2
  12. 2024Quantifying Lexical Semantic Shift via Unbalanced Optimal Transportcited by 2
  13. 2024Tracking Semantic Change in Slovene: A Novel Dataset and Optimal Transport-Based Distancecited by 1
  14. 2026Improving Interpretability of Lexical Semantic Change with Neurobiological Featurescited by 1
  15. 2021Representing ELMo embeddings as two-dimensional text onlinecited by 0
  16. 2021Text analysis and deep learning: A network approachcited by 0
  17. 2025Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Transfer in Sense-Aware Taskscited by 0
  18. 2025CALE : Concept-Aligned Embeddings for Both Within-Lemma and Inter-Lemma Sense Differentiationcited by 0
  19. 2026Rethinking Metrics for Lexical Semantic Change Detectioncited by 0
  20. 2026Accurate and Efficient Statistical Testing for Word Semantic Breadthcited by 0