SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection
Not on the map. Why?
Abstract (arXiv)
Lexical Semantic Change detection, i.e., the task of identifying words that change meaning over time, is a very active research area, with applications in NLP, lexicography, and linguistics. Evaluation is currently the most pressing problem in Lexical Semantic Change detection, as no gold standards are available to the community, which hinders progress. We present the results of the first shared task that addresses this gap by providing researchers with an evaluation framework and manually annotated, high-quality datasets for English, German, Latin, and Swedish. 33 teams submitted 186 systems, which were evaluated on two subtasks.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 13; 2023: 14; 2024: 29; 2025: 12; 2026: 19.
105 papers.
Sort:
By area:
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2021Time Masking for Temporal Language Modelscited by 46
- 2021Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Sensescited by 39
- 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 33
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 26
- 2021DWUG: A large Resource of Diachronic Word Usage Graphs in Four Languagescited by 25
- 2022Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semanticscited by 24
- 2022Temporal Attention for Language Modelscited by 21
- 2023A Survey on Contextualised Semantic Shift Detectioncited by 21
- 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
- 2022Contextualized language models for semantic change detection: lessons learnedcited by 20
- 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19
38 more
- 2022BiTimeBERT: Extending Pre-Trained Language Representations with Bi-Temporal Informationcited by 17
- 2021Challenges for Computational Lexical Semantic Changecited by 15
- 2021Statistically significant detection of semantic shifts using contextual word embeddingscited by 14
- 2022Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slangcited by 14
- 2021Lexical Semantic Change Discoverycited by 13
- 2023Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligencecited by 13
- 2024Time Awareness in Large Language Models: Benchmarking Fact Recall Across Timecited by 12
- 2021Three-part diachronic semantic change dataset for Russiancited by 11
- 2022HistBERT: A Pre-trained Language Model for Diachronic Lexical Semantic Analysiscited by 11
- 2022LSCDiscovery: A shared task on semantic change discovery and detection in Spanishcited by 11
- 2024Robustness of Large Language Models to Perturbations in Textcited by 11
- 2021Grammatical Profiling for Semantic Change Detectioncited by 10
- 2023Can Word Sense Distribution Detect Semantic Changes of Words?cited by 10
- 2024Graph-based Clustering for Detecting Semantic Change Across Time and Languagescited by 10
- 2023Substitution-based Semantic Change Detection using Contextual Embeddingscited by 9
- 2023Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddingscited by 8
- 2022NorDiaChange: Diachronic Semantic Change Dataset for Norwegiancited by 7
- 2022Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Changecited by 7
- 2022RuDSI: graph-based word sense induction dataset for Russiancited by 7
- 2023The DURel Annotation Tool: Human and Computational Measurement of Semantic Proximity, Sense Clusters and Semantic Changecited by 7
- 2024(Chat)GPT v BERT: Dawn of Justice for Semantic Change Detectioncited by 7
- 2024Analyzing Semantic Change through Lexical Replacementscited by 7
- 2024Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Typescited by 7
- 2024Definition generation for lexical semantic change detectioncited by 7
- 2023Evolving linguistic divergence on polarizing social mediacited by 6
- 2023textitSwap and Predict -- Predicting the Semantic Changes in Words across Corpora by Context Swappingcited by 6
- 2024Towards Automating Text Annotation: A Case Study on Semantic Proximity Annotation using GPT-4cited by 6
- 2024Survey in Characterizing Semantic Changecited by 5
- 2024A Semantic Distance Metric Learning approach for Lexical Semantic Change Detectioncited by 5
- 2024Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Modelscited by 5
- 2021Lexical semantic change for Ancient Greek and Latincited by 4
- 2021Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detectioncited by 4
- 2021Semantic Journeys: Quantifying Change in Emoji Meaning from 2012-2018cited by 4
- 2021On the Universality of Deep Contextual Language Modelscited by 4
- 2024Investigating the Contextualised Word Embedding Dimensions Specified for Contextual and Temporal Semantic Changescited by 4
- 2024Semantic Change Characterization with LLMs using Rhetoricscited by 4
- 2025Pretraining Language Models for Diachronic Linguistic Change Discoverycited by 4
- 2025SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detectioncited by 4
50 most cited of 105 All 105 (JSON)
- 2026Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?16 Sep 2026
- 2026Tracing individual knowledge trajectories in a changing field: the case of general relativity and gravitation16 Sep 2026
- 2026Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala8 Sep 2026
- 2026Inspicio: Open-Vocabulary, LLM-Based Sense Retrieval for Historical Languages1 Sep 2026
- 2026SynFlow: A Multidimensional Diachronic Semantic Analysis Toolkit19 Aug 2026
- 2026A Computational Approach to Measuring Semantic Change in Sanskrit Literature31 Jul 2026
- 2026AI-Associated Lexical Shifts Across 34 Languages: Cross-Lingual Convergence and Diachronic Uptake in News Writing25 May 2026
- 2026Scene Abstraction for Lexical Semantics: Structured Representations of Situated Meaning21 May 2026
- 2026Evaluating the Evaluator: Problems with SemEval-2020 Task 1 for Lexical Semantic Change Detection14 Apr 2026
- 2026In the LLM era, Word Sense Induction remains unsolved12 Mar 2026
- 2026Temporal Text Classification with Large Language Models11 Mar 2026
- 2026Semantic Substrate Dynamics Theory: An Operator-Theoretic Framework for Geometric Semantic Drift21 Feb 2026
38 more
- 2026Rethinking Metrics for Lexical Semantic Change Detection17 Feb 2026
- 2026How Do Lexical Senses Correspond Between Spoken German and German Sign Language?14 Feb 2026
- 2026DHPLT: large-scale multilingual diachronic corpora and word representations for semantic change modelling12 Feb 2026
- 2026Improving Interpretability of Lexical Semantic Change with Neurobiological Features10 Feb 2026
- 2026ReFRAME or Remain: Unsupervised Lexical Semantic Change Detection with Frame Semantics4 Feb 2026
- 2026Word-Centered Semantic Graphs for Interpretable Diachronic Sense Tracking29 Jan 2026
- 2026Transparent Semantic Change Detection with Dependency-Based Profiles6 Jan 2026
- 2025AETAS: Analysis of Evolving Temporal Affect and Semantics for Legal History20 Dec 2025
- 2025Tracking Temporal Dynamics of Vector Sets with Gaussian Process17 Dec 2025
- 2025Hybrid Retrieval-Augmented Generation for Robust Multilingual Document Question Answering14 Dec 2025
- 2025Start Making Sense(s): A Developmental Probe of Attention Specialization Using Lexical Ambiguity26 Nov 2025
- 2025Contextual morphologically-guided tokenization for Latin encoder models12 Nov 2025
- 2025What is a protest anyway? Codebook conceptualization is still a first-order concern in LLM-era classification3 Oct 2025
- 2025SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detection15 Sep 2025
- 2025CALE : Concept-Aligned Embeddings for Both Within-Lemma and Inter-Lemma Sense Differentiation6 Aug 2025
- 2025Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Transfer in Sense-Aware Tasks30 May 2025
- 2025Pretraining Language Models for Diachronic Linguistic Change Discovery7 Apr 2025
- 2025LSC-Eval: A General Framework to Evaluate Methods for Assessing Dimensions of Lexical Semantic Change Using LLM-Generated Synthetic Data11 Mar 2025
- 2025Analyzing Continuous Semantic Shifts with Diachronic Word Similarity Matrices16 Jan 2025
- 2024Quantifying Lexical Semantic Shift via Unbalanced Optimal Transport17 Dec 2024
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research30 Nov 2024
- 2024Comparative Analysis of Static and Contextual Embeddings for Analyzing Semantic Changes in Medieval Latin Charters11 Oct 2024
- 2024Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective7 Oct 2024
- 2024Time Awareness in Large Language Models: Benchmarking Fact Recall Across Time20 Sep 2024
- 2024Deep-change at AXOLOTL-24: Orchestrating WSD and WSI Models for Semantic Change Modeling9 Aug 2024
- 2024Semantic Change Characterization with LLMs using Rhetorics23 Jul 2024
- 2024Robustness of Large Language Models to Perturbations in Text12 Jul 2024
- 2024Exploring Sound Change Over Time: A Review of Computational and Human Perception6 Jul 2024
- 2024Towards Automating Text Annotation: A Case Study on Semantic Proximity Annotation using GPT-44 Jul 2024
- 2024AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modeling4 Jul 2024
- 2024Investigating the Contextualised Word Embedding Dimensions Specified for Contextual and Temporal Semantic Changes3 Jul 2024
- 2024CHEW: A Dataset of CHanging Events in Wikipedia27 Jun 2024
- 2024Definition generation for lexical semantic change detection20 Jun 2024
- 2024Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Types5 Jun 2024
- 2024Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models4 Jun 2024
- 2024Presence or Absence: Are Unknown Word Usages in Dictionaries?2 Jun 2024
- 2024LGDE: Local Graph-based Dictionary Expansion13 May 2024
- 2024Analyzing Semantic Change through Lexical Replacements29 Apr 2024
50 newest of 105 All 105 (JSON)
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2021Time Masking for Temporal Language Modelscited by 46
- 2021Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Sensescited by 39
- 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 33
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 26
- 2021DWUG: A large Resource of Diachronic Word Usage Graphs in Four Languagescited by 25
- 2022Gender Bias in Word Embeddings: A Comprehensive Analysis of Frequency, Syntax, and Semanticscited by 24
- 2022Temporal Attention for Language Modelscited by 21
- 2023A Survey on Contextualised Semantic Shift Detectioncited by 21
- 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
- 2022Contextualized language models for semantic change detection: lessons learnedcited by 20
- 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19
12 most cited of 103 All 103 (JSON)
- 2026Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?16 Sep 2026
- 2026Tracing individual knowledge trajectories in a changing field: the case of general relativity and gravitation16 Sep 2026
- 2026Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala8 Sep 2026
- 2026Inspicio: Open-Vocabulary, LLM-Based Sense Retrieval for Historical Languages1 Sep 2026
- 2026SynFlow: A Multidimensional Diachronic Semantic Analysis Toolkit19 Aug 2026
- 2026A Computational Approach to Measuring Semantic Change in Sanskrit Literature31 Jul 2026
- 2026AI-Associated Lexical Shifts Across 34 Languages: Cross-Lingual Convergence and Diachronic Uptake in News Writing25 May 2026
- 2026Scene Abstraction for Lexical Semantics: Structured Representations of Situated Meaning21 May 2026
- 2026Evaluating the Evaluator: Problems with SemEval-2020 Task 1 for Lexical Semantic Change Detection14 Apr 2026
- 2026In the LLM era, Word Sense Induction remains unsolved12 Mar 2026
- 2026Temporal Text Classification with Large Language Models11 Mar 2026
- 2026Semantic Substrate Dynamics Theory: An Operator-Theoretic Framework for Geometric Semantic Drift21 Feb 2026
12 newest of 103 All 103 (JSON)