mlsanityData to 7 Oct 2026

Lexical Semantic Change Discovery

arXiv 2106.03111 ↗First posted 6 Jun 2021cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

While there is a large amount of research in the field of Lexical Semantic Change Detection, only few approaches go beyond a standard benchmark evaluation of existing models. In this paper, we propose a shift of focus from change detection to change discovery, i.e., discovering novel word senses over time from the full corpus vocabulary. By heavily fine-tuning a type-based and a token-based approach on recently published German data, we demonstrate that both models can successfully be applied to discover new words undergoing meaning change. Furthermore, we provide an almost fully automated framework for both evaluation and discovery.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 27 of its 73 references that are in the map. First posted on arXiv 6 Jun 2021.

Builds on

27 of 73 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
  5. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
  6. 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 105
  7. 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
  8. 2018Diachronic word embeddings and semantic shifts: a surveycited by 90
  9. 2014Statistically Significant Detection of Linguistic Changecited by 82
  10. 2014Temporal Analysis of Language through Neural Language Modelscited by 53
  11. 2018Diachronic Usage Relatedness (DURel): A Framework for the Annotation of Lexical Semantic Changecited by 35
  12. 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 33
15 more
  1. 2019Time-Out: Temporal Referencing for Robust Modeling of Lexical Semantic Changecited by 32
  2. 2020UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detectioncited by 32
  3. 2019A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domainscited by 31
  4. 2021DWUG: A large Resource of Diachronic Word Usage Graphs in Four Languagescited by 25
  5. 2020Capturing Evolution in Word Usage: Just Add More Clusters?cited by 22
  6. 2020RuSemShift: a dataset of historical lexical semantic change in Russiancited by 16
  7. 2021Challenges for Computational Lexical Semantic Changecited by 15
  8. 2019GASC: Genre-Aware Semantic Change for Ancient Greekcited by 10
  9. 2020CIRCE at SemEval-2020 Task 1: Ensembling Context-Free and Context-Dependent Word Representationscited by 9
  10. 2020Simulating Lexical Semantic Change from Sense-Annotated Datacited by 6
  11. 2020IMS at SemEval-2020 Task 1: How low can you go? Dimensionality in Lexical Semantic Change Detectioncited by 5
  12. 2020OP-IMS @ DIACR-Ita: Back to the Roots: SGNS+OP+CD still rocks Semantic Change Detectioncited by 5
  13. 2020CL-IMS @ DIACR-Ita: Volente o Nolente: BERT does not outperform SGNS on Semantic Change Detectioncited by 4
  14. 2021Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detectioncited by 4
  15. 2020UWB @ DIACR-Ita: Lexical Semantic Change Detection with CCA and Orthogonal Transformationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 2; 2024: 4; 2025: 3; 2026: 2.

13 papers.

Sort: