Time-Out: Temporal Referencing for Robust Modeling of Lexical Semantic Change
Not on the map. Why?
Abstract (arXiv)
State-of-the-art models of lexical semantic change detection suffer from noise stemming from vector space alignment. We have empirically tested the Temporal Referencing method for lexical semantic change and show that, by avoiding alignment, it is less affected by this noise. We show that, trained on a diachronic corpus, the skip-gram with negative sampling architecture with temporal referencing outperforms alignment models on a synthetic task as well as a manual testset. We introduce a principled way to simulate lexical semantic change and systematically control for possible biases.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 2; 2023: 9; 2024: 3; 2025: 2; 2026: 2.
33 papers.
Sort:
By area:
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
- 2021Time Masking for Temporal Language Modelscited by 46
- 2021Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Sensescited by 39
- 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 34
- 2023A Survey on Contextualised Semantic Shift Detectioncited by 22
- 2022Temporal Attention for Language Modelscited by 21
- 2021Challenges for Computational Lexical Semantic Changecited by 16
- 2023Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligencecited by 15
- 2021Conceptual similarity and communicative need shape colexification: an experimental studycited by 14
- 2021Statistically significant detection of semantic shifts using contextual word embeddingscited by 14
- 2021Lexical Semantic Change Discoverycited by 13
- 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoningcited by 11
21 more
- 2023Can Word Sense Distribution Detect Semantic Changes of Words?cited by 10
- 2023Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddingscited by 8
- 2021Abolitionist Networks: Modeling Language Change in Nineteenth-Century Activist Newspaperscited by 6
- 2023textitSwap and Predict -- Predicting the Semantic Changes in Words across Corpora by Context Swappingcited by 6
- 2024A Semantic Distance Metric Learning approach for Lexical Semantic Change Detectioncited by 5
- 2021Lexical semantic change for Ancient Greek and Latincited by 4
- 2021Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detectioncited by 4
- 2021From Plenipotentiary to Puddingless: Users and Uses of New Words in Early English Letterscited by 4
- 2021Semantic Journeys: Quantifying Change in Emoji Meaning from 2012-2018cited by 4
- 2025SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detectioncited by 4
- 2022Predicting Long-Term Citations from Short-Term Linguistic Influencecited by 3
- 2024Syntactic Language Change in English and German: Metrics, Parsers, and Convergencescited by 3
- 2024The LSCD Benchmark: a Testbed for Diachronic Word Meaning Taskscited by 3
- 2023Computational modeling of semantic changecited by 2
- 2025LSC-Eval: A General Framework to Evaluate Methods for Assessing Dimensions of Lexical Semantic Change Using LLM-Generated Synthetic Datacited by 2
- 2021SuperSim: a test set for word similarity and relatedness in Swedishcited by 1
- 2021Measuring diachronic sense change: new models and Monte Carlo methods for Bayesian inferencecited by 1
- 2023Contextualized Word Vector-based Methods for Discovering Semantic Differences with No Training nor Word Alignmentcited by 0
- 2023An Embedded Diachronic Sense Change Model with a Case Study from Ancient Greekcited by 0
- 2026Rethinking Metrics for Lexical Semantic Change Detectioncited by 0
- 2026The BD-LSC Dataset: Facilitating the Benchmarking of Models for Lexical Semantic Change Detection in Slang and Standard Usagecited by 0
- 2026The BD-LSC Dataset: Facilitating the Benchmarking of Models for Lexical Semantic Change Detection in Slang and Standard Usage15 Jun 2026
- 2026Rethinking Metrics for Lexical Semantic Change Detection17 Feb 2026
- 2025SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detection15 Sep 2025
- 2025LSC-Eval: A General Framework to Evaluate Methods for Assessing Dimensions of Lexical Semantic Change Using LLM-Generated Synthetic Data11 Mar 2025
- 2024The LSCD Benchmark: a Testbed for Diachronic Word Meaning Tasks29 Mar 2024
- 2024A Semantic Distance Metric Learning approach for Lexical Semantic Change Detection1 Mar 2024
- 2024Syntactic Language Change in English and German: Metrics, Parsers, and Convergences18 Feb 2024
- 2023An Embedded Diachronic Sense Change Model with a Case Study from Ancient Greek1 Nov 2023
- 2023Once Upon a textitTime in textitGraph: Relative-Time Pretraining for Complex Temporal Reasoning23 Oct 2023
- 2023Can Word Sense Distribution Detect Semantic Changes of Words?16 Oct 2023
- 2023textitSwap and Predict -- Predicting the Semantic Changes in Words across Corpora by Context Swapping16 Oct 2023
- 2023Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligence24 Sep 2023
21 more
- 2023Contextualized Word Vector-based Methods for Discovering Semantic Differences with No Training nor Word Alignment19 May 2023
- 2023Unsupervised Semantic Variation Prediction using the Distribution of Sibling Embeddings15 May 2023
- 2023Computational modeling of semantic change13 Apr 2023
- 2023A Survey on Contextualised Semantic Shift Detection4 Apr 2023
- 2022Predicting Long-Term Citations from Short-Term Linguistic Influence24 Oct 2022
- 2022Temporal Attention for Language Models4 Feb 2022
- 2021Time Masking for Temporal Language Models12 Oct 2021
- 2021Time-Aware Language Models as Temporal Knowledge Bases29 Jun 2021
- 2021Lexical Semantic Change Discovery6 Jun 2021
- 2021Semantic Journeys: Quantifying Change in Emoji Meaning from 2012-20183 May 2021
- 2021Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses29 Apr 2021
- 2021Measuring diachronic sense change: new models and Monte Carlo methods for Bayesian inference14 Apr 2021
- 2021SuperSim: a test set for word similarity and relatedness in Swedish12 Apr 2021
- 2021Statistically significant detection of semantic shifts using contextual word embeddings8 Apr 2021
- 2021Conceptual similarity and communicative need shape colexification: an experimental study19 Mar 2021
- 2021From Plenipotentiary to Puddingless: Users and Uses of New Words in Early English Letters17 Mar 2021
- 2021Abolitionist Networks: Modeling Language Change in Nineteenth-Century Activist Newspapers12 Mar 2021
- 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detection12 Mar 2021
- 2021Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detection22 Jan 2021
- 2021Lexical semantic change for Ancient Greek and Latin22 Jan 2021
- 2021Challenges for Computational Lexical Semantic Change19 Jan 2021
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
- 2021Time Masking for Temporal Language Modelscited by 46
- 2021Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Sensescited by 39
- 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 34
- 2023A Survey on Contextualised Semantic Shift Detectioncited by 22
- 2022Temporal Attention for Language Modelscited by 21
- 2021Challenges for Computational Lexical Semantic Changecited by 16
- 2023Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligencecited by 15
- 2021Conceptual similarity and communicative need shape colexification: an experimental studycited by 14
- 2021Statistically significant detection of semantic shifts using contextual word embeddingscited by 14
- 2021Lexical Semantic Change Discoverycited by 13
- 2023Can Word Sense Distribution Detect Semantic Changes of Words?cited by 10
12 most cited of 32 All 32 (JSON)
- 2026The BD-LSC Dataset: Facilitating the Benchmarking of Models for Lexical Semantic Change Detection in Slang and Standard Usage15 Jun 2026
- 2026Rethinking Metrics for Lexical Semantic Change Detection17 Feb 2026
- 2025SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detection15 Sep 2025
- 2025LSC-Eval: A General Framework to Evaluate Methods for Assessing Dimensions of Lexical Semantic Change Using LLM-Generated Synthetic Data11 Mar 2025
- 2024The LSCD Benchmark: a Testbed for Diachronic Word Meaning Tasks29 Mar 2024
- 2024A Semantic Distance Metric Learning approach for Lexical Semantic Change Detection1 Mar 2024
- 2024Syntactic Language Change in English and German: Metrics, Parsers, and Convergences18 Feb 2024
- 2023An Embedded Diachronic Sense Change Model with a Case Study from Ancient Greek1 Nov 2023
- 2023Can Word Sense Distribution Detect Semantic Changes of Words?16 Oct 2023
- 2023textitSwap and Predict -- Predicting the Semantic Changes in Words across Corpora by Context Swapping16 Oct 2023
- 2023Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligence24 Sep 2023
- 2023Contextualized Word Vector-based Methods for Discovering Semantic Differences with No Training nor Word Alignment19 May 2023
12 newest of 32 All 32 (JSON)