Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Change
Not on the map. Why?
Abstract (arXiv)
Words shift in meaning for many reasons, including cultural factors like new technologies and regular linguistic processes like subjectification. Understanding the evolution of language and culture requires disentangling these underlying causes. Here we show how two different distributional measures can be used to detect two different types of semantic change. The first measure, which has been used in many previous works, analyzes global shifts in a word's distributional semantics, it is sensitive to changes due to regular processes of linguistic drift, such as the semantic generalization of promise ("I promise." -> "It promised to be exciting."). The second measure, which we develop here, focuses on local changes to a word's nearest semantic neighbors; it is more sensitive to cultural shifts, such as the change in the meaning of cell ("prison cell" -> "cell phone"). Comparing measurements made by these two methods allows researchers to determine whether changes are more cultural or linguistic in nature, a distinction that is essential for work in the digital humanities and historical linguistics.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 8; 2023: 12; 2024: 14; 2025: 4; 2026: 8.
63 papers.
Sort:
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 128
- 2021Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Mediacited by 51
- 2021Self-Supervised Test-Time Learning for Reading Comprehensioncited by 22
- 2021Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corporacited by 21
- 2022Contextualized language models for semantic change detection: lessons learnedcited by 20
- 2024ReSi: A Comprehensive Benchmark for Representational Similarity Measurescited by 18
- 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
- 2021Challenges for Computational Lexical Semantic Changecited by 15
- 2023One Wide Feedforward is All You Needcited by 15
- 2021Statistically significant detection of semantic shifts using contextual word embeddingscited by 14
- 2022Discovering Differences in the Representation of People using Contextualized Semantic Axescited by 12
38 more
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Researchcited by 12
- 2021Three-part diachronic semantic change dataset for Russiancited by 11
- 2022LSCDiscovery: A shared task on semantic change discovery and detection in Spanishcited by 11
- 2024Robustness of Large Language Models to Perturbations in Textcited by 11
- 2024Graph-based Clustering for Detecting Semantic Change Across Time and Languagescited by 10
- 2023Substitution-based Semantic Change Detection using Contextual Embeddingscited by 9
- 2021Mitigating Temporal-Drift: A Simple Approach to Keep NER Models Crispcited by 7
- 2022NorDiaChange: Diachronic Semantic Change Dataset for Norwegiancited by 7
- 2024Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Typescited by 7
- 2021Abolitionist Networks: Modeling Language Change in Nineteenth-Century Activist Newspaperscited by 6
- 2023Robust language-based mental health assessments in time and space through social mediacited by 5
- 2021Semantic Journeys: Quantifying Change in Emoji Meaning from 2012-2018cited by 4
- 2021Capturing Stance Dynamics in Social Media: Open Challenges and Research Directionscited by 4
- 2022A Greek Parliament Proceedings Dataset for Computational Linguistics and Political Analysiscited by 4
- 2022Letters From the Past: Modeling Historical Sound Change Through Diachronic Character Embeddingscited by 3
- 2024Presence or Absence: Are Unknown Word Usages in Dictionaries?cited by 3
- 2024A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applicationscited by 3
- 2021A Longitudinal Multi-modal Dataset for Dementia Monitoring and Diagnosiscited by 2
- 2022SexWEs: Domain-Aware Word Embeddings via Cross-lingual Semantic Specialisation for Chinese Sexism Detection in Social Mediacited by 2
- 2023Same Words, Different Meanings: Semantic Polarization in Broadcast Media Language Forecasts Polarization on Social Media Discoursecited by 2
- 2023Investigating the Effects of Fairness Interventions Using Pointwise Representational Similaritycited by 2
- 2023Geometric instability of graph neural networks on large graphscited by 2
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusioncited by 2
- 2025SiDiaC: Sinhala Diachronic Corpuscited by 2
- 2021Fake it Till You Make it: Self-Supervised Semantic Shifts for Monolingual Word Embedding Taskscited by 1
- 2022TransDrift: Modeling Word-Embedding Drift using Transformercited by 1
- 2023Semantic Change Detection for the Romanian Languagecited by 1
- 2024Tracking Semantic Change in Slovene: A Novel Dataset and Optimal Transport-Based Distancecited by 1
- 2024A Systematic Survey of Natural Language Processing for the Greek Languagecited by 1
- 2024Historical Ink: Semantic Shift Detection for 19th Century Spanishcited by 1
- 2024Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspectivecited by 1
- 2021Bridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis managementcited by 0
- 2021DUKweb: Diachronic word representations from the UK Web Archive corpuscited by 0
- 2021How to Do Things without Words: Modeling Semantic Drift of Emojicited by 0
- 2021Diachronic Text Mining Investigation of Therapeutic Candidates for COVID-19cited by 0
- 2021On the Impact of Temporal Representations on Metaphor Detectioncited by 0
- 2023WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Datasetcited by 0
- 2024Revealing COVID-19's Social Dynamics: Diachronic Semantic Analysis of Vaccine and Symptom Discourse on Twittercited by 0
50 most cited of 63 All 63 (JSON)
- 2026Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala8 Sep 2026
- 2026ChronoLens: Measuring Language Change Across Time, Languages, and Linguistic Levels4 Aug 2026
- 2026A Computational Approach to Measuring Semantic Change in Sanskrit Literature31 Jul 2026
- 2026Do It Right! A Methodology for Successful NLP System Development6 Jul 2026
- 2026From Layers to Networks: Comparing Neural Representations via Diffusion Geometry15 May 2026
- 2026The Impact of Dimensionality on the Stability of Node Embeddings9 Apr 2026
- 2026Modeling Changing Scientific Concepts with Complex Networks: A Case Study on the Chemical Revolution18 Mar 2026
- 2026Rethinking Metrics for Lexical Semantic Change Detection17 Feb 2026
- 2025SiDiaC: Sinhala Diachronic Corpus22 Sep 2025
- 2025Characterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings16 Jun 2025
- 2025The cell as a token: high-dimensional geometry in language models and cell embeddings26 Mar 2025
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusion8 Feb 2025
38 more
- 2024From communities to interpretable network and word embedding: an unified approach11 Dec 2024
- 2024Words and Action: Modeling Linguistic Leadership in #BlackLivesMatter Communities3 Dec 2024
- 2024Normalized Space Alignment: A Versatile Metric for Representation Analysis7 Nov 2024
- 2024Revealing COVID-19's Social Dynamics: Diachronic Semantic Analysis of Vaccine and Symptom Discourse on Twitter10 Oct 2024
- 2024Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective7 Oct 2024
- 2024ReSi: A Comprehensive Benchmark for Representational Similarity Measures1 Aug 2024
- 2024A Systematic Survey of Natural Language Processing for the Greek Language13 Jul 2024
- 2024Robustness of Large Language Models to Perturbations in Text12 Jul 2024
- 2024Historical Ink: Semantic Shift Detection for 19th Century Spanish8 Jul 2024
- 2024A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications10 Jun 2024
- 2024Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Types5 Jun 2024
- 2024Presence or Absence: Are Unknown Word Usages in Dictionaries?2 Jun 2024
- 2024Tracking Semantic Change in Slovene: A Novel Dataset and Optimal Transport-Based Distance26 Feb 2024
- 2024Graph-based Clustering for Detecting Semantic Change Across Time and Languages1 Feb 2024
- 2023Substitution-based Semantic Change Detection using Contextual Embeddings5 Sep 2023
- 2023One Wide Feedforward is All You Need4 Sep 2023
- 2023Semantic Change Detection for the Romanian Language23 Aug 2023
- 2023Geometric instability of graph neural networks on large graphs19 Aug 2023
- 2023WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Dataset7 Aug 2023
- 2023Towards More Human-like AI Communication: A Review of Emergent Communication Research1 Aug 2023
- 2023Investigating the Effects of Fairness Interventions Using Pointwise Representational Similarity30 May 2023
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measures10 May 2023
- 2023Can Large Language Models Transform Computational Social Science?12 Apr 2023
- 2023Robust language-based mental health assessments in time and space through social media25 Feb 2023
- 2023Fairness in Language Models Beyond English: Gaps and Challenges24 Feb 2023
- 2023Same Words, Different Meanings: Semantic Polarization in Broadcast Media Language Forecasts Polarization on Social Media Discourse20 Jan 2023
- 2022SexWEs: Domain-Aware Word Embeddings via Cross-lingual Semantic Specialisation for Chinese Sexism Detection in Social Media15 Nov 2022
- 2022A Greek Parliament Proceedings Dataset for Computational Linguistics and Political Analysis23 Oct 2022
- 2022Discovering Differences in the Representation of People using Contextualized Semantic Axes21 Oct 2022
- 2022Contextualized language models for semantic change detection: lessons learned31 Aug 2022
- 2022TransDrift: Modeling Word-Embedding Drift using Transformer16 Jun 2022
- 2022Letters From the Past: Modeling Historical Sound Change Through Diachronic Character Embeddings17 May 2022
- 2022LSCDiscovery: A shared task on semantic change discovery and detection in Spanish13 May 2022
- 2022NorDiaChange: Diachronic Semantic Change Dataset for Norwegian13 Jan 2022
- 2021Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora28 Dec 2021
- 2021On the Impact of Temporal Representations on Metaphor Detection5 Nov 2021
- 2021Diachronic Text Mining Investigation of Therapeutic Candidates for COVID-1926 Oct 2021
- 2021How to Do Things without Words: Modeling Semantic Drift of Emoji8 Oct 2021
50 newest of 63 All 63 (JSON)
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 128
- 2021Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Mediacited by 51
- 2021Self-Supervised Test-Time Learning for Reading Comprehensioncited by 22
- 2021Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corporacited by 21
- 2022Contextualized language models for semantic change detection: lessons learnedcited by 20
- 2024ReSi: A Comprehensive Benchmark for Representational Similarity Measurescited by 18
- 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
- 2021Challenges for Computational Lexical Semantic Changecited by 15
- 2023One Wide Feedforward is All You Needcited by 15
- 2021Statistically significant detection of semantic shifts using contextual word embeddingscited by 14
- 2022Discovering Differences in the Representation of People using Contextualized Semantic Axescited by 12
12 most cited of 63 All 63 (JSON)
- 2026Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala8 Sep 2026
- 2026ChronoLens: Measuring Language Change Across Time, Languages, and Linguistic Levels4 Aug 2026
- 2026A Computational Approach to Measuring Semantic Change in Sanskrit Literature31 Jul 2026
- 2026Do It Right! A Methodology for Successful NLP System Development6 Jul 2026
- 2026From Layers to Networks: Comparing Neural Representations via Diffusion Geometry15 May 2026
- 2026The Impact of Dimensionality on the Stability of Node Embeddings9 Apr 2026
- 2026Modeling Changing Scientific Concepts with Complex Networks: A Case Study on the Chemical Revolution18 Mar 2026
- 2026Rethinking Metrics for Lexical Semantic Change Detection17 Feb 2026
- 2025SiDiaC: Sinhala Diachronic Corpus22 Sep 2025
- 2025Characterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings16 Jun 2025
- 2025The cell as a token: high-dimensional geometry in language models and cell embeddings26 Mar 2025
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusion8 Feb 2025
12 newest of 63 All 63 (JSON)