mlsanityData to 7 Oct 2026

Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slang

arXiv 2203.04651 ↗First posted 9 Mar 2022cs.CLcited by 14

Not on the map. Why?

Abstract (arXiv)

Languages are continuously undergoing changes, and the mechanisms that underlie these changes are still a matter of debate. In this work, we approach language evolution through the lens of causality in order to model not only how various distributional factors associate with language change, but how they causally affect it. In particular, we study slang, which is an informal language that is typically restricted to a specific group or social setting. We analyze the semantic change and frequency shift of slang words and compare them to those of standard, nonslang words. With causal discovery and causal inference techniques, we measure the effect that word type (slang/nonslang) has on both semantic change and frequency shift, as well as its relationship to frequency, polysemy and part of speech. Our analysis provides some new insights in the study of language change, e.g., we show that slang words undergo less semantic change but tend to have larger frequency shifts over time.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 24 of its 86 references that are in the map. First posted on arXiv 9 Mar 2022.

Builds on

24 of 86 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  5. 2018Deep contextualized word representationscited by 2,285
  6. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
  7. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
  8. 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 105
  9. 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
  10. 2014Statistically Significant Detection of Linguistic Changecited by 82
  11. 2014Temporal Analysis of Language through Neural Language Modelscited by 53
  12. 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 33
12 more
  1. 2020UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detectioncited by 32
  2. 2019A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domainscited by 31
  3. 2020Capturing Evolution in Word Usage: Just Add More Clusters?cited by 22
  4. 2017Learning to Explain Non-Standard English Words and Phrasescited by 21
  5. 2021Frequency-based Distortions in Contextualized Word Embeddingscited by 19
  6. 2017On the Linearity of Semantic Change: Investigating Meaning Variation via Dynamic Graph Modelscited by 11
  7. 2021A Computational Framework for Slang Generationcited by 11
  8. 2021Grammatical Profiling for Semantic Change Detectioncited by 10
  9. 2018Simple Models for Word Formation in English Slangcited by 8
  10. 2019Polysemy and brevity versus frequency in languagecited by 8
  11. 2017Frequency patterns of semantic change: Corpus-based evidence of a near-critical dynamics in language changecited by 5
  12. 2020IMS at SemEval-2020 Task 1: How low can you go? Dimensionality in Lexical Semantic Change Detectioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 2; 2024: 4; 2025: 3; 2026: 2.

14 papers.

Sort:

By area: