Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slang
Not on the map. Why?
Abstract (arXiv)
Languages are continuously undergoing changes, and the mechanisms that underlie these changes are still a matter of debate. In this work, we approach language evolution through the lens of causality in order to model not only how various distributional factors associate with language change, but how they causally affect it. In particular, we study slang, which is an informal language that is typically restricted to a specific group or social setting. We analyze the semantic change and frequency shift of slang words and compare them to those of standard, nonslang words. With causal discovery and causal inference techniques, we measure the effect that word type (slang/nonslang) has on both semantic change and frequency shift, as well as its relationship to frequency, polysemy and part of speech. Our analysis provides some new insights in the study of language change, e.g., we show that slang words undergo less semantic change but tend to have larger frequency shifts over time.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 24 of its 86 references that are in the map. First posted on arXiv 9 Mar 2022.
Builds on
24 of 86 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2018Deep contextualized word representationscited by 2,285
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 105
- 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
- 2014Statistically Significant Detection of Linguistic Changecited by 82
- 2014Temporal Analysis of Language through Neural Language Modelscited by 53
- 2021Explaining and Improving BERT Performance on Lexical Semantic Change Detectioncited by 33
12 more
- 2020UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detectioncited by 32
- 2019A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domainscited by 31
- 2020Capturing Evolution in Word Usage: Just Add More Clusters?cited by 22
- 2017Learning to Explain Non-Standard English Words and Phrasescited by 21
- 2021Frequency-based Distortions in Contextualized Word Embeddingscited by 19
- 2017On the Linearity of Semantic Change: Investigating Meaning Variation via Dynamic Graph Modelscited by 11
- 2021A Computational Framework for Slang Generationcited by 11
- 2021Grammatical Profiling for Semantic Change Detectioncited by 10
- 2018Simple Models for Word Formation in English Slangcited by 8
- 2019Polysemy and brevity versus frequency in languagecited by 8
- 2017Frequency patterns of semantic change: Corpus-based evidence of a near-critical dynamics in language changecited by 5
- 2020IMS at SemEval-2020 Task 1: How low can you go? Dimensionality in Lexical Semantic Change Detectioncited by 5
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 4; 2025: 3; 2026: 2.
14 papers.
Sort:
By area:
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 24
- 2023A Survey on Contextualised Semantic Shift Detectioncited by 21
- 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Modelscited by 7
- 2024Toward Informal Language Processing: Knowledge of Slang in Large Language Modelscited by 6
- 2024The Lou Dataset -- Exploring the Impact of Gender-Fair Language in German Text Classificationcited by 5
- 2025Understanding Gen Alpha Digital Language: Evaluation of LLM Safety Systems for Content Moderationcited by 4
- 2022Tracing Semantic Variation in Slangcited by 3
- 2025SlangDIT: Benchmarking LLMs in Interpretative Slang Translationcited by 3
- 2022ImmunoLingo: Linguistics-based formalization of the antibody languagecited by 2
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusioncited by 2
- 2022A Study of Slang Representation Methodscited by 1
- 2026Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?16 Sep 2026
- 2026Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala8 Sep 2026
- 2025SlangDIT: Benchmarking LLMs in Interpretative Slang Translation20 May 2025
- 2025Understanding Gen Alpha Digital Language: Evaluation of LLM Safety Systems for Content Moderation14 May 2025
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusion8 Feb 2025
- 2024The Lou Dataset -- Exploring the Impact of Gender-Fair Language in German Text Classification26 Sep 2024
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMs27 Jul 2024
- 2024Toward Informal Language Processing: Knowledge of Slang in Large Language Models2 Apr 2024
- 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Change19 Feb 2024
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models21 May 2023
- 2023A Survey on Contextualised Semantic Shift Detection4 Apr 2023
- 2022A Study of Slang Representation Methods11 Dec 2022
2 more
- 2022Tracing Semantic Variation in Slang16 Oct 2022
- 2022ImmunoLingo: Linguistics-based formalization of the antibody language26 Sep 2022
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 24
- 2023A Survey on Contextualised Semantic Shift Detectioncited by 21
- 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Modelscited by 7
- 2024Toward Informal Language Processing: Knowledge of Slang in Large Language Modelscited by 6
- 2024The Lou Dataset -- Exploring the Impact of Gender-Fair Language in German Text Classificationcited by 5
- 2022Tracing Semantic Variation in Slangcited by 3
- 2025SlangDIT: Benchmarking LLMs in Interpretative Slang Translationcited by 3
- 2022ImmunoLingo: Linguistics-based formalization of the antibody languagecited by 2
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusioncited by 2
- 2022A Study of Slang Representation Methodscited by 1
- 2026Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhalacited by 0
12 most cited of 13 All 13 (JSON)
- 2026Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?16 Sep 2026
- 2026Dynamics of Meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala8 Sep 2026
- 2025SlangDIT: Benchmarking LLMs in Interpretative Slang Translation20 May 2025
- 2025Rethinking Word Similarity: Semantic Similarity through Classification Confusion8 Feb 2025
- 2024The Lou Dataset -- Exploring the Impact of Gender-Fair Language in German Text Classification26 Sep 2024
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMs27 Jul 2024
- 2024Toward Informal Language Processing: Knowledge of Slang in Large Language Models2 Apr 2024
- 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Change19 Feb 2024
- 2023Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models21 May 2023
- 2023A Survey on Contextualised Semantic Shift Detection4 Apr 2023
- 2022A Study of Slang Representation Methods11 Dec 2022
- 2022Tracing Semantic Variation in Slang16 Oct 2022
12 newest of 13 All 13 (JSON)