mlsanityData to 7 Oct 2026

From sunblock to softblock: Analyzing the correlates of neology in published writing and on social media

arXiv 2602.13123 ↗First posted 13 Feb 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Living languages are shaped by a host of conflicting internal and external evolutionary pressures. While some of these pressures are universal across languages and cultures, others differ depending on the social and conversational context: language use in newspapers is subject to very different constraints than language use on social media. Prior distributional semantic work on English word emergence (neology) identified two factors correlated with creation of new words by analyzing a corpus consisting primarily of historical published texts (Ryskina et al., 2020, arXiv:2001.07740). Extending this methodology to contextual embeddings in addition to static ones and applying it to a new corpus of Twitter posts, we show that the same findings hold for both domains, though the topic popularity growth factor may contribute less to neology on Twitter than in published writing. We hypothesize that this difference can be explained by the two domains favouring different neologism formation mechanisms.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 84 references that are in the map. First posted on arXiv 13 Feb 2026.

Builds on

27 of 84 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
  5. 2021All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Qualitycited by 150
  6. 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
  7. 2018Diachronic word embeddings and semantic shifts: a surveycited by 90
  8. 2014Statistically Significant Detection of Linguistic Changecited by 82
  9. 2018Survey of Computational Approaches to Lexical Semantic Changecited by 60
  10. 2023A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologiescited by 59
  11. 2019Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shiftcited by 37
  12. 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
15 more
  1. 2024NEO-BENCH: Evaluating Robustness of Large Language Models with Neologismscited by 19
  2. 2020Where New Words Are Born: Distributional Semantic Analysis of Neologisms and Their Semantic Neighborhoodscited by 17
  3. 2018Making "fetch" happen: The influence of social and linguistic context on nonstandard word growth and declinecited by 15
  4. 2021Conceptual similarity and communicative need shape colexification: an experimental studycited by 14
  5. 2020Will it Unblend?cited by 11
  6. 2018Simple Models for Word Formation in English Slangcited by 8
  7. 2021Quantifying Cognitive Factors in Lexical Declinecited by 8
  8. 2024Silent Signals, Loud Impact: LLMs for Word-Sense Disambiguation of Coded Dog Whistlescited by 7
  9. 2018Quantifying the dynamics of topical fluctuations in languagecited by 6
  10. 2024Making FETCH! Happen: Finding Emergent Dog Whistles Through Common Habitatscited by 6
  11. 2024Verbing Weirds Language (Models): Evaluation of English Zero-Derivation in Five LLMscited by 5
  12. 2019Semantic Change and Semantic Stability: Variation is Keycited by 4
  13. 2020Phonetic and Visual Priors for Decipherment of Informal Romanizationcited by 4
  14. 2019Semantic Change and Emerging Tropes In a Large Corpus of New High German Poetrycited by 3
  15. 2016Tracing metaphors in time through self-distance in vector spacescited by 2

Built on by

Not cited yet.