mlsanityData to 14 Oct 2026

Identifying Emerging Concepts in Large Corpora

arXiv 2502.21315 ↗First posted 28 Feb 2025cs.CL cs.CYcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce a new method to identify emerging concepts in large text corpora. By analyzing changes in the heatmaps of the underlying embedding space, we are able to detect these concepts with high accuracy shortly after they originate, in turn outperforming common alternatives. We further demonstrate the utility of our approach by analyzing speeches in the U.S. Senate from 1941 to 2015. Our results suggest that the minority party is more active in introducing new concepts into the Senate discourse. We also identify specific concepts that closely correlate with the Senators' racial, ethnic, and gender identities. An implementation of our method is publicly available.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 43 references that are in the map. First posted on arXiv 28 Feb 2025.

Builds on

16 of 43 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  4. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  5. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
  6. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 221
  7. 2020Top2Vec: Distributed Representations of Topicscited by 126
  8. 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
  9. 2014Statistically Significant Detection of Linguistic Changecited by 82
  10. 2020Tired of Topic Models? Clusters of Pretrained Word Embeddings Make for Fast and Good Topics too!cited by 73
  11. 2019Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shiftcited by 37
  12. 2018Short-Term Meaning Shift: A Distributional Explorationcited by 23
4 more
  1. 2023A Survey on Contextualised Semantic Shift Detectioncited by 22
  2. 2019The Diversity-Innovation Paradox in Sciencecited by 21
  3. 2018Making "fetch" happen: The influence of social and linguistic context on nonstandard word growth and declinecited by 15
  4. 2023Specious Sites: Tracking the Spread and Sway of Spurious News Stories at Scalecited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026HistLens: Mapping Idea Change across Concepts and Corporacited by 1