Monitoring geometrical properties of word embeddings for detecting the emergence of new topics
Not on the map. Why?
Abstract (arXiv)
Slow emerging topic detection is a task between event detection, where we aggregate behaviors of different words on short period of time, and language evolution, where we monitor their long term evolution. In this work, we tackle the problem of early detection of slowly emerging new topics. To this end, we gather evidence of weak signals at the word level. We propose to monitor the behavior of words representation in an embedding space and use one of its geometrical properties to characterize the emergence of topics. As evaluation is typically hard for this kind of task, we present a framework for quantitative evaluation. We show positive results that outperform state-of-the-art methods on two public datasets of press and scientific articles.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 9 of its 35 references that are in the map. First posted on arXiv 5 Nov 2021.
Builds on
9 of 35 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2018Deep contextualized word representationscited by 2,285
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2014Statistically Significant Detection of Linguistic Changecited by 82
- 2014Temporal Analysis of Language through Neural Language Modelscited by 53
- 2019Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shiftcited by 37
- 2020UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detectioncited by 32
- 2015Measuring Word Significance using Distributed Representations of Wordscited by 21
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.