Large Language Models on Lexical Semantic Change Detection: An Evaluation
Not on the map. Why?
Abstract (arXiv)
Lexical Semantic Change Detection stands out as one of the few areas where Large Language Models (LLMs) have not been extensively involved. Traditional methods like PPMI, and SGNS remain prevalent in research, alongside newer BERT-based approaches. Despite the comprehensive coverage of various natural language processing domains by LLMs, there is a notable scarcity of literature concerning their application in this specific realm. In this work, we seek to bridge this gap by introducing LLMs into the domain of Lexical Semantic Change Detection. Our work presents novel prompting solutions and a comprehensive evaluation that spans all three generations of language models, contributing to the exploration of LLMs in this research area.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 19 references that are in the map. First posted on arXiv 10 Dec 2023.
Builds on
13 of 19 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 307
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
- 2014Statistically Significant Detection of Linguistic Changecited by 82
- 2018Survey of Computational Approaches to Lexical Semantic Changecited by 60
- 2019A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domainscited by 31
- 2020Capturing Evolution in Word Usage: Just Add More Clusters?cited by 22
1 more
Built on by
Citing papers per year: 2024: 2.
2 papers.