Presence or Absence: Are Unknown Word Usages in Dictionaries?
Not on the map. Why?
Abstract (arXiv)
There has been a surge of interest in computational modeling of semantic change. The foci of previous works are on detecting and interpreting word senses gained over time; however, it remains unclear whether the gained senses are covered by dictionaries. In this work, we aim to fill this research gap by comparing detected word senses with dictionary sense inventories in order to bridge between the communities of lexical semantic change detection and lexicography. We evaluate our system in the AXOLOTL-24 shared task for Finnish, Russian and German languages citefedorova-etal-2024-axolotl. Our system is fully unsupervised. It leverages a graph-based clustering approach to predict mappings between unknown word usages and dictionary entries for Subtask 1, and generates dictionary-like definitions for those novel word usages through the state-of-the-art Large Language Models such as GPT-4 and LLaMA-3 for Subtask 2. In Subtask 1, our system outperforms the baseline system by a large margin, and it offers interpretability for the mapping results by distinguishing between matched and unmatched (novel) word usages through our graph-based clustering approach. Our system ranks first in Finnish and German, and ranks second in Russian on the Subtask 2 test-phase leaderboard. These results show the potential of our system in managing dictionary entries, particularly for updating dictionaries to include novel sense entries. Our code and data are made publicly availablefootnoteurlhttps://github.com/xiaohemaikoo/axolotl24-ABDN-NLP.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 30 of its 52 references that are in the map. First posted on arXiv 2 Jun 2024.
Builds on
30 of 52 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2023GPT-4 Technical Reportcited by 18,132
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
- 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
- 2021Few-shot Learning with Multilingual Language Modelscited by 278
- 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 224
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2020SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detectioncited by 105
- 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
18 more
- 2016Cultural Shift or Linguistic Drift? Comparing Two Computational Measures of Semantic Changecited by 63
- 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
- 2014Temporal Analysis of Language through Neural Language Modelscited by 53
- 2022DiscoScore: Evaluating Text Generation with BERT and Discourse Coherencecited by 35
- 2020Capturing Evolution in Word Usage: Just Add More Clusters?cited by 22
- 2021Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corporacited by 21
- 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19
- 2022Semeval-2022 Task 1: CODWOE -- Comparing Dictionaries and Word Embeddingscited by 18
- 2024A Comprehensive Survey of Contamination Detection Methods in Large Language Modelscited by 12
- 2017On the Linearity of Semantic Change: Investigating Meaning Variation via Dynamic Graph Modelscited by 11
- 2022LSCDiscovery: A shared task on semantic change discovery and detection in Spanishcited by 11
- 2023LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillationcited by 11
- 2024Graph-based Clustering for Detecting Semantic Change Across Time and Languagescited by 10
- 2023The DURel Annotation Tool: Human and Computational Measurement of Semantic Proximity, Sense Clusters and Semantic Changecited by 7
- 2021Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detectioncited by 4
- 2024Detection of Non-recorded Word Senses in English and Swedishcited by 3
- 2024The LSCD Benchmark: a Testbed for Diachronic Word Meaning Taskscited by 2
- 2024Enriching Word Usage Graphs with Cluster Definitionscited by 1
Built on by
Citing papers per year: 2024: 3.
3 papers.