Explaining novel senses using definition generation with open language models
Not on the map. Why?
Abstract (arXiv)
We apply definition generators based on open-weights large language models to the task of creating explanations of novel senses, taking target word usages as an input. To this end, we employ the datasets from the AXOLOTL'24 shared task on explainable semantic change modeling, which features Finnish, Russian and German languages. We fine-tune and provide publicly the open-source models performing higher than the best submissions of the aforementioned shared task, which employed closed proprietary LLMs. In addition, we find that encoder-decoder definition generators perform on par with their decoder-only counterparts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
12 of 25 references.
References · 12
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
- 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 206
- 2019GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledgecited by 79
- 2016Definition Modeling: Learning to define word embeddings in natural languagecited by 46
- 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19
- 2024Definition generation for lexical semantic change detectioncited by 7
- 2023"Definition Modeling: To model definitions." Generating Definitions With Little to No Semanticscited by 4
Built on by
Not cited yet.