mlsanityData to 14 Oct 2026

GEAR: A Simple GENERATE, EMBED, AVERAGE AND RANK Approach for Unsupervised Reverse Dictionary

arXiv 2412.06654 ↗First posted 9 Dec 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Reverse Dictionary (RD) is the task of obtaining the most relevant word or set of words given a textual description or dictionary definition. Effective RD methods have applications in accessibility, translation or writing support systems. Moreover, in NLP research we find RD to be used to benchmark text encoders at various granularities, as it often requires word, definition and sentence embeddings. In this paper, we propose a simple approach to RD that leverages LLMs in combination with embedding models. Despite its simplicity, this approach outperforms supervised baselines in well studied RD datasets, while also showing less over-fitting. We also conduct a number of experiments on different dictionaries and analyze how different styles, registers and target audiences impact the quality of RD systems. We conclude that, on average, untuned embeddings alone fare way below an LLM-only baseline (although they are competitive in highly technical dictionaries), but are crucial for boosting performance in combined methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 53 references that are in the map. First posted on arXiv 9 Dec 2024.

Builds on

22 of 53 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  7. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
  8. 2018WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representationscited by 372
  9. 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 333
  10. 2019GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledgecited by 79
  11. 2021Dict-BERT: Enhancing Language Model Pre-training with Dictionarycited by 38
  12. 2023Jina Embeddings: A Novel Set of High-Performance Sentence Embedding Modelscited by 35
10 more
  1. 2015Learning to Understand Phrases by Embedding the Dictionarycited by 33
  2. 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19
  3. 2019Multi-channel Reverse Dictionary Modelcited by 16
  4. 2018Mapping Text to Knowledge Graph Entities using Multi-Sense LSTMscited by 14
  5. 2024TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Taskscited by 14
  6. 2020BERT for Monolingual and Cross-Lingual Reverse Dictionarycited by 12
  7. 2024On the Tip of the Tongue: Analyzing Conceptual Representation in Large Language Models with Reverse-Dictionary Probecited by 6
  8. 2022A Unified Model for Reverse Dictionary and Definition Modellingcited by 5
  9. 2022WordAlchemy: A transformer-based Reverse Dictionarycited by 3
  10. 2021Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selectioncited by 2

Built on by

Not cited yet.