A Unified Model for Reverse Dictionary and Definition Modelling
Not on the map. Why?
Abstract (arXiv)
We build a dual-way neural dictionary to retrieve words given definitions, and produce definitions for queried words. The model learns the two tasks simultaneously and handles unknown words via embeddings. It casts a word or a definition to the same representation space through a shared layer, then generates the other form in a multi-task fashion. Our method achieves promising automatic scores on previous benchmarks without extra resources. Human annotators prefer the model's outputs in both reference-less and reference-based evaluation, indicating its practicality. Analysis suggests that multiple objectives benefit learning.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 9 May 2022.
Builds on
16 of 26 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2016Using the Output Embedding to Improve Language Modelscited by 272
- 2016Definition Modeling: Learning to define word embeddings in natural languagecited by 46
- 2018Conditional Generators of Words Definitionscited by 35
- 2015Learning to Understand Phrases by Embedding the Dictionarycited by 33
- 2019Multi-channel Reverse Dictionary Modelcited by 16
4 more
- 2019Mark my Word: A Sequence-to-Sequence Approach to Definition Modelingcited by 15
- 2018Mapping Text to Knowledge Graph Entities using Multi-Sense LSTMscited by 14
- 2020BERT for Monolingual and Cross-Lingual Reverse Dictionarycited by 12
- 2018xSense: Learning Sense-Separated Sparse Representations and Textual Definitions for Explainable Word Sense Networkscited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 2.
5 papers.
- 2024CoLLEGe: Concept Embedding Generation for Large Language Modelscited by 3
- 2025Advancing Arabic Reverse Dictionary Systems: A Transformer-Based Approach with Dataset Construction Guidelinescited by 1
- 2025Multilingual Definition Modelingcited by 1
- 2023Towards a Transformer-Based Reverse Dictionary Model for Quality Estimation of Definitionscited by 0
- 2024GEAR: A Simple GENERATE, EMBED, AVERAGE AND RANK Approach for Unsupervised Reverse Dictionarycited by 0
- 2025Multilingual Definition Modeling2 Jun 2025
- 2025Advancing Arabic Reverse Dictionary Systems: A Transformer-Based Approach with Dataset Construction Guidelines30 Apr 2025
- 2024GEAR: A Simple GENERATE, EMBED, AVERAGE AND RANK Approach for Unsupervised Reverse Dictionary9 Dec 2024
- 2024CoLLEGe: Concept Embedding Generation for Large Language Models22 Mar 2024
- 2023Towards a Transformer-Based Reverse Dictionary Model for Quality Estimation of Definitions6 Nov 2023