mlsanityData to 7 Oct 2026

Understanding Jargon: Combining Extraction and Generation for Definition Modeling

arXiv 2111.07267 ↗First posted 14 Nov 2021cs.CL cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

Can machines know what twin prime is? From the composition of this phrase, machines may guess twin prime is a certain kind of prime, but it is still difficult to deduce exactly what twin stands for without additional knowledge. Here, twin prime is a jargon - a specialized term used by experts in a particular field. Explaining jargon is challenging since it usually requires domain knowledge to understand. Recently, there is an increasing interest in extracting and generating definitions of words automatically. However, existing approaches, either extraction or generation, perform poorly on jargon. In this paper, we propose to combine extraction and generation for jargon definition modeling: first extract self- and correlative definitional information of target jargon from the Web and then generate the final definitions by incorporating the extracted definitional information. Our framework is remarkably simple but effective: experiments demonstrate our method can generate high-quality definitions for jargon and outperform state-of-the-art models significantly, e.g., BLEU score from 8.76 to 22.66 and human-annotated score from 2.34 to 4.04.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 20 of its 46 references that are in the map. First posted on arXiv 14 Nov 2021.

Builds on

20 of 46 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  9. 2019A Question-Entailment Approach to Question Answeringcited by 133
  10. 2016Definition Modeling: Learning to define word embeddings in natural languagecited by 46
  11. 2018Conditional Generators of Words Definitionscited by 35
  12. 2019Mark my Word: A Sequence-to-Sequence Approach to Definition Modelingcited by 15
8 more
  1. 2019A Joint Model for Definition Extraction with Syntactic Connection and Semantic Consistencycited by 14
  2. 2019Incorporating Sememes into Chinese Definition Modelingcited by 13
  3. 2020VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modelingcited by 13
  4. 2020Document-Level Definition Detection in Scholarly Documents: Existing Models, Error Analyses, and Future Directionscited by 11
  5. 2021Graphine: A Dataset for Graph-aware Terminology Definition Generationcited by 10
  6. 2021Open Relation Modeling: Learning to Define Relations between Entitiescited by 7
  7. 2020Automated Discovery of Mathematical Definitions in Text with Deep Neural Networkscited by 6
  8. 2021Measuring Fine-Grained Domain Relevance of Terms: A Hierarchical Core-Fringe Approachcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 3; 2024: 4; 2025: 4; 2026: 2.

15 papers.

Sort:

By area: