Understanding Jargon: Combining Extraction and Generation for Definition Modeling
Not on the map. Why?
Abstract (arXiv)
Can machines know what twin prime is? From the composition of this phrase, machines may guess twin prime is a certain kind of prime, but it is still difficult to deduce exactly what twin stands for without additional knowledge. Here, twin prime is a jargon - a specialized term used by experts in a particular field. Explaining jargon is challenging since it usually requires domain knowledge to understand. Recently, there is an increasing interest in extracting and generating definitions of words automatically. However, existing approaches, either extraction or generation, perform poorly on jargon. In this paper, we propose to combine extraction and generation for jargon definition modeling: first extract self- and correlative definitional information of target jargon from the Web and then generate the final definitions by incorporating the extracted definitional information. Our framework is remarkably simple but effective: experiments demonstrate our method can generate high-quality definitions for jargon and outperform state-of-the-art models significantly, e.g., BLEU score from 8.76 to 22.66 and human-annotated score from 2.34 to 4.04.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 20 of its 46 references that are in the map. First posted on arXiv 14 Nov 2021.
Builds on
20 of 46 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2019A Question-Entailment Approach to Question Answeringcited by 133
- 2016Definition Modeling: Learning to define word embeddings in natural languagecited by 46
- 2018Conditional Generators of Words Definitionscited by 35
- 2019Mark my Word: A Sequence-to-Sequence Approach to Definition Modelingcited by 15
8 more
- 2019A Joint Model for Definition Extraction with Syntactic Connection and Semantic Consistencycited by 14
- 2019Incorporating Sememes into Chinese Definition Modelingcited by 13
- 2020VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modelingcited by 13
- 2020Document-Level Definition Detection in Scholarly Documents: Existing Models, Error Analyses, and Future Directionscited by 11
- 2021Graphine: A Dataset for Graph-aware Terminology Definition Generationcited by 10
- 2021Open Relation Modeling: Learning to Define Relations between Entitiescited by 7
- 2020Automated Discovery of Mathematical Definitions in Text with Deep Neural Networkscited by 6
- 2021Measuring Fine-Grained Domain Relevance of Terms: A Hierarchical Core-Fringe Approachcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 4; 2025: 4; 2026: 2.
15 papers.
Sort:
By area:
- 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Modelscited by 77
- 2023RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledgecited by 51
- 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19
- 2024A SMART Mnemonic Sounds like "Glue Tonic": Mixing LLMs with Student Feedback to Make Mnemonic Learning Stickcited by 10
- 2022DEER: Descriptive Knowledge Graph for Explaining Entity Relationshipscited by 7
- 2024CoAM: Corpus of All-Type Multiword Expressionscited by 4
- 2022VER: Unifying Verbalizing Entities and Relationscited by 2
- 2025Can Large Language Models Understand Internet Buzzwords Through User-Generated Contentcited by 2
- 2025Multilingual Definition Modelingcited by 1
- 2023WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Datasetcited by 0
- 2025Adapting Definition Modeling for New Languages: A Case Study on Belarusiancited by 0
3 more
- 2025Breaking the Curse of Knowledge: Designing Personalized Jargon Support for Real-Time Online Meetingscited by 0
- 2026Towards Automated Lexicography: Generating and Evaluating Definitions for Learner's Dictionariescited by 0
- 2026Domain-Specific Jargon in Large Language Models: A Comparative Analysis between General-Purpose and Specialist Modelscited by 0
- 2026Domain-Specific Jargon in Large Language Models: A Comparative Analysis between General-Purpose and Specialist Models11 Sep 2026
- 2026Towards Automated Lexicography: Generating and Evaluating Definitions for Learner's Dictionaries5 Jan 2026
- 2025Breaking the Curse of Knowledge: Designing Personalized Jargon Support for Real-Time Online Meetings13 Aug 2025
- 2025Adapting Definition Modeling for New Languages: A Case Study on Belarusian13 Jul 2025
- 2025Multilingual Definition Modeling2 Jun 2025
- 2025Can Large Language Models Understand Internet Buzzwords Through User-Generated Content21 May 2025
- 2024CoAM: Corpus of All-Type Multiword Expressions24 Dec 2024
- 2024A SMART Mnemonic Sounds like "Glue Tonic": Mixing LLMs with Student Feedback to Make Mnemonic Learning Stick21 Jun 2024
- 2024Evaluation of Retrieval-Augmented Generation: A Survey13 May 2024
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Models17 Apr 2024
- 2023RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge14 Nov 2023
- 2023WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Dataset7 Aug 2023
- 2023RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledgecited by 51
- 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysiscited by 19
- 2022DEER: Descriptive Knowledge Graph for Explaining Entity Relationshipscited by 7
- 2024CoAM: Corpus of All-Type Multiword Expressionscited by 4
- 2022VER: Unifying Verbalizing Entities and Relationscited by 2
- 2025Can Large Language Models Understand Internet Buzzwords Through User-Generated Contentcited by 2
- 2025Multilingual Definition Modelingcited by 1
- 2023WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Datasetcited by 0
- 2025Adapting Definition Modeling for New Languages: A Case Study on Belarusiancited by 0
- 2025Breaking the Curse of Knowledge: Designing Personalized Jargon Support for Real-Time Online Meetingscited by 0
- 2026Towards Automated Lexicography: Generating and Evaluating Definitions for Learner's Dictionariescited by 0
- 2026Domain-Specific Jargon in Large Language Models: A Comparative Analysis between General-Purpose and Specialist Modelscited by 0
- 2026Domain-Specific Jargon in Large Language Models: A Comparative Analysis between General-Purpose and Specialist Models11 Sep 2026
- 2026Towards Automated Lexicography: Generating and Evaluating Definitions for Learner's Dictionaries5 Jan 2026
- 2025Breaking the Curse of Knowledge: Designing Personalized Jargon Support for Real-Time Online Meetings13 Aug 2025
- 2025Adapting Definition Modeling for New Languages: A Case Study on Belarusian13 Jul 2025
- 2025Multilingual Definition Modeling2 Jun 2025
- 2025Can Large Language Models Understand Internet Buzzwords Through User-Generated Content21 May 2025
- 2024CoAM: Corpus of All-Type Multiword Expressions24 Dec 2024
- 2023RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge14 Nov 2023
- 2023WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Dataset7 Aug 2023
- 2023Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis19 May 2023
- 2022VER: Unifying Verbalizing Entities and Relations20 Nov 2022
- 2022DEER: Descriptive Knowledge Graph for Explaining Entity Relationships21 May 2022