mlsanityData to 14 Oct 2026

GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledge

arXiv 1908.07245 ↗First posted 20 Aug 2019cs.CLcited by 79

Not on the map. Why?

Abstract (arXiv)

Word Sense Disambiguation (WSD) aims to find the exact sense of an ambiguous word in a particular context. Traditional supervised methods rarely take into consideration the lexical resources like WordNet, which are widely utilized in knowledge-based methods. Recent studies have shown the effectiveness of incorporating gloss (sense definition) into neural networks for WSD. However, compared with traditional word expert supervised methods, they have not achieved much improvement. In this paper, we focus on how to better leverage gloss knowledge in a supervised neural WSD system. We construct context-gloss pairs and propose three BERT-based models for WSD. We fine-tune the pre-trained BERT model on SemCor3.0 training corpus and the experimental results on several English all-words WSD benchmark datasets show that our approach outperforms the state-of-the-art systems.

Key facts. Cited by 79 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Aug 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 26; 2022: 14; 2023: 16; 2024: 12; 2025: 6; 2026: 5.

79 papers.

Sort:

By area:

  1. 2023CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoningcited by 25
  2. 2021NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Predictioncited by 23
  3. 2022ArabGlossBERT: Fine-Tuning BERT on Context-Gloss Pairs for WSDcited by 18
  4. 2021EmpathBERT: A BERT-based Framework for Demographic-aware Empathy Predictioncited by 17
  5. 2021LMMS Reloaded: Transformer-based Sense Embeddings for Disambiguation and Beyondcited by 17
  6. 2022Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualizationcited by 17
  7. 2023AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graphcited by 17
  8. 2024AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimationcited by 14
  9. 2023Driving Context into Text-to-Text Privatizationcited by 13
  10. 2021FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionarycited by 12
  11. 2023A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysiscited by 12
  12. 2021KI-BERT: Infusing Knowledge Context for Better Language and Domain Understandingcited by 11
38 more
  1. 2022Efficient Zero-shot Event Extraction with Context-Definition Alignmentcited by 11
  2. 2023SALMA: Arabic Sense-Annotated Corpus and WSD Benchmarkscited by 10
  3. 2023What do Language Models know about word senses? Zero-Shot WSD with Language Models and Domain Inventoriescited by 9
  4. 2021Incorporating Word Sense Disambiguation in Neural Language Modelscited by 6
  5. 2021LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitutioncited by 6
  6. 2021Learning Sense-Specific Static Embeddings using Contextualised Word Embeddings as a Proxycited by 6
  7. 2023Context-Gloss Augmentation for Improving Arabic Target Sense Verificationcited by 6
  8. 2021PolyLM: Learning about Polysemy through Language Modelingcited by 5
  9. 2021Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventoriescited by 5
  10. 2022Multilingual Word Sense Disambiguation with Unified Sense Representationcited by 5
  11. 2023Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Informationcited by 5
  12. 2023Ambiguity Meets Uncertainty: Investigating Uncertainty Estimation for Word Sense Disambiguationcited by 5
  13. 2024Resolving Regular Polysemy in Named Entitiescited by 5
  14. 2024Multiple Sources are Better Than One: Incorporating External Knowledge in Low-Resource Glossingcited by 5
  15. 2021Non-Parametric Few-Shot Learning for Word Sense Disambiguationcited by 4
  16. 2022Semantic Role Labeling Meets Definition Modeling: Using Natural Language to Describe Predicate-Argument Structurescited by 4
  17. 2024Neural Sequence-to-Sequence Modeling with Attention by Leveraging Deep Learning Architectures for Enhanced Contextual Understanding in Abstractive Text Summarizationcited by 4
  18. 2021IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity Regression Taskcited by 3
  19. 2021Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledgecited by 3
  20. 2022Using Paraphrases to Study Properties of Contextual Embeddingscited by 3
  21. 2023Data Augmentation for Conflict and Duplicate Detection in Software Engineering Sentence Pairscited by 3
  22. 2023Word sense extensioncited by 3
  23. 2023Representation Learning via Variational Bayesian Networkscited by 3
  24. 2023TILFA: A Unified Framework for Text, Image, and Layout Fusion in Argument Miningcited by 3
  25. 2024On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directionscited by 3
  26. 2024AXOLOTL'24 Shared Task on Multilingual Explainable Semantic Change Modelingcited by 3
  27. 2021Training Bi-Encoders for Word Sense Disambiguationcited by 2
  28. 2021Meta-Learning with Variational Semantic Memory for Word Sense Disambiguationcited by 2
  29. 2021Semi-Supervised and Unsupervised Sense Annotation via Translationscited by 2
  30. 2021Context-gloss Augmentation for Improving Word Sense Disambiguationcited by 2
  31. 2021Building on Huang et al. GlossBERT for Word Sense Disambiguationcited by 2
  32. 2022Improving Contextual Representation with Gloss Regularized Pre-trainingcited by 2
  33. 2022Chinese Word Sense Embedding with SememeWSD and Synonym Setcited by 2
  34. 2022CIKQA: Learning Commonsense Inference with a Unified Knowledge-in-the-loop QA Paradigmcited by 2
  35. 2022SMSMix: Sense-Maintained Sentence Mixup for Word Sense Disambiguationcited by 2
  36. 2024Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguationcited by 2
  37. 2025SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoccited by 2
  38. 2025Bias Analysis and Mitigation through Protected Attribute Detection and Regard Classificationcited by 2

50 most cited of 79 All 79 (JSON)