mlsanityData to 14 Oct 2026

SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc

arXiv 2503.05958 ↗First posted 7 Mar 2025cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

The rise of generative chat-based Large Language Models (LLMs) over the past two years has spurred a race to develop systems that promise near-human conversational and reasoning experiences. However, recent studies indicate that the language understanding offered by these models remains limited and far from human-like performance, particularly in grasping the contextual meanings of words, an essential aspect of reasoning. In this paper, we present a simple yet computationally efficient framework for multilingual Word Sense Disambiguation (WSD). Our approach reframes the WSD task as a cluster discrimination analysis over a semantic network refined from BabelNet using group algebra. We validate our methodology across multiple WSD benchmarks, achieving a new state of the art for all languages and tasks, as well as in individual assessments by part of speech. Notably, our model significantly surpasses the performance of current alternatives, even in low-resource languages, while reducing the parameter count by 72%.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 81 references that are in the map. First posted on arXiv 7 Mar 2025.

Builds on

28 of 81 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  10. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  11. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  12. 2016Enriching Word Vectors with Subword Informationcited by 1,583
16 more
  1. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  2. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  3. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 488
  4. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 229
  5. 2023ChatGPT: Jack of all trades, master of nonecited by 204
  6. 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
  7. 2019GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledgecited by 79
  8. 2020Moving Down the Long Tail of Word Sense Disambiguation with Gloss-Informed Biencoderscited by 61
  9. 2019Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense Disambiguationcited by 40
  10. 2019Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representationscited by 21
  11. 2018Incorporating Glosses into Neural Word Sense Disambiguationcited by 18
  12. 2019Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word Sense Disambiguationcited by 17
  13. 2022WinoDict: Probing language models for in-context word acquisitioncited by 15
  14. 2016Word Sense Disambiguation using a Bidirectional LSTMcited by 11
  15. 2023Ambiguity Meets Uncertainty: Investigating Uncertainty Estimation for Word Sense Disambiguationcited by 5
  16. 2023Word Sense Disambiguation as a Game of Neurosymbolic Dartscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.