SenWiCh: Sense-Annotation of Low-Resource Languages for WiC using Hybrid Methods
Not on the map. Why?
Abstract (arXiv)
This paper addresses the critical need for high-quality evaluation datasets in low-resource languages to advance cross-lingual transfer. While cross-lingual transfer offers a key strategy for leveraging multilingual pretraining to expand language technologies to understudied and typologically diverse languages, its effectiveness is dependent on quality and suitable benchmarks. We release new sense-annotated datasets of sentences containing polysemous words, spanning ten low-resource languages across diverse language families and scripts. To facilitate dataset creation, the paper presents a demonstrably beneficial semi-automatic annotation method. The utility of the datasets is demonstrated through Word-in-Context (WiC) formatted experiments that evaluate transfer on these low-resource languages. Results highlight the importance of targeted dataset creation and evaluation for effective polysemy disambiguation in low-resource settings and transfer studies. The released datasets and code aim to support further research into fair, robust, and truly multilingual NLP.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 23 of its 74 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
23 of 74 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 872
- 2019How multilingual is Multilingual BERT?cited by 645
- 2018WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representationscited by 372
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 293
- 2021MuRIL: Multilingual Representations for Indian Languagescited by 179
- 2020PhoBERT: Pre-trained language models for Vietnamesecited by 149
- 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 136
- 2024Multilingual Instruction Tuning With Just a Pinch of Multilingualitycited by 73
- 2021BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?cited by 56
11 more
- 2024IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languagescited by 52
- 2023Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Reviewcited by 50
- 2020AI4Bharat-IndicNLP Corpus: Monolingual Corpora and Word Embeddings for Indic Languagescited by 44
- 2020XL-WiC: A Multilingual Benchmark for Evaluating Semantic Contextualizationcited by 42
- 2022L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languagescited by 35
- 2021Predicting the Performance of Multilingual NLP Modelscited by 24
- 2021Analysing The Impact Of Linguistic Features On Cross-Lingual Transfercited by 16
- 2021AM2iCo: Evaluating Word Meaning in Context across Low-Resource Languages with Adversarial Examplescited by 14
- 2020WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Contextcited by 13
- 2018Adversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specializationcited by 12
- 2021FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionarycited by 12
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026An Exploration-Analysis-Disambiguation Reasoning Framework for Word Sense Disambiguation with Low-Parameter LLMscited by 1
- 2025Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Transfer in Sense-Aware Taskscited by 0
- 2026Rethinking Metrics for Lexical Semantic Change Detectioncited by 0
- 2026SemBench: A Universal Semantic Framework for LLM Evaluationcited by 0
- 2026SemBench: A Universal Semantic Framework for LLM Evaluation12 Mar 2026
- 2026An Exploration-Analysis-Disambiguation Reasoning Framework for Word Sense Disambiguation with Low-Parameter LLMs5 Mar 2026
- 2026Rethinking Metrics for Lexical Semantic Change Detection17 Feb 2026
- 2025Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Transfer in Sense-Aware Tasks30 May 2025