Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data
Not on the map. Why?
Abstract (arXiv)
Considering the importance of detecting hateful language, labeled hate speech data is expensive and time-consuming to collect, particularly for low-resource languages. Prior work has demonstrated the effectiveness of cross-lingual transfer learning and data augmentation in improving performance on tasks with limited labeled data. To develop an efficient and scalable cross-lingual transfer learning approach, we leverage nearest-neighbor retrieval to augment minimal labeled data in the target language, thereby enhancing detection performance. Specifically, we assume access to a small set of labeled training instances in the target language and use these to retrieve the most relevant labeled examples from a large multilingual hate speech detection pool. We evaluate our approach on eight languages and demonstrate that it consistently outperforms models trained solely on the target language data. Furthermore, in most cases, our method surpasses the current state-of-the-art. Notably, our approach is highly data-efficient, retrieving as small as 200 instances in some cases while maintaining superior performance. Moreover, it is scalable, as the retrieval pool can be easily expanded, and the method can be readily adapted to new languages and tasks. We also apply maximum marginal relevance to mitigate redundancy and filter out highly similar retrieved instances, resulting in improvements in some languages.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 68 references that are in the map. First posted on arXiv 20 May 2025.
Builds on
30 of 68 references.
References · 30
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
18 more
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
- 2020HateCheck: Functional Tests for Hate Speech Detection Modelscited by 216
- 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
- 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
- 2020Measuring a hate speech spectrum with faceted Rasch item response theory and perspective-aware, explainable-by-design deep learningcited by 68
- 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
- 2022Unsupervised Cross-Task Generalization via Retrieval Augmentationcited by 42
- 2022Large-Scale Hate Speech Detection with Cross-Domain Transfercited by 41
- 2022ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Datacited by 34
- 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluationcited by 28
- 2022Data-Efficient Finetuning Using Cross-Task Nearest Neighborscited by 26
- 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
- 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
- 2021Data Expansion using Back Translation and Paraphrasing for Hate Speech Detectioncited by 20
- 2023Cross-Lingual Transfer with Target Language-Ready Task Adapterscited by 15
- 2024Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Datasetcited by 13
- 2024Toxicity Classification in Ukrainiancited by 7
- 2023DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selectioncited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.