mlsanityData to 14 Oct 2026

Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data

arXiv 2505.14272 ↗First posted 20 May 2025cs.CL cs.CY cs.MMcited by 2

Not on the map. Why?

Abstract (arXiv)

Considering the importance of detecting hateful language, labeled hate speech data is expensive and time-consuming to collect, particularly for low-resource languages. Prior work has demonstrated the effectiveness of cross-lingual transfer learning and data augmentation in improving performance on tasks with limited labeled data. To develop an efficient and scalable cross-lingual transfer learning approach, we leverage nearest-neighbor retrieval to augment minimal labeled data in the target language, thereby enhancing detection performance. Specifically, we assume access to a small set of labeled training instances in the target language and use these to retrieve the most relevant labeled examples from a large multilingual hate speech detection pool. We evaluate our approach on eight languages and demonstrate that it consistently outperforms models trained solely on the target language data. Furthermore, in most cases, our method surpasses the current state-of-the-art. Notably, our approach is highly data-efficient, retrieving as small as 200 instances in some cases while maintaining superior performance. Moreover, it is scalable, as the retrieval pool can be easily expanded, and the method can be readily adapted to new languages and tasks. We also apply maximum marginal relevance to mitigate redundancy and filter out highly similar retrieved instances, resulting in improvements in some languages.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 68 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

30 of 68 references.

References · 30

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  2. 2017Billion-scale similarity search with GPUscited by 2,497
  3. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  4. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  5. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  6. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  7. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  8. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
  9. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
  10. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
  11. 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
  12. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
18 more
  1. 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
  2. 2020HateCheck: Functional Tests for Hate Speech Detection Modelscited by 216
  3. 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
  4. 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
  5. 2020Measuring a hate speech spectrum with faceted Rasch item response theory and perspective-aware, explainable-by-design deep learningcited by 68
  6. 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
  7. 2022Unsupervised Cross-Task Generalization via Retrieval Augmentationcited by 42
  8. 2022Large-Scale Hate Speech Detection with Cross-Domain Transfercited by 41
  9. 2022ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Datacited by 34
  10. 2023Robust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluationcited by 28
  11. 2022Data-Efficient Finetuning Using Cross-Task Nearest Neighborscited by 26
  12. 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
  13. 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
  14. 2021Data Expansion using Back Translation and Paraphrasing for Hate Speech Detectioncited by 20
  15. 2023Cross-Lingual Transfer with Target Language-Ready Task Adapterscited by 15
  16. 2024Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Datasetcited by 13
  17. 2024Toxicity Classification in Ukrainiancited by 7
  18. 2023DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selectioncited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.