mlsanityData to 7 Oct 2026

Transferring Knowledge via Neighborhood-Aware Optimal Transport for Low-Resource Hate Speech Detection

arXiv 2210.09340 ↗First posted 17 Oct 2022cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The concerning rise of hateful content on online platforms has increased the attention towards automatic hate speech detection, commonly formulated as a supervised classification task. State-of-the-art deep learning-based approaches usually require a substantial amount of labeled resources for training. However, annotating hate speech resources is expensive, time-consuming, and often harmful to the annotators. This creates a pressing need to transfer knowledge from the existing labeled resources to low-resource hate speech corpora with the goal of improving system performance. For this, neighborhood-based frameworks have been shown to be effective. However, they have limited flexibility. In our paper, we propose a novel training strategy that allows flexible modeling of the relative proximity of neighbors retrieved from a resource-rich corpus to learn the amount of transfer. In particular, we incorporate neighborhood information with Optimal Transport, which permits exploiting the geometry of the data embedding space. By aligning the joint embedding and label distributions of neighbors, we demonstrate substantial improvements over strong baselines, in low-resource scenarios, on different publicly available hate speech corpora.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 59 references that are in the map. First posted on arXiv 17 Oct 2022.

Builds on

26 of 59 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  4. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  5. 2020Language-agnostic BERT Sentence Embeddingcited by 621
  6. 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 280
  7. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 217
  8. 2018DeepJDOT: Deep Joint Distribution Optimal Transport for Unsupervised Domain Adaptationcited by 212
  9. 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
  10. 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 123
  11. 2020Graph Optimal Transport for Cross-Domain Alignmentcited by 103
  12. 2019A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Mediacited by 95
14 more
  1. 2019TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selectioncited by 74
  2. 2020ETHOS: an Online Hate Speech Detection Datasetcited by 66
  3. 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
  4. 2020Vocabulary Learning via Optimal Transport for Neural Machine Translationcited by 58
  5. 2022Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Listscited by 54
  6. 2020Augmenting Transformers with KNN-Based Composite Memory for Dialoguecited by 53
  7. 2020BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QAcited by 36
  8. 2021Detection of Hate Speech using BERT and Hate Speech Word Embedding with Deep Modelcited by 26
  9. 2018Challenges in Discriminating Profanity from Hate Speechcited by 23
  10. 2020Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transportcited by 20
  11. 2022Toward Interpretable Semantic Textual Similarity via Optimal Transport-based Contrastive Sentence Learningcited by 13
  12. 2022Automatic Identification and Classification of Bragging in Social Mediacited by 12
  13. 2018Comparative Studies of Detecting Abusive Language on Twittercited by 9
  14. 2021Neural Supervised Domain Adaptation by Augmenting Pre-trained Models with Random Unitscited by 2

Built on by

Not cited yet.