mlsanityData to 7 Oct 2026

Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challenges

arXiv 2401.09244 ↗First posted 17 Jan 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

The growing prevalence and rapid evolution of offensive language in social media amplify the complexities of detection, particularly highlighting the challenges in identifying such content across diverse languages. This survey presents a systematic and comprehensive exploration of Cross-Lingual Transfer Learning (CLTL) techniques in offensive language detection in social media. Our study stands as the first holistic overview to focus exclusively on the cross-lingual scenario in this domain. We analyse 67 relevant papers and categorise these studies across various dimensions, including the characteristics of multilingual datasets used, the cross-lingual resources employed, and the specific CLTL strategies implemented. According to "what to transfer", we also summarise three main CLTL transfer approaches: instance, feature, and parameter transfer. Additionally, we shed light on the current challenges and future research opportunities in this field. Furthermore, we have made our survey resources available online, including two comprehensive tables that provide accessible references to the multilingual datasets and CLTL methods used in the reviewed literature.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 75 of its 198 references that are in the map. First posted on arXiv 17 Jan 2024.

Builds on

75 of 198 references.

References · 75

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2018Deep contextualized word representationscited by 2,285
  9. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  10. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  11. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  12. 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
38 more
  1. 2017Word Translation Without Parallel Datacited by 480
  2. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  3. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
  4. 2018Learning Word Vectors for 157 Languagescited by 279
  5. 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 272
  6. 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 265
  7. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 217
  8. 2016Ex Machina: Personal Attacks Seen at Scalecited by 208
  9. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
  10. 2018Hate Speech Dataset from a White Supremacy Forumcited by 196
  11. 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
  12. 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
  13. 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
  14. 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 109
  15. 2017Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee Crisiscited by 95
  16. 2017Offline bilingual word vectors, orthogonal transformations and the inverted softmaxcited by 94
  17. 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
  18. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
  19. 2017Detecting Online Hate Speech Using Context Aware Modelscited by 72
  20. 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
  21. 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
  22. 2020ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corporacited by 63
  23. 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
  24. 2023Probing LLMs for hate speech detection: strengths and vulnerabilitiescited by 52
  25. 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
  26. 2020Offensive Language Identification in Greekcited by 49
  27. 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
  28. 2019Offensive Language and Hate Speech Detection for Danishcited by 48
  29. 2023Evaluating GPT-3 Generated Explanations for Hateful Content Moderationcited by 44
  30. 2020Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspectivecited by 43
  31. 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
  32. 2018Aggression-annotated Corpus of Hindi-English Code-mixed Datacited by 40
  33. 2020Hate Speech detection in the Bengali language: A dataset and its baseline evaluationcited by 37
  34. 2015Transfer Learning for Speech and Language Processingcited by 35
  35. 2019Tackling Online Abuse: A Survey of Automated Abuse Detection Methodscited by 33
  36. 2020Developing a Multilingual Annotated Corpus of Misogyny and Aggressioncited by 31
  37. 2018Peer to Peer Hate: Hate Speech Instigators and Their Targetscited by 30
  38. 2021MUDES: Multilingual Detection of Offensive Spanscited by 30

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.