Cross-lingual Offensive Language Detection: A Systematic Review of Datasets, Transfer Approaches and Challenges
Not on the map. Why?
Abstract (arXiv)
The growing prevalence and rapid evolution of offensive language in social media amplify the complexities of detection, particularly highlighting the challenges in identifying such content across diverse languages. This survey presents a systematic and comprehensive exploration of Cross-Lingual Transfer Learning (CLTL) techniques in offensive language detection in social media. Our study stands as the first holistic overview to focus exclusively on the cross-lingual scenario in this domain. We analyse 67 relevant papers and categorise these studies across various dimensions, including the characteristics of multilingual datasets used, the cross-lingual resources employed, and the specific CLTL strategies implemented. According to "what to transfer", we also summarise three main CLTL transfer approaches: instance, feature, and parameter transfer. Additionally, we shed light on the current challenges and future research opportunities in this field. Furthermore, we have made our survey resources available online, including two comprehensive tables that provide accessible references to the multilingual datasets and CLTL methods used in the reviewed literature.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 75 of its 198 references that are in the map. First posted on arXiv 17 Jan 2024.
Builds on
75 of 198 references.
References · 75
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2018Deep contextualized word representationscited by 2,285
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
38 more
- 2017Word Translation Without Parallel Datacited by 480
- 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
- 2018Learning Word Vectors for 157 Languagescited by 279
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 272
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 265
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 217
- 2016Ex Machina: Personal Attacks Seen at Scalecited by 208
- 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
- 2018Hate Speech Dataset from a White Supremacy Forumcited by 196
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
- 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
- 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
- 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 109
- 2017Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee Crisiscited by 95
- 2017Offline bilingual word vectors, orthogonal transformations and the inverted softmaxcited by 94
- 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2017Detecting Online Hate Speech Using Context Aware Modelscited by 72
- 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2020ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corporacited by 63
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
- 2023Probing LLMs for hate speech detection: strengths and vulnerabilitiescited by 52
- 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
- 2020Offensive Language Identification in Greekcited by 49
- 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
- 2019Offensive Language and Hate Speech Detection for Danishcited by 48
- 2023Evaluating GPT-3 Generated Explanations for Hateful Content Moderationcited by 44
- 2020Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspectivecited by 43
- 2021SWSR: A Chinese Dataset and Lexicon for Online Sexism Detectioncited by 42
- 2018Aggression-annotated Corpus of Hindi-English Code-mixed Datacited by 40
- 2020Hate Speech detection in the Bengali language: A dataset and its baseline evaluationcited by 37
- 2015Transfer Learning for Speech and Language Processingcited by 35
- 2019Tackling Online Abuse: A Survey of Automated Abuse Detection Methodscited by 33
- 2020Developing a Multilingual Annotated Corpus of Misogyny and Aggressioncited by 31
- 2018Peer to Peer Hate: Hate Speech Instigators and Their Targetscited by 30
- 2021MUDES: Multilingual Detection of Offensive Spanscited by 30
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.