Bridging Gaps in Hate Speech Detection: Meta-Collections and Benchmarks for Low-Resource Iberian Languages
Not on the map. Why?
Abstract (arXiv)
Hate speech poses a serious threat to social cohesion and individual well-being, particularly on social media, where it spreads rapidly. While research on hate speech detection has progressed, it remains largely focused on English, resulting in limited resources and benchmarks for low-resource languages. Moreover, many of these languages have multiple linguistic varieties, a factor often overlooked in current approaches. At the same time, large language models require substantial amounts of data to perform reliably, a requirement that low-resource languages often cannot meet. In this work, we address these gaps by compiling a meta-collection of hate speech datasets for European Spanish, standardised with unified labels and metadata. This collection is based on a systematic analysis and integration of existing resources, aiming to bridge the data gap and support more consistent and scalable hate speech detection. We extended this collection by translating it into European Portuguese and into a Galician standard that is more convergent with Spanish and another Galician variant that is more convergent with Portuguese, creating aligned multilingual corpora. Using these resources, we establish new benchmarks for hate speech detection in Iberian languages. We evaluate state-of-the-art large language models in zero-shot, few-shot, and fine-tuning settings, providing baseline results for future research. Moreover, we perform a cross-lingual analysis with our target languages. Our findings underscore the importance of multilingual and variety-aware approaches in hate speech detection and offer a foundation for improved benchmarking in underrepresented European languages.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 87 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
34 of 87 references.
References · 34
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
- 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 207
- 2013Crowdsourcing a Word-Emotion Association Lexiconcited by 196
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
- 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
- 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
22 more
- 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 129
- 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 110
- 2018Hate Lingo: A Target-based Linguistic Analysis of Hate Speech in Social Mediacited by 59
- 2023Probing LLMs for hate speech detection: strengths and vulnerabilitiescited by 52
- 2020Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysiscited by 45
- 2021Hate Towards the Political Opponent: A Twitter Corpus Study of the 2020 US Elections on the Basis of Offensive Speech and Stance Detectioncited by 45
- 2023HateMM: A Multi-Modal Dataset for Hate Video Classificationcited by 42
- 2022Large-Scale Hate Speech Detection with Cross-Domain Transfercited by 41
- 2022Toxicity Detection with Generative Prompt-based Inferencecited by 35
- 2018Peer to Peer Hate: Hate Speech Instigators and Their Targetscited by 30
- 2017Mean Birds: Detecting Aggression and Bullying on Twittercited by 29
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 27
- 2024From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasetscited by 25
- 2024Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpuscited by 24
- 2022Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource Settingscited by 21
- 2021HateBR: A Large Expert Annotated Corpus of Brazilian Instagram Comments for Offensive Language and Hate Speech Detectioncited by 15
- 2024MetaHate: A Dataset for Unifying Efforts on Hate Speech Detectioncited by 14
- 2019The FRENK Datasets of Socially Unacceptable Discourse in Slovene and Englishcited by 8
- 2023Auditing Elon Musk's Impact on Hate Speech and Botscited by 8
- 2024A Comprehensive Study on NLP Data Augmentation for Hate Speech Detection: Legacy Methods, BERT, and LLMscited by 7
- 2023The crime of being poorcited by 4
- 2023A Text-to-Text Model for Multilingual Offensive Language Identificationcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.