Mapping Toxic Comments Across Demographics: A Dataset from German Public Broadcasting
Not on the map. Why?
Abstract (arXiv)
A lack of demographic context in existing toxic speech datasets limits our understanding of how different age groups communicate online. In collaboration with funk, a German public service content network, this research introduces the first large-scale German dataset annotated for toxicity and enriched with platform-provided age estimates. The dataset includes 3,024 human-annotated and 30,024 LLM-annotated anonymized comments from Instagram, TikTok, and YouTube. To ensure relevance, comments were consolidated using predefined toxic keywords, resulting in 16.7% labeled as problematic. The annotation pipeline combined human expertise with state-of-the-art language models, identifying key categories such as insults, disinformation, and criticism of broadcasting fees. The dataset reveals age-based differences in toxic speech patterns, with younger users favoring expressive language and older users more often engaging in disinformation and devaluation. This resource provides new opportunities for studying linguistic variation across demographics and supports the development of more equitable and age-aware content moderation systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
13 of 34 references.
References · 13
- 2018Datasheets for Datasetscited by 1,386
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
- 2018Hate Speech Dataset from a White Supremacy Forumcited by 198
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 140
- 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 110
- 2020Multilingual Offensive Language Identification with Cross-lingual Embeddingscited by 71
- 2018Hate Lingo: A Target-based Linguistic Analysis of Hate Speech in Social Mediacited by 59
- 2023Probing LLMs for hate speech detection: strengths and vulnerabilitiescited by 52
- 2024Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Datasetcited by 13
- 2024Investigating Annotator Bias in Large Language Models for Hate Speech Detectioncited by 6
Built on by
Citing papers per year: 2025: 1.
1 paper.