Surfacing contextual hate speech words within social media
Not on the map. Why?
Abstract (arXiv)
Social media platforms have recently seen an increase in the occurrence of hate speech discourse which has led to calls for improved detection methods. Most of these rely on annotated data, keywords, and a classification technique. While this approach provides good coverage, it can fall short when dealing with new terms produced by online extremist communities which act as original sources of words which have alternate hate speech meanings. These code words (which can be both created and adopted words) are designed to evade automatic detection and often have benign meanings in regular discourse. As an example, "skypes", "googles", and "yahoos" are all instances of words which have an alternate meaning that can be used for hate speech. This overlap introduces additional challenges when relying on keywords for both the collection of data that is specific to hate speech, and downstream classification. In this work, we develop a community detection approach for finding extremist hate speech communities and collecting data from their members. We also develop a word embedding model that learns the alternate hate speech meaning of words and demonstrate the candidacy of our code words with several annotation experiments, designed to determine if it is possible to recognize a word as being used for hate speech without knowing its alternate meaning. We report an inter-annotator agreement rate of K=0.871, and K=0.676 for data drawn from our extremist community and the keyword approach respectively, supporting our claim that hate speech detection is a contextual task and does not depend on a fixed list of keywords. Our goal is to advance the domain by providing a high quality hate speech dataset in addition to learned code words that can be fed into existing classification approaches, thus improving the accuracy of automated detection.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 0; 2023: 1; 2024: 2.
6 papers.
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2021Self-Supervised Euphemism Detection and Identification for Content Moderationcited by 25
- 2021Euphemistic Phrase Detection by Masked Language Modelcited by 13
- 2024Making FETCH! Happen: Finding Emergent Dog Whistles Through Common Habitatscited by 6
- 2023Analyzing Norm Violations in Live-Stream Chatcited by 3
- 2024Impromptu Cybercrime Euphemism Detectioncited by 3
- 2024Making FETCH! Happen: Finding Emergent Dog Whistles Through Common Habitats16 Dec 2024
- 2024Impromptu Cybercrime Euphemism Detection2 Dec 2024
- 2023Analyzing Norm Violations in Live-Stream Chat18 May 2023
- 2021Euphemistic Phrase Detection by Masked Language Model10 Sep 2021
- 2021Self-Supervised Euphemism Detection and Identification for Content Moderation31 Mar 2021
- 2021Towards generalisable hate speech detection: a review on obstacles and solutions17 Feb 2021