"Stop Asian Hate!" : Refining Detection of Anti-Asian Hate Speech During the COVID-19 Pandemic
Not on the map. Why?
Abstract (arXiv)
Content warning: This work displays examples of explicit and/or strongly offensive language. Fueled by a surge of anti-Asian xenophobia and prejudice during the COVID-19 pandemic, many have taken to social media to express these negative sentiments. Identifying these posts is crucial for moderation and understanding the nature of hate in online spaces. In this paper, we create and annotate a corpus of tweets to explore anti-Asian hate speech with a finer level of granularity. Our analysis reveals that this emergent form of hate speech often eludes established approaches. To address this challenge, we develop a model and an accompanied efficient training regimen that incorporates agreement between annotators. Our approach produces up to 8.8% improvement in macro F1 scores over a strong established baseline, indicating its effectiveness even in settings where consensus among annotators is low. We demonstrate that we are able to identify hate speech that is systematically missed by established hate speech detectors.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 20 of its 55 references that are in the map. First posted on arXiv 4 Dec 2021.
Builds on
20 of 55 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 265
- 2019Racial Bias in Hate Speech and Abusive Language Detection Datasetscited by 208
- 2016Demographic Dialectal Variation in Social Media: A Case Study of African-American Englishcited by 194
- 2020Directions in Abusive Language Training Data: Garbage In, Garbage Outcited by 139
- 2019A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Mediacited by 95
- 2021Challenges in Automated Debiasing for Toxic Language Detectioncited by 95
- 2021Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreementcited by 71
8 more
- 2021Towards generalisable hate speech detection: a review on obstacles and solutionscited by 66
- 2020Detecting East Asian Prejudice on Social Mediacited by 40
- 2020Racism is a Virus: Anti-Asian Hate and Counterspeech in Social Media during the COVID-19 Crisiscited by 40
- 2020Detecting Hate Speech in Multi-modal Memescited by 38
- 2017Mean Birds: Detecting Aggression and Bullying on Twittercited by 29
- 2021Predicting Anti-Asian Hateful Users on Twitter during COVID-19cited by 11
- 2020Annotating for Hate Speech: The MaNeCo Corpus and Some Input from Critical Discourse Analysiscited by 6
- 2020Understanding Public Sentiments, Opinions and Topics about COVID-19 using Twittercited by 5
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 1; 2025: 0; 2026: 1.
4 papers.
- 2024"Define Your Terms" : Enhancing Efficient Offensive Speech Classification with Definitioncited by 7
- 2022Hypothesis Engineering for Zero-Shot Hate Speech Detectioncited by 3
- 2022How Much Hate with #china? A Preliminary Analysis on China-related Hateful Tweets Two Years After the Covid Pandemic Begancited by 1
- 2026Beyond Static Benchmarks: Synthesizing Harmful Content via Persona-based Simulation for Robust Evaluationcited by 0
- 2026Beyond Static Benchmarks: Synthesizing Harmful Content via Persona-based Simulation for Robust Evaluation18 Apr 2026
- 2024"Define Your Terms" : Enhancing Efficient Offensive Speech Classification with Definition5 Feb 2024
- 2022How Much Hate with #china? A Preliminary Analysis on China-related Hateful Tweets Two Years After the Covid Pandemic Began11 Nov 2022
- 2022Hypothesis Engineering for Zero-Shot Hate Speech Detection3 Oct 2022