mlsanityData to 14 Oct 2026

Speech Detection Task Against Asian Hate: BERT the Central, While Data-Centric Studies the Crucial

arXiv 2206.02114 ↗First posted 5 Jun 2022cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

With the COVID-19 pandemic continuing, hatred against Asians is intensifying in countries outside Asia, especially among the Chinese. There is an urgent need to detect and prevent hate speech towards Asians effectively. In this work, we first create COVID-HATE-2022, an annotated dataset including 2,025 annotated tweets fetched in early February 2022, which are labeled based on specific criteria, and we present the comprehensive collection of scenarios of hate and non-hate tweets in the dataset. Second, we fine-tune the BERT model based on the relevant datasets and demonstrate several strategies related to the "cleaning" of the tweets. Third, we investigate the performance of advanced fine-tuning strategies with various model-centric and data-centric approaches, and we show that both strategies generally improve the performance, while data-centric ones outperform the others, and it demonstrates the feasibility and effectiveness of the data-centric approaches in the associated tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 64 references that are in the map. First posted on arXiv 5 Jun 2022.

Builds on

23 of 64 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  4. 2014How transferable are features in deep neural networks?cited by 1,225
  5. 2020On Layer Normalization in the Transformer Architecturecited by 922
  6. 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 425
  7. 2019How to Fine-Tune BERT for Text Classification?cited by 411
  8. 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
  9. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
  10. 2020Revisiting Few-sample BERT Fine-tuningcited by 238
  11. 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 207
  12. 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
11 more
  1. 2019What Would Elsa Do? Freezing Layers During Transformer Fine-Tuningcited by 89
  2. 2020Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approachcited by 83
  3. 2021Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learningcited by 72
  4. 2020Learning from Rules Generalizing Labeled Exemplarscited by 59
  5. 2020Detecting East Asian Prejudice on Social Mediacited by 40
  6. 2020Racism is a Virus: Anti-Asian Hate and Counterspeech in Social Media during the COVID-19 Crisiscited by 40
  7. 2021Detection of Hate Speech using BERT and Hate Speech Word Embedding with Deep Modelcited by 26
  8. 2021Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detectioncited by 15
  9. 2022Cyberbullying Classifiers are Sensitive to Model-Agnostic Perturbationscited by 5
  10. 2021Hate speech detection using static BERT embeddingscited by 4
  11. 2022A Feature Extraction based Model for Hate Speech Identificationcited by 1

Built on by

Not cited yet.