mlsanityData to 14 Oct 2026

Detecting Anti-Semitic Hate Speech using Transformer-based Large Language Models

arXiv 2405.03794 ↗First posted 6 May 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Academic researchers and social media entities grappling with the identification of hate speech face significant challenges, primarily due to the vast scale of data and the dynamic nature of hate speech. Given the ethical and practical limitations of large predictive models like ChatGPT in directly addressing such sensitive issues, our research has explored alternative advanced transformer-based and generative AI technologies since 2019. Specifically, we developed a new data labeling technique and established a proof of concept targeting anti-Semitic hate speech, utilizing a variety of transformer models such as BERT (arXiv:1810.04805), DistillBERT (arXiv:1910.01108), RoBERTa (arXiv:1907.11692), and LLaMA-2 (arXiv:2307.09288), complemented by the LoRA fine-tuning approach (arXiv:2106.09685). This paper delineates and evaluates the comparative efficacy of these cutting-edge methods in tackling the intricacies of hate speech detection, highlighting the need for responsible and carefully managed AI applications within sensitive contexts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 6 May 2024.

Builds on

12 of 21 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  8. 2018Deep contextualized word representationscited by 2,290
  9. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  10. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  11. 2019A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Mediacited by 96
  12. 2019Transfer Learning for Hate Speech Detection in Social Mediacited by 13

Built on by

Not cited yet.