HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X
Not on the map. Why?
Abstract (arXiv)
The widespread use of social media platforms like Twitter and Facebook has enabled people of all ages to share their thoughts and experiences, leading to an immense accumulation of user-generated content. However, alongside the benefits, these platforms also face the challenge of managing hate speech and offensive content, which can undermine rational discourse and threaten democratic values. As a result, there is a growing need for automated methods to detect and mitigate such content, especially given the complexity of conversations that may require contextual analysis across multiple languages, including code-mixed languages like Hinglish, German-English, and Bangla. We participated in the English task where we have to classify English tweets into two categories namely Hate and Offensive and Non Hate-Offensive. In this work, we experiment with state-of-the-art large language models like GPT-3.5 Turbo via prompting to classify tweets into Hate and Offensive or Non Hate-Offensive. In this study, we evaluate the performance of a classification model using Macro-F1 scores across three distinct runs. The Macro-F1 score, which balances precision and recall across all classes, is used as the primary metric for model evaluation. The scores obtained are 0.756 for run 1, 0.751 for run 2, and 0.754 for run 3, indicating a high level of performance with minimal variance among the runs. The results suggest that the model consistently performs well in terms of precision and recall, with run 1 showing the highest performance. These findings highlight the robustness and reliability of the model across different runs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 14 Nov 2024.
Builds on
13 of 31 references.
References · 13
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
- 2019A BERT-Based Transfer Learning Approach for Hate Speech Detection in Online Social Mediacited by 96
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 90
- 2020Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT modelcited by 87
- 2021Detecting Hate Speech with GPT-3cited by 56
- 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
- 2017A Web of Hate: Tackling Hateful Speech in Online Social Spacescited by 15
- 2024Subjective textitIsms? On the Danger of Conflating Hate and Offence in Abusive Language Detectioncited by 9
- 2024GPT-HateCheck: Can LLMs Write Better Functional Tests for Hate Speech Detection?cited by 3
Built on by
Not cited yet.