A systematic review of Hate Speech automatic detection using Natural Language Processing
Not on the map. Why?
Abstract (arXiv)
With the multiplication of social media platforms, which offer anonymity, easy access and online community formation, and online debate, the issue of hate speech detection and tracking becomes a growing challenge to society, individual, policy-makers and researchers. Despite efforts for leveraging automatic techniques for automatic detection and monitoring, their performances are still far from satisfactory, which constantly calls for future research on the issue. This paper provides a systematic review of literature in this field, with a focus on natural language processing and deep learning technologies, highlighting the terminology, processing pipeline, core methods employed, with a focal point on deep learning architecture. From a methodological perspective, we adopt PRISMA guideline of systematic review of the last 10 years literature from ACM Digital Library and Google Scholar. In the sequel, existing surveys, limitations, and future research directions are extensively discussed.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 53 of its 159 references that are in the map. First posted on arXiv 22 May 2021.
Builds on
53 of 159 references.
References · 53
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
- 2019CamemBERT: a Tasty French Language Modelcited by 368
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 265
- 2016Ex Machina: Personal Attacks Seen at Scalecited by 208
- 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
- 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 206
- 2018Hate Speech Dataset from a White Supremacy Forumcited by 196
38 more
- 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
- 2019Text Classification Algorithms: A Surveycited by 163
- 2019FlauBERT: Unsupervised Language Model Pre-training for Frenchcited by 153
- 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
- 2019Multilingual and Multi-Aspect Hate Speech Analysiscited by 133
- 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 128
- 2019Adaptation of Deep Bidirectional Multilingual Transformers for Russian Languagecited by 109
- 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 109
- 2019BERTje: A Dutch BERT Modelcited by 109
- 2019Exploring Hate Speech Detection in Multimodal Publicationscited by 103
- 2017Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee Crisiscited by 95
- 2017Comparative Study of CNN and RNN for Natural Language Processingcited by 81
- 2019Portuguese Named Entity Recognition using BERT-CRFcited by 73
- 2017Detecting Online Hate Speech Using Context Aware Modelscited by 72
- 2018Characterizing and Detecting Hateful Users on Twittercited by 55
- 2020Offensive Language Identification in Greekcited by 49
- 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
- 2019Offensive Language and Hate Speech Detection for Danishcited by 48
- 2017One-step and Two-step Classification for Abusive Language Detection on Twittercited by 46
- 2018Aggression-annotated Corpus of Hindi-English Code-mixed Datacited by 40
- 2020BEEP! Korean Corpus of Online News Comments for Toxic Speech Detectioncited by 39
- 2020Hate Speech detection in the Bengali language: A dataset and its baseline evaluationcited by 37
- 2018Hate Speech Detection: A Solved Problem? The Challenging Case of Long Tail on Twittercited by 36
- 2019Tackling Online Abuse: A Survey of Automated Abuse Detection Methodscited by 33
- 2018Peer to Peer Hate: Hate Speech Instigators and Their Targetscited by 30
- 2020Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Networkcited by 30
- 2018Detecting Offensive Language in Tweets Using Deep Learningcited by 23
- 2018Challenges in Discriminating Profanity from Hate Speechcited by 23
- 2020Detecting White Supremacist Hate Speech using Domain Specific Word Embedding with Deep Learning and BERTcited by 19
- 2018Hate Speech Detection from Code-mixed Hindi-English Tweets Using Deep Learning Modelscited by 16
- 2018A Quality Type-aware Annotated Corpus and Lexicon for Harassment Researchcited by 11
- 2020Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Modelscited by 11
- 2019Right-wing German Hate Speech on Twitter: Analysis and Automatic Detectioncited by 9
- 2020UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detectioncited by 9
- 2020QutNocturnal@HASOC'19: CNN for Hate Speech and Offensive Content Identification in Hindi Languagecited by 9
- 2020NLPDove at SemEval-2020 Task 12: Improving Offensive Language Detection with Cross-lingual Transfercited by 8
- 2020Gauravarora@HASOC-Dravidian-CodeMix-FIRE2020: Pre-training ULMFiT on Synthetically Generated Code-Mixed Data for Hate Speech Detectioncited by 5
- 2020LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT?cited by 3
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 0; 2024: 2; 2025: 14; 2026: 8.
26 papers.
Sort:
By area:
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2024The Unseen Targets of Hate -- A Systematic Review of Hateful Communication Datasetscited by 6
- 2026DriftGuard: Safety-Aware Multi-Monitor Detection and Selective Adaptation for Evolving Toxicity Moderationcited by 4
- 2025Moderating Harm: Benchmarking Large Language Models for Cyberbullying Detection in YouTube Commentscited by 3
- 2025Digital Guardians: Can GPT-4, Perspective API, and Moderation API reliably detect hate speech in reader comments of German online newspapers?cited by 2
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in Englishcited by 2
- 2025Do You Really Need a GPU to Guard Your LLM? CPU-Class Classifiers and Multi-Stage Pipelines for Safety Enforcement at Scalecited by 2
- 2024Hate Speech Detection Using Cross-Platform Social Media Data In English and German Languagecited by 1
- 2025HP-BERT: A framework for longitudinal study of Hinduphobia on social media via language modelscited by 1
- 2025Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineeringcited by 1
- 2025Tuning-Free Structured Sparse PCA via Deep Unfolding Networkscited by 0
14 more
- 2025EdgeAIGuard: Agentic LLMs for Minor Protection in Digital Spacescited by 0
- 2025Stronger Together: Unleashing the Social Impact of Hate Speech Researchcited by 0
- 2025Understanding and Analyzing Inappropriately Targeting Language in Online Discourse: A Comparative Annotation Studycited by 0
- 2025Bias-Aware Mislabeling Detection via Decoupled Confident Learningcited by 0
- 2025Detoxify: A framework for abusive text transformation using LLMscited by 0
- 2025Before the Outrage: Challenges and Advances in Predicting Online Antisocial Behaviorcited by 0
- 2025Defining, Understanding, and Detecting Online Toxicity: Challenges and Machine Learning Approachescited by 0
- 2026Boosting Accuracy and Interpretability in Multilingual Hate Speech Detection Through Layer Freezing and Explainable AIcited by 0
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Modelscited by 0
- 2026Large language models for spreading dynamics in complex systemscited by 0
- 2026The geometry of online conversations and the causal antecedents of conflictual discoursecited by 0
- 2026ToxiREX: A Dataset on Toxic REasoning in ConteXtcited by 0
- 2026Hate Speech Detection in Turkish and Arabic: A Comprehensive Studycited by 0
- 2026EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasioncited by 0
- 2026EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasion28 Aug 2026
- 2026Hate Speech Detection in Turkish and Arabic: A Comprehensive Study30 Jun 2026
- 2026DriftGuard: Safety-Aware Multi-Monitor Detection and Selective Adaptation for Evolving Toxicity Moderation27 Jun 2026
- 2026ToxiREX: A Dataset on Toxic REasoning in ConteXt26 Jun 2026
- 2026The geometry of online conversations and the causal antecedents of conflictual discourse17 Feb 2026
- 2026Large language models for spreading dynamics in complex systems8 Feb 2026
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models8 Jan 2026
- 2026Boosting Accuracy and Interpretability in Multilingual Hate Speech Detection Through Layer Freezing and Explainable AI6 Jan 2026
- 2025Do You Really Need a GPU to Guard Your LLM? CPU-Class Classifiers and Multi-Stage Pipelines for Safety Enforcement at Scale22 Dec 2025
- 2025Defining, Understanding, and Detecting Online Toxicity: Challenges and Machine Learning Approaches14 Sep 2025
- 2025Before the Outrage: Challenges and Advances in Predicting Online Antisocial Behavior28 Jul 2025
- 2025Detoxify: A framework for abusive text transformation using LLMs14 Jul 2025
14 more
- 2025Bias-Aware Mislabeling Detection via Decoupled Confident Learning9 Jul 2025
- 2025Moderating Harm: Benchmarking Large Language Models for Cyberbullying Detection in YouTube Comments25 May 2025
- 2025Understanding and Analyzing Inappropriately Targeting Language in Online Discourse: A Comparative Annotation Study22 May 2025
- 2025Stronger Together: Unleashing the Social Impact of Hate Speech Research19 May 2025
- 2025Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineering21 Apr 2025
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in English11 Apr 2025
- 2025EdgeAIGuard: Agentic LLMs for Minor Protection in Digital Spaces28 Feb 2025
- 2025Tuning-Free Structured Sparse PCA via Deep Unfolding Networks28 Feb 2025
- 2025HP-BERT: A framework for longitudinal study of Hinduphobia on social media via language models7 Jan 2025
- 2025Digital Guardians: Can GPT-4, Perspective API, and Moderation API reliably detect hate speech in reader comments of German online newspapers?2 Jan 2025
- 2024Hate Speech Detection Using Cross-Platform Social Media Data In English and German Language2 Oct 2024
- 2024The Unseen Targets of Hate -- A Systematic Review of Hateful Communication Datasets14 May 2024
- 2022COLD: A Benchmark for Chinese Offensive Language Detection16 Jan 2022
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark16 Oct 2021
- 2026ToxiREX: A Dataset on Toxic REasoning in ConteXtcited by 0
- 2026ToxiREX: A Dataset on Toxic REasoning in ConteXt26 Jun 2026
- 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2024The Unseen Targets of Hate -- A Systematic Review of Hateful Communication Datasetscited by 6
- 2026DriftGuard: Safety-Aware Multi-Monitor Detection and Selective Adaptation for Evolving Toxicity Moderationcited by 4
- 2025Moderating Harm: Benchmarking Large Language Models for Cyberbullying Detection in YouTube Commentscited by 3
- 2025Digital Guardians: Can GPT-4, Perspective API, and Moderation API reliably detect hate speech in reader comments of German online newspapers?cited by 2
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in Englishcited by 2
- 2024Hate Speech Detection Using Cross-Platform Social Media Data In English and German Languagecited by 1
- 2025HP-BERT: A framework for longitudinal study of Hinduphobia on social media via language modelscited by 1
- 2025Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineeringcited by 1
- 2025Tuning-Free Structured Sparse PCA via Deep Unfolding Networkscited by 0
- 2025Stronger Together: Unleashing the Social Impact of Hate Speech Researchcited by 0
12 most cited of 22 All 22 (JSON)
- 2026Hate Speech Detection in Turkish and Arabic: A Comprehensive Study30 Jun 2026
- 2026DriftGuard: Safety-Aware Multi-Monitor Detection and Selective Adaptation for Evolving Toxicity Moderation27 Jun 2026
- 2026The geometry of online conversations and the causal antecedents of conflictual discourse17 Feb 2026
- 2026Large language models for spreading dynamics in complex systems8 Feb 2026
- 2026LLMs-Integrated Automatic Hate Speech Recognition Using Controllable Text Generation Models8 Jan 2026
- 2026Boosting Accuracy and Interpretability in Multilingual Hate Speech Detection Through Layer Freezing and Explainable AI6 Jan 2026
- 2025Defining, Understanding, and Detecting Online Toxicity: Challenges and Machine Learning Approaches14 Sep 2025
- 2025Before the Outrage: Challenges and Advances in Predicting Online Antisocial Behavior28 Jul 2025
- 2025Detoxify: A framework for abusive text transformation using LLMs14 Jul 2025
- 2025Bias-Aware Mislabeling Detection via Decoupled Confident Learning9 Jul 2025
- 2025Moderating Harm: Benchmarking Large Language Models for Cyberbullying Detection in YouTube Comments25 May 2025
- 2025Understanding and Analyzing Inappropriately Targeting Language in Online Discourse: A Comparative Annotation Study22 May 2025
12 newest of 22 All 22 (JSON)