Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models
Not on the map. Why?
Abstract (arXiv)
In the evolving landscape of online communication, moderating hate speech (HS) presents an intricate challenge, compounded by the multimodal nature of digital content. This comprehensive survey delves into the recent strides in HS moderation, spotlighting the burgeoning role of large language models (LLMs) and large multimodal models (LMMs). Our exploration begins with a thorough analysis of current literature, revealing the nuanced interplay between textual, visual, and auditory elements in propagating HS. We uncover a notable trend towards integrating these modalities, primarily due to the complexity and subtlety with which HS is disseminated. A significant emphasis is placed on the advances facilitated by LLMs and LMMs, which have begun to redefine the boundaries of detection and moderation capabilities. We identify existing gaps in research, particularly in the context of underrepresented languages and cultures, and the need for solutions to handle low-resource settings. The survey concludes with a forward-looking perspective, outlining potential avenues for future research, including the exploration of novel AI methodologies, the ethical governance of AI in moderation, and the development of more nuanced, context-aware systems. This comprehensive overview aims to catalyze further research and foster a collaborative effort towards more sophisticated, responsible, and human-centric approaches to HS moderation in the digital era. WARNING: This paper contains offensive examples.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 49 of its 92 references that are in the map. First posted on arXiv 30 Jan 2024.
Builds on
49 of 92 references.
References · 49
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023A Survey of Large Language Modelscited by 2,576
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 407
- 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 380
- 2018Large Scale Crowdsourcing and Characterization of Twitter Abusive Behaviorcited by 270
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
- 2020HateCheck: Functional Tests for Hate Speech Detection Modelscited by 216
37 more
- 2018Hate Speech Dataset from a White Supremacy Forumcited by 198
- 2017Deep Learning for Hate Speech Detection in Tweetscited by 180
- 2023Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learningcited by 149
- 2019CONAN -- COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speechcited by 110
- 2019Exploring Hate Speech Detection in Multimodal Publicationscited by 103
- 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 86
- 2020Contextualizing Hate Speech Classifiers with Post-hoc Explanationcited by 84
- 2021Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speechcited by 82
- 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
- 2023Prompting for Multimodal Hateful Meme Classificationcited by 69
- 2018Thou shalt not hate: Countering Online Hate Speechcited by 64
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
- 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
- 2023Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detectioncited by 47
- 2021Disentangling Hate in Online Memescited by 46
- 2023Evaluating GPT-3 Generated Explanations for Hateful Content Moderationcited by 46
- 2021Towards Knowledge-Grounded Counter Narrative Generation for Hate Speechcited by 42
- 2023HateMM: A Multi-Modal Dataset for Hate Video Classificationcited by 42
- 2023Decoding the Underlying Meaning of Multimodal Hateful Memescited by 39
- 2023HARE: Explainable Hate Speech Detection with Step-by-Step Reasoningcited by 31
- 2020Detecting Hateful Memes Using a Multimodal Deep Ensemblecited by 30
- 2021DeepHate: Hate Speech Detection via Multi-Faceted Text Representationscited by 29
- 2022On Explaining Multimodal Hateful Meme Detection Modelscited by 29
- 2018Leveraging Intra-User and Inter-User Representation Learning for Automated Hate Speech Detectioncited by 25
- 2022How Hate Speech Varies by Target Identity: A Computational Analysiscited by 23
- 2021AngryBERT: Joint Learning Target and Emotion for Hate Speech Detectioncited by 19
- 2023Zero-Resource Hallucination Prevention for Large Language Modelscited by 19
- 2022Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detectioncited by 18
- 2022Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalizationcited by 17
- 2023Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Modelscited by 15
- 2024MuTox: Universal MUltilingual Audio-based TOXicity Dataset and Zero-shot Detectorcited by 15
- 2021DeToxy: A Large-Scale Multimodal Dataset for Toxicity Classification in Spoken Utterancescited by 14
- 2023CoSyn: Detecting Implicit Hate Speech in Online Conversations Using a Context Synergized Hyperbolic Networkcited by 12
- 2023Detecting and Correcting Hate Speech in Multimodal Memes with Large Visual Language Modelcited by 12
- 2021Benchmark dataset of memes with text transcriptions for automatic detection of multi-modal misogynistic contentcited by 9
- 2023Multi-modal Hate Speech Detection using Machine Learningcited by 8
- 2022Predicting Hate Intensity of Twitter Conversation Threadscited by 7
Built on by
Citing papers per year: 2024: 6; 2025: 14; 2026: 6.
26 papers.
Sort:
By area:
- 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
- 2024Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settingscited by 14
- 2025Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreementcited by 14
- 2025Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisionscited by 14
- 2025Cross-Modal Transfer from Memes to Videos: Addressing Data Scarcity in Hateful Video Detectioncited by 9
- 2024Bridging Modalities: Enhancing Cross-Modality Hate Speech Detection with Few-Shot In-Context Learningcited by 7
- 2025LionGuard 2: Building Lightweight, Data-Efficient & Localised Multilingual Content Moderatorscited by 7
- 2024Do Large Language Models Speak All Languages Equally? A Comparative Study in Low-Resource Settingscited by 6
- 2026MemeLens: Multilingual Multitask VLMs for Memescited by 6
- 2026The Impact of AI-Generated Text on the Internetcited by 6
- 2024ArMeme: Propagandistic Content in Arabic Memescited by 5
- 2025LLM-C3MOD: A Human-LLM Collaborative System for Cross-Cultural Hate Speech Moderationcited by 5
14 more
- 2025MM-HSD: Multi-Modal Hate Speech Detection in Videoscited by 5
- 2024SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memescited by 4
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderationcited by 4
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in Englishcited by 2
- 2025MuSeD: A Multimodal Spanish Dataset for Sexism Detection in Social Media Videoscited by 2
- 2025Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Modelscited by 2
- 2025Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languagescited by 2
- 2025MultiHateLoc: Towards Temporal Localisation of Multimodal Hate Content in Online Videoscited by 1
- 2026Toward Accountable AI-Generated Content on Social Platforms: Steganographic Attribution and Multimodal Harm Detectioncited by 1
- 2025Decoding Memes: Benchmarking Narrative Role Classification across Multilingual and Multimodal Modelscited by 0
- 2025Innocence in the Crossfire: Roles of Skip Connections in Jailbreaking Visual Language Modelscited by 0
- 2025Reasoning-Aware Multimodal Fusion for Hateful Video Detectioncited by 0
- 2026CLARA: Clip-Level Multimodal Alignment with VLM-Derived Rationales for Hateful Video Detectioncited by 0
- 2026Introducing the Privacy-HSD Trade-off: Hate Speech Detection, but not at the Cost of Privacycited by 0
- 2026Introducing the Privacy-HSD Trade-off: Hate Speech Detection, but not at the Cost of Privacy19 Aug 2026
- 2026CLARA: Clip-Level Multimodal Alignment with VLM-Derived Rationales for Hateful Video Detection16 Aug 2026
- 2026The Impact of AI-Generated Text on the Internet14 Apr 2026
- 2026Toward Accountable AI-Generated Content on Social Platforms: Steganographic Attribution and Multimodal Harm Detection12 Apr 2026
- 2026MemeLens: Multilingual Multitask VLMs for Memes18 Jan 2026
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderation8 Jan 2026
- 2025MultiHateLoc: Towards Temporal Localisation of Multimodal Hate Content in Online Videos11 Dec 2025
- 2025Reasoning-Aware Multimodal Fusion for Hateful Video Detection2 Dec 2025
- 2025Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languages18 Sep 2025
- 2025MM-HSD: Multi-Modal Hate Speech Detection in Videos28 Aug 2025
- 2025LionGuard 2: Building Lightweight, Data-Efficient & Localised Multilingual Content Moderators21 Jul 2025
- 2025Innocence in the Crossfire: Roles of Skip Connections in Jailbreaking Visual Language Models18 Jul 2025
14 more
- 2025Decoding Memes: Benchmarking Narrative Role Classification across Multilingual and Multimodal Models29 Jun 2025
- 2025Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Models30 Apr 2025
- 2025MuSeD: A Multimodal Spanish Dataset for Sexism Detection in Social Media Videos15 Apr 2025
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in English11 Apr 2025
- 2025LLM-C3MOD: A Human-LLM Collaborative System for Cross-Cultural Hate Speech Moderation10 Mar 2025
- 2025Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisions16 Feb 2025
- 2025Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement10 Feb 2025
- 2025Cross-Modal Transfer from Memes to Videos: Addressing Data Scarcity in Hateful Video Detection26 Jan 2025
- 2024SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes29 Dec 2024
- 2024Survey of Cultural Awareness in Language Models: Text and Beyond30 Oct 2024
- 2024Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settings17 Oct 2024
- 2024Bridging Modalities: Enhancing Cross-Modality Hate Speech Detection with Few-Shot In-Context Learning8 Oct 2024
- 2024Do Large Language Models Speak All Languages Equally? A Comparative Study in Low-Resource Settings5 Aug 2024
- 2024ArMeme: Propagandistic Content in Arabic Memes6 Jun 2024
- 2025Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisionscited by 14
- 2025Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Modelscited by 2
- 2025Innocence in the Crossfire: Roles of Skip Connections in Jailbreaking Visual Language Modelscited by 0
- 2025Innocence in the Crossfire: Roles of Skip Connections in Jailbreaking Visual Language Models18 Jul 2025
- 2025Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Models30 Apr 2025
- 2025Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisions16 Feb 2025
- 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
- 2024Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settingscited by 14
- 2025Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreementcited by 14
- 2025Cross-Modal Transfer from Memes to Videos: Addressing Data Scarcity in Hateful Video Detectioncited by 9
- 2024Bridging Modalities: Enhancing Cross-Modality Hate Speech Detection with Few-Shot In-Context Learningcited by 7
- 2025LionGuard 2: Building Lightweight, Data-Efficient & Localised Multilingual Content Moderatorscited by 7
- 2024Do Large Language Models Speak All Languages Equally? A Comparative Study in Low-Resource Settingscited by 6
- 2026MemeLens: Multilingual Multitask VLMs for Memescited by 6
- 2026The Impact of AI-Generated Text on the Internetcited by 6
- 2024ArMeme: Propagandistic Content in Arabic Memescited by 5
- 2025LLM-C3MOD: A Human-LLM Collaborative System for Cross-Cultural Hate Speech Moderationcited by 5
- 2025MM-HSD: Multi-Modal Hate Speech Detection in Videoscited by 5
12 most cited of 20 All 20 (JSON)
- 2026Introducing the Privacy-HSD Trade-off: Hate Speech Detection, but not at the Cost of Privacy19 Aug 2026
- 2026CLARA: Clip-Level Multimodal Alignment with VLM-Derived Rationales for Hateful Video Detection16 Aug 2026
- 2026The Impact of AI-Generated Text on the Internet14 Apr 2026
- 2026MemeLens: Multilingual Multitask VLMs for Memes18 Jan 2026
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderation8 Jan 2026
- 2025MultiHateLoc: Towards Temporal Localisation of Multimodal Hate Content in Online Videos11 Dec 2025
- 2025MM-HSD: Multi-Modal Hate Speech Detection in Videos28 Aug 2025
- 2025LionGuard 2: Building Lightweight, Data-Efficient & Localised Multilingual Content Moderators21 Jul 2025
- 2025Decoding Memes: Benchmarking Narrative Role Classification across Multilingual and Multimodal Models29 Jun 2025
- 2025MuSeD: A Multimodal Spanish Dataset for Sexism Detection in Social Media Videos15 Apr 2025
- 2025A Survey of Machine Learning Models and Datasets for the Multi-label Classification of Textual Hate Speech in English11 Apr 2025
- 2025LLM-C3MOD: A Human-LLM Collaborative System for Cross-Cultural Hate Speech Moderation10 Mar 2025
12 newest of 20 All 20 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Decoding Hate: Exploring Language Models' Reactions to Hate Speech
- 2026Is AI Ready for Multimodal Hate Speech Detection? A Comprehensive Dataset and Benchmark Evaluation ↗
- 2025Rethinking Hate Speech Detection on Social Media: Can LLMs Replace Traditional Models?
- 2023Probing LLMs for hate speech detection: strengths and vulnerabilities
- 2026Beyond Hate: Differentiating Uncivil and Intolerant Speech in Multimodal Content Moderation
- 2025Labels or Input? Rethinking Augmentation in Multimodal Hate Detection
- 2023HateRephrase: Zero- and Few-Shot Reduction of Hate Intensity in Online Posts using Large Language Models
- 2023A Review of Vision-Language Models and their Performance on the Hateful Memes Challenge