Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities
Not on the map. Why?
Abstract (arXiv)
Internet memes, channels for humor, social commentary, and cultural expression, are increasingly used to spread toxic messages. Studies on the computational analyses of toxic memes have significantly grown over the past five years, and the only three surveys on computational toxic meme analysis cover only work published until 2022, leading to inconsistent terminology and unexplored trends. Our work fills this gap by surveying content-based computational perspectives on toxic memes, and reviewing key developments until early 2024. Employing the PRISMA methodology, we systematically extend the previously considered papers, achieving a threefold result. First, we survey 119 new papers, analyzing 158 computational works focused on content-based toxic meme analysis. We identify over 30 datasets used in toxic meme analysis and examine their labeling systems. Second, after observing the existence of unclear definitions of meme toxicity in computational works, we introduce a new taxonomy for categorizing meme toxicity types. We also note an expansion in computational tasks beyond the simple binary classification of memes as toxic or non-toxic, indicating a shift towards achieving a nuanced comprehension of toxicity. Third, we identify three content-based dimensions of meme toxicity under automatic study: target, intent, and conveyance tactics. We develop a framework illustrating the relationships between these dimensions and meme toxicities. The survey analyzes key challenges and recent trends, such as enhanced cross-modal reasoning, integrating expert and cultural knowledge, the demand for automatic toxicity explanations, and handling meme toxicity in low-resource languages. Also, it notes the rising use of Large Language Models (LLMs) and generative AI for detecting and generating toxic memes. Finally, it proposes pathways for advancing toxic meme detection and interpretation.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 89 of its 247 references that are in the map. First posted on arXiv 11 Jun 2024.
Builds on
89 of 247 references.
References · 89
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
- 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 207
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 175
- 2017Understanding Abuse: A Typology of Abusive Language Detection Subtaskscited by 116
- 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 86
- 2020SemEval-2020 Task 8: Memotion Analysis -- The Visuo-Lingual Metaphor!cited by 78
- 2021Detecting Harmful Memes and Their Targetscited by 78
- 2023Prompting for Multimodal Hateful Meme Classificationcited by 69
38 more
- 2023Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Modelscited by 66
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2022Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Featurescited by 56
- 2024GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abusecited by 52
- 2020Vilio: State-of-the-art Visio-Linguistic Models applied to Hateful Memescited by 51
- 2020Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challengecited by 51
- 2020A Multimodal Framework for the Detection of Hateful Memescited by 49
- 2018On the Origins of Memes by Means of Fringe Web Communitiescited by 47
- 2021A Survey on Multimodal Disinformation Detectioncited by 47
- 2023Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detectioncited by 47
- 2021Disentangling Hate in Online Memescited by 46
- 2021Detecting Propaganda Techniques in Memescited by 44
- 2020Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solutioncited by 41
- 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
- 2023Decoding the Underlying Meaning of Multimodal Hateful Memescited by 39
- 2020Detecting Hate Speech in Multi-modal Memescited by 38
- 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 33
- 2020Detecting Hateful Memes Using a Multimodal Deep Ensemblecited by 30
- 2019Hate Speech in Pixels: Detection of Offensive Memes towards Automatic Moderationcited by 29
- 2020Multimodal Learning for Hateful Memes Detectioncited by 29
- 2021Defining and Detecting Toxicity on Social Media: Context and Knowledge are Keycited by 29
- 2022On Explaining Multimodal Hateful Meme Detection Modelscited by 29
- 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learningcited by 26
- 2021A Framework of Severity for Harmful Content Onlinecited by 23
- 2022DISARM: Detecting the Victims Targeted by Harmful Memescited by 20
- 2023Mapping Memes to Words for Multimodal Hateful Meme Classificationcited by 20
- 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
- 2023BanglaAbuseMeme: A Dataset for Bengali Abusive Meme Classificationcited by 18
- 2024Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Modelscited by 18
- 2023Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Modelscited by 15
- 2020A Multimodal Memes Classification: A Survey and Open Research Issuescited by 14
- 2020Preserving Integrity in Online Social Networkscited by 14
- 2021Caption Enriched Samples for Improving Hateful Memes Detectioncited by 14
- 2021DeToxy: A Large-Scale Multimodal Dataset for Toxicity Classification in Spoken Utterancescited by 14
- 2023Characterizing the Entities in Harmful Memes: Who is the Hero, the Villain, the Victim?cited by 14
- 2023On the Proactive Generation of Unsafe Images From Text-To-Image Models Using Benign Promptscited by 14
- 2024MetaHate: A Dataset for Unifying Efforts on Hate Speech Detectioncited by 14
50 most cited of 89 All 89 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 7.
13 papers.
Sort:
- 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detectioncited by 7
- 2026MemeLens: Multilingual Multitask VLMs for Memescited by 6
- 2024SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memescited by 4
- 2025Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directionscited by 3
- 2025Clustering Internet Memes Through Template Matching and Multi-Dimensional Similaritycited by 1
- 2026All Changes May Have Invariant Principles: Improving Ever-Shifting Harmful Meme Detection via Design Concept Reproductioncited by 1
- 2026MER-Bench: A Comprehensive Benchmark for Multimodal Meme Reappraisalcited by 1
- 2026Harm or Humor: A Multimodal, Multilingual Benchmark for Overt and Covert Harmful Humorcited by 1
- 2025Unpacking Hateful Memes: Presupposed Context and False Claimscited by 0
- 2025Leveraging LLMs for Context-Aware Implicit Textual and Multimodal Hate Speech Detectioncited by 0
- 2026From Vulnerable Data Subjects to Vulnerabilizing Data Practices: Navigating the Protection Paradox in AI-Based Analyses of Platformized Livescited by 0
- 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detectioncited by 0
- 2026Dissonant ballerinas and crafty carrots: a comparative multi-modal analysis of Italian brain rot30 Sep 2026
- 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection17 Sep 2026
- 2026From Vulnerable Data Subjects to Vulnerabilizing Data Practices: Navigating the Protection Paradox in AI-Based Analyses of Platformized Lives17 Apr 2026
- 2026Harm or Humor: A Multimodal, Multilingual Benchmark for Overt and Covert Harmful Humor18 Mar 2026
- 2026MER-Bench: A Comprehensive Benchmark for Multimodal Meme Reappraisal16 Mar 2026
- 2026MemeLens: Multilingual Multitask VLMs for Memes18 Jan 2026
- 2026All Changes May Have Invariant Principles: Improving Ever-Shifting Harmful Meme Detection via Design Concept Reproduction8 Jan 2026
- 2025Leveraging LLMs for Context-Aware Implicit Textual and Multimodal Hate Speech Detection17 Oct 2025
- 2025Unpacking Hateful Memes: Presupposed Context and False Claims11 Oct 2025
- 2025Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directions29 Sep 2025
- 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detection10 Jun 2025
- 2025Clustering Internet Memes Through Template Matching and Multi-Dimensional Similarity30 Apr 2025
1 more
- 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detectioncited by 7
- 2026MemeLens: Multilingual Multitask VLMs for Memescited by 6
- 2024SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memescited by 4
- 2025Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directionscited by 3
- 2025Clustering Internet Memes Through Template Matching and Multi-Dimensional Similaritycited by 1
- 2026All Changes May Have Invariant Principles: Improving Ever-Shifting Harmful Meme Detection via Design Concept Reproductioncited by 1
- 2026MER-Bench: A Comprehensive Benchmark for Multimodal Meme Reappraisalcited by 1
- 2026Harm or Humor: A Multimodal, Multilingual Benchmark for Overt and Covert Harmful Humorcited by 1
- 2025Unpacking Hateful Memes: Presupposed Context and False Claimscited by 0
- 2025Leveraging LLMs for Context-Aware Implicit Textual and Multimodal Hate Speech Detectioncited by 0
- 2026From Vulnerable Data Subjects to Vulnerabilizing Data Practices: Navigating the Protection Paradox in AI-Based Analyses of Platformized Livescited by 0
- 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detectioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026Dissonant ballerinas and crafty carrots: a comparative multi-modal analysis of Italian brain rot30 Sep 2026
- 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection17 Sep 2026
- 2026From Vulnerable Data Subjects to Vulnerabilizing Data Practices: Navigating the Protection Paradox in AI-Based Analyses of Platformized Lives17 Apr 2026
- 2026Harm or Humor: A Multimodal, Multilingual Benchmark for Overt and Covert Harmful Humor18 Mar 2026
- 2026MER-Bench: A Comprehensive Benchmark for Multimodal Meme Reappraisal16 Mar 2026
- 2026MemeLens: Multilingual Multitask VLMs for Memes18 Jan 2026
- 2026All Changes May Have Invariant Principles: Improving Ever-Shifting Harmful Meme Detection via Design Concept Reproduction8 Jan 2026
- 2025Leveraging LLMs for Context-Aware Implicit Textual and Multimodal Hate Speech Detection17 Oct 2025
- 2025Unpacking Hateful Memes: Presupposed Context and False Claims11 Oct 2025
- 2025Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directions29 Sep 2025
- 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detection10 Jun 2025
- 2025Clustering Internet Memes Through Template Matching and Multi-Dimensional Similarity30 Apr 2025
12 newest of 13 All 13 (JSON)