mlsanityData to 14 Oct 2026

Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities

arXiv 2406.07353 ↗First posted 11 Jun 2024cs.CL cs.AI cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Internet memes, channels for humor, social commentary, and cultural expression, are increasingly used to spread toxic messages. Studies on the computational analyses of toxic memes have significantly grown over the past five years, and the only three surveys on computational toxic meme analysis cover only work published until 2022, leading to inconsistent terminology and unexplored trends. Our work fills this gap by surveying content-based computational perspectives on toxic memes, and reviewing key developments until early 2024. Employing the PRISMA methodology, we systematically extend the previously considered papers, achieving a threefold result. First, we survey 119 new papers, analyzing 158 computational works focused on content-based toxic meme analysis. We identify over 30 datasets used in toxic meme analysis and examine their labeling systems. Second, after observing the existence of unclear definitions of meme toxicity in computational works, we introduce a new taxonomy for categorizing meme toxicity types. We also note an expansion in computational tasks beyond the simple binary classification of memes as toxic or non-toxic, indicating a shift towards achieving a nuanced comprehension of toxicity. Third, we identify three content-based dimensions of meme toxicity under automatic study: target, intent, and conveyance tactics. We develop a framework illustrating the relationships between these dimensions and meme toxicities. The survey analyzes key challenges and recent trends, such as enhanced cross-modal reasoning, integrating expert and cultural knowledge, the demand for automatic toxicity explanations, and handling meme toxicity in low-resource languages. Also, it notes the rising use of Large Language Models (LLMs) and generative AI for detecting and generating toxic memes. Finally, it proposes pathways for advancing toxic meme detection and interpretation.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 89 of its 247 references that are in the map. First posted on arXiv 11 Jun 2024.

Builds on

89 of 247 references.

References · 89

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  3. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  4. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  5. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
  6. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 207
  7. 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 175
  8. 2017Understanding Abuse: A Typology of Abusive Language Detection Subtaskscited by 116
  9. 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 86
  10. 2020SemEval-2020 Task 8: Memotion Analysis -- The Visuo-Lingual Metaphor!cited by 78
  11. 2021Detecting Harmful Memes and Their Targetscited by 78
  12. 2023Prompting for Multimodal Hateful Meme Classificationcited by 69
38 more
  1. 2023Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Modelscited by 66
  2. 2022Handling Bias in Toxic Speech Detection: A Surveycited by 61
  3. 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
  4. 2022Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Featurescited by 56
  5. 2024GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abusecited by 52
  6. 2020Vilio: State-of-the-art Visio-Linguistic Models applied to Hateful Memescited by 51
  7. 2020Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challengecited by 51
  8. 2020A Multimodal Framework for the Detection of Hateful Memescited by 49
  9. 2018On the Origins of Memes by Means of Fringe Web Communitiescited by 47
  10. 2021A Survey on Multimodal Disinformation Detectioncited by 47
  11. 2023Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detectioncited by 47
  12. 2021Disentangling Hate in Online Memescited by 46
  13. 2021Detecting Propaganda Techniques in Memescited by 44
  14. 2020Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solutioncited by 41
  15. 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
  16. 2023Decoding the Underlying Meaning of Multimodal Hateful Memescited by 39
  17. 2020Detecting Hate Speech in Multi-modal Memescited by 38
  18. 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 33
  19. 2020Detecting Hateful Memes Using a Multimodal Deep Ensemblecited by 30
  20. 2019Hate Speech in Pixels: Detection of Offensive Memes towards Automatic Moderationcited by 29
  21. 2020Multimodal Learning for Hateful Memes Detectioncited by 29
  22. 2021Defining and Detecting Toxicity on Social Media: Context and Knowledge are Keycited by 29
  23. 2022On Explaining Multimodal Hateful Meme Detection Modelscited by 29
  24. 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learningcited by 26
  25. 2021A Framework of Severity for Harmful Content Onlinecited by 23
  26. 2022DISARM: Detecting the Victims Targeted by Harmful Memescited by 20
  27. 2023Mapping Memes to Words for Multimodal Hateful Meme Classificationcited by 20
  28. 2022Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabiccited by 18
  29. 2023BanglaAbuseMeme: A Dataset for Bengali Abusive Meme Classificationcited by 18
  30. 2024Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Modelscited by 18
  31. 2023Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Modelscited by 15
  32. 2020A Multimodal Memes Classification: A Survey and Open Research Issuescited by 14
  33. 2020Preserving Integrity in Online Social Networkscited by 14
  34. 2021Caption Enriched Samples for Improving Hateful Memes Detectioncited by 14
  35. 2021DeToxy: A Large-Scale Multimodal Dataset for Toxicity Classification in Spoken Utterancescited by 14
  36. 2023Characterizing the Entities in Harmful Memes: Who is the Hero, the Villain, the Victim?cited by 14
  37. 2023On the Proactive Generation of Unsafe Images From Text-To-Image Models Using Benign Promptscited by 14
  38. 2024MetaHate: A Dataset for Unifying Efforts on Hate Speech Detectioncited by 14

50 most cited of 89 All 89 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 7.

13 papers.

Sort: