mlsanityData to 7 Oct 2026

Detecting Hateful Memes Using a Multimodal Deep Ensemble

arXiv 2012.13235 ↗First posted 24 Dec 2020cs.LG cs.CL cs.CVcited by 30

Not on the map. Why?

Abstract (arXiv)

While significant progress has been made using machine learning algorithms to detect hate speech, important technical challenges still remain to be solved in order to bring their performance closer to human accuracy. We investigate several of the most recent visual-linguistic Transformer architectures and propose improvements to increase their performance for this task. The proposed model outperforms the baselines by a large margin and ranks 5th on the leaderboard out of 3,100+ participants.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 4; 2023: 8; 2024: 7; 2025: 5; 2026: 1.

30 papers.

Sort:

By area:

  1. 2021MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targetscited by 85
  2. 2021Detecting Harmful Memes and Their Targetscited by 77
  3. 2023Prompting for Multimodal Hateful Meme Classificationcited by 68
  4. 2022Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Featurescited by 55
  5. 2021Disentangling Hate in Online Memescited by 46
  6. 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Modelscited by 26
  7. 2024Towards Low-Resource Harmful Meme Detection with LMM Agentscited by 23
  8. 2022DISARM: Detecting the Victims Targeted by Harmful Memescited by 20
  9. 2023Mapping Memes to Words for Multimodal Hateful Meme Classificationcited by 19
  10. 2022What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memescited by 18
  11. 2024Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Modelscited by 17
  12. 2023Characterizing the Entities in Harmful Memes: Who is the Hero, the Villain, the Victim?cited by 14
18 more
  1. 2023Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Modelscited by 14
  2. 2025MIND: A Multi-agent Framework for Zero-shot Harmful Meme Detectioncited by 14
  3. 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
  4. 2023Detecting and Correcting Hate Speech in Multimodal Memes with Large Visual Language Modelcited by 12
  5. 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencingcited by 12
  6. 2023MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched Contextualizationcited by 11
  7. 2023MemeFier: Dual-stage Modality Fusion for Image Meme Classificationcited by 6
  8. 2025MM-HSD: Multi-Modal Hate Speech Detection in Videoscited by 5
  9. 2024SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memescited by 4
  10. 2021An Interpretable Approach to Hateful Meme Detectioncited by 3
  11. 2025Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Modelscited by 2
  12. 2025Representation Decomposition for Learning Similarity and Contrastness Across Modalities for Affective Computingcited by 2
  13. 2026Robust Harmful Meme Detection under Missing Modalities via Shared Representation Learningcited by 2
  14. 2022Feels Bad Man: Dissecting Automated Hateful Meme Detection Through the Lens of Facebook's Challengecited by 1
  15. 2024COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transportcited by 1
  16. 2021LIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP featurescited by 0
  17. 2023MATK: The Meme Analytical Tool Kitcited by 0
  18. 2025Fall into a Pit, Gain in a Wit: Cognitive-Guided Harmful Meme Detection via Misjudgment Risk Pattern Retrievalcited by 0