mlsanityData to 14 Oct 2026

Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution

arXiv 2012.08290 ↗First posted 15 Dec 2020cs.CL cs.CVcited by 41

Not on the map. Why?

Abstract (arXiv)

Hateful meme detection is a new research area recently brought out that requires both visual, linguistic understanding of the meme and some background knowledge to performing well on the task. This technical report summarises the first place solution of the Hateful Meme Detection Challenge 2020, which extending state-of-the-art visual-linguistic transformers to tackle this problem. At the end of the report, we also point out the shortcomings and possible directions for improving the current methodology.

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 6; 2022: 10; 2023: 16; 2024: 5; 2025: 4.

41 papers.

Sort:

By area:

  1. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  2. 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 175
  3. 2021Detecting Harmful Memes and Their Targetscited by 78
  4. 2023Prompting for Multimodal Hateful Meme Classificationcited by 69
  5. 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
  6. 2022Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Featurescited by 56
  7. 2023Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detectioncited by 47
  8. 2021Disentangling Hate in Online Memescited by 46
  9. 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 33
  10. 2022On Explaining Multimodal Hateful Meme Detection Modelscited by 29
  11. 2022On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learningcited by 26
  12. 2024Towards Low-Resource Harmful Meme Detection with LMM Agentscited by 24
29 more
  1. 2023Mapping Memes to Words for Multimodal Hateful Meme Classificationcited by 20
  2. 2022Emotion Based Hate Speech Detection using Multimodal Learningcited by 18
  3. 2024Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Modelscited by 18
  4. 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
  5. 2023Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Modelscited by 15
  6. 2024Modularized Networks for Few-shot Hateful Meme Detectioncited by 15
  7. 2025MIND: A Multi-agent Framework for Zero-shot Harmful Meme Detectioncited by 15
  8. 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
  9. 2023Detecting and Correcting Hate Speech in Multimodal Memes with Large Visual Language Modelcited by 12
  10. 2023Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modalitycited by 9
  11. 2023MemeFier: Dual-stage Modality Fusion for Image Meme Classificationcited by 6
  12. 2023MemeGraphs: Linking Memes to Knowledge Graphscited by 6
  13. 2023PromptMTopic: Unsupervised Multimodal Topic Modeling of Memes using Large Language Modelscited by 5
  14. 2021An Interpretable Approach to Hateful Meme Detectioncited by 3
  15. 2021Towards A Multi-agent System for Online Hate Speech Detectioncited by 2
  16. 2023TOT: Topology-Aware Optimal Transport For Multimodal Hate Detectioncited by 2
  17. 2023ARC-NLP at Multimodal Hate Speech Event Detection 2023: Multimodal Methods Boosted by Ensemble Learning, Syntactical and Entity Featurescited by 2
  18. 2025Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Modelscited by 2
  19. 2022Feels Bad Man: Dissecting Automated Hateful Meme Detection Through the Lens of Facebook's Challengecited by 1
  20. 2022Multimodal Transformer for Parallel Concatenated Variational Autoencoderscited by 1
  21. 2022The Hateful Memes Challenge Next Movecited by 1
  22. 2023Meme Sentiment Analysis Enhanced with Multimodal Spatial Encoding and Facial Embeddingcited by 1
  23. 2023A Review of Vision-Language Models and their Performance on the Hateful Memes Challengecited by 1
  24. 2023Unimodal Intermediate Training for Multimodal Meme Sentiment Classificationcited by 1
  25. 2024Prompt-enhanced Network for Hateful Meme Classificationcited by 1
  26. 2021What is Multimodality?cited by 0
  27. 2022RubCSG at SemEval-2022 Task 5: Ensemble learning for identifying misogynous MEMEscited by 0
  28. 2025What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shiftcited by 0
  29. 2025Unpacking Hateful Memes: Presupposed Context and False Claimscited by 0