mlsanityData to 7 Oct 2026

KID: Knowledge-Injected Dual-Head Learning for Knowledge-Grounded Harmful Meme Detection

arXiv 2601.21796 ↗First posted 29 Jan 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Internet memes have become pervasive carriers of digital culture on social platforms. However, their heavy reliance on metaphors and sociocultural context also makes them subtle vehicles for harmful content, posing significant challenges for automated content moderation. Existing approaches primarily focus on intra-modal and inter-modal signal analysis, while the understanding of implicit toxicity often depends on background knowledge that is not explicitly present in the meme itself. To address this challenge, we propose KID, a Knowledge-Injected Dual-Head Learning framework for knowledge-grounded harmful meme detection. KID adopts a label-constrained distillation paradigm to decompose complex meme understanding into structured reasoning chains that explicitly link visual evidence, background knowledge, and classification labels. These chains guide the learning process by grounding external knowledge in meme-specific contexts. In addition, KID employs a dual-head architecture that jointly optimizes semantic generation and classification objectives, enabling aligned linguistic reasoning while maintaining stable decision boundaries. Extensive experiments on five multilingual datasets spanning English, Chinese, and low-resource Bengali demonstrate that KID achieves SOTA performance on both binary and multi-label harmful meme detection tasks, improving over previous best methods by 2.1%--19.7% across primary evaluation metrics. Ablation studies further confirm the effectiveness of knowledge injection and dual-head joint learning, highlighting their complementary contributions to robust and generalizable meme understanding. The code and data are available at https://github.com/PotatoDog1669/KID.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

24 of 35 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  10. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  11. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
  12. 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
12 more
  1. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 511
  2. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
  3. 2019Exploring Hate Speech Detection in Multimodal Publicationscited by 103
  4. 2021Detecting Harmful Memes and Their Targetscited by 77
  5. 2023Prompting for Multimodal Hateful Meme Classificationcited by 68
  6. 2022Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Featurescited by 55
  7. 2023Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detectioncited by 45
  8. 2024MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classificationcited by 29
  9. 2023Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learningcited by 20
  10. 2023BanglaAbuseMeme: A Dataset for Bengali Abusive Meme Classificationcited by 18
  11. 2024Towards Comprehensive Detection of Chinese Harmful Memescited by 12
  12. 2025Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detectioncited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Recognition to Reasoning: Advancing Multimodal Harmful Meme Detection via Chain-of-Thought Alignment
  2. 2023Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models
  3. 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detection
  4. 2025Fall into a Pit, Gain in a Wit: Cognitive-Guided Harmful Meme Detection via Misjudgment Risk Pattern Retrieval
  5. 2024Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes
  6. 2024Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models
  7. 2026SyRHM: Symbolic-Language-Enhanced Reasoning with Associative Retrieval for Zero-shot Harmful Meme Detection
  8. 2026Beyond a Joke: Multi-Angle Reasoning for Detecting and Explaining Harmful Humor in Memes