mlsanityData to 14 Oct 2026

MemeLogos: Knowledge-Driven Retrieval-Augmented Reasoning for Harmful Meme Detection

arXiv 2610.15463 ↗First posted 11 Oct 2026cs.AIcited by 0

On the map: Retrieval-augmented generation → Privacy and security of RAG

Abstract (arXiv)

With the rapid proliferation of social media, harmful memes have become a growing threat to online ecosystems. Their harmfulness is often implicitly conveyed through complex interactions among visual, textual, and contextual cues, making accurate detection challenging. Recent studies have introduced Retrieval-Augmented Generation (RAG) and external knowledge into harmful meme detection. However, existing methods mainly retrieve similar instances or auxiliary information, limiting their ability to capture reusable harmfulness knowledge and underlying reasoning mechanisms, and thus constraining both detection performance and interpretability. To address these challenges, we propose MemeLogos, a knowledge-driven retrieval-augmented reasoning framework for harmful meme detection. MemeLogos abstracts recurring harmfulness patterns and reasoning structures from diverse harmful cases into reusable knowledge units and organizes them into a dedicated star-shaped knowledge graph. By combining structured knowledge retrieval with an explicit multi-stage reasoning process inspired by cognitive mechanisms, MemeLogos leverages retrieved knowledge to guide harmfulness reasoning, improving both detection reliability and interpretability. Extensive experiments show that MemeLogos consistently outperforms existing harmful meme detection methods while generating more coherent and interpretable reasoning, demonstrating the effectiveness of structured harmfulness knowledge for multimodal content understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Privacy and security of RAG, one of 15 directions in Retrieval-augmented generation. Builds on 31 of its 45 references that are in the map. First posted on arXiv 11 Oct 2026.

Builds on

31 of 45 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detection18 Feb

Other references · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  6. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  7. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  8. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  9. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
  10. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  11. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
  12. 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 223
18 more
  1. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
  2. 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 184
  3. 2021Detecting Harmful Memes and Their Targetscited by 78
  4. 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 71
  5. 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
  6. 2025Knowledge Graph-Guided Retrieval Augmented Generationcited by 58
  7. 2022Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Featurescited by 56
  8. 2023Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detectioncited by 47
  9. 2025The Distracting Effect: Understanding Irrelevant Passages in RAGcited by 33
  10. 2024MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classificationcited by 30
  11. 2023Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learningcited by 21
  12. 2023Mapping Memes to Words for Multimodal Hateful Meme Classificationcited by 20
  13. 2023Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Modelscited by 15
  14. 2024Towards Comprehensive Detection of Chinese Harmful Memescited by 13
  15. 2024Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memescited by 8
  16. 2025ExPO-HM: Learning to Explain-then-Detect for Hateful Meme Detectioncited by 8
  17. 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detectioncited by 7
  18. 2026KID: Knowledge-Injected Dual-Head Learning for Knowledge-Grounded Harmful Meme Detectioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Recognition to Reasoning: Advancing Multimodal Harmful Meme Detection via Chain-of-Thought Alignment
  2. 2025Fall into a Pit, Gain in a Wit: Cognitive-Guided Harmful Meme Detection via Misjudgment Risk Pattern Retrieval
  3. 2026SyRHM: Symbolic-Language-Enhanced Reasoning with Associative Retrieval for Zero-shot Harmful Meme Detection
  4. 2024Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models
  5. 2026All Changes May Have Invariant Principles: Improving Ever-Shifting Harmful Meme Detection via Design Concept Reproduction
  6. 2024Towards Low-Resource Harmful Meme Detection with LMM Agents
  7. 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection
  8. 2026HarmTrace: Anchor-Calibrated Decoupled Optimization for Fine-Grained Target Identification in Harmful Memes