MemeSense: An Adaptive In-Context Framework for Social Commonsense Driven Meme Moderation
Not on the map. Why?
Abstract (arXiv)
Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail to recognize such subtle or implicit harm. We introduce MemeSense, an adaptive framework designed to generate socially grounded interventions for harmful memes by combining visual and textual understanding with curated, semantically aligned examples enriched with commonsense cues. This enables the model to detect nuanced complexed threats like misogyny, stereotyping, or vulgarity "even in memes lacking overt language". Across multiple benchmark datasets, MemeSense outperforms state-of-the-art methods, achieving up to 35% higher semantic similarity and 9% improvement in BERTScore for non-textual memes, and notable gains for text-rich memes as well. These results highlight MemeSense as a promising step toward safer, more context-aware AI systems for real-world content moderation. Code and data available at: https://github.com/sayantan11995/MemeSense
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 16 Feb 2025.
Builds on
25 of 44 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 128
- 2021A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor Searchcited by 82
- 2024Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directionscited by 66
- 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
- 2018Cross-topic Argument Mining from Heterogeneous Sources Using Attention-based Neural Networkscited by 58
- 2024Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learningcited by 49
- 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
- 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 32
13 more
- 2024Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activationscited by 32
- 2023Can Multimodal Large Language Models Truly Perform Multimodal In-Context Learning?cited by 31
- 2023How to Configure Good In-Context Sequence for Visual Question Answeringcited by 31
- 2024What Factors Affect Multi-Modal In-Context Learning? An In-Depth Explorationcited by 31
- 2024SafeInfer: Context Adaptive Decoding Time Safety Alignment for Large Language Modelscited by 22
- 2018Analyzing the hate and counter speech accounts on Twittercited by 21
- 2024MemeGuard: An LLM and VLM-based Framework for Advancing Content Moderation via Meme Interventioncited by 20
- 2024On Zero-Shot Counterspeech Generation by LLMscited by 17
- 2024Meme-ingful Analysis: Enhanced Understanding of Cyberbullying in Memes Through Multimodal Explanationscited by 13
- 2024Can MLLMs Perform Text-to-Image In-Context Learning?cited by 13
- 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencingcited by 12
- 2023MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched Contextualizationcited by 11
- 2024Navigating the Cultural Kaleidoscope: A Hitchhiker's Guide to Sensitivity in Large Language Modelscited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detectioncited by 6
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderationcited by 4
- 2026FBHM: Functional Benchmarking and Steering of VLMs for Hateful Meme Detectioncited by 0
- 2026FBHM: Functional Benchmarking and Steering of VLMs for Hateful Meme Detection29 May 2026
- 2026PEST: Parameter Efficient Steering of Blackbox VLMs via Agentic Few-shot Alignment for Hateful Meme Moderation8 Jan 2026
- 2025Read as You See: Guiding Unimodal LLMs for Low-Resource Explainable Harmful Meme Detection10 Jun 2025