mlsanityData to 7 Oct 2026

MemeSense: An Adaptive In-Context Framework for Social Commonsense Driven Meme Moderation

arXiv 2502.11246 ↗First posted 16 Feb 2025cs.IR cs.CL cs.CYcited by 3

Not on the map. Why?

Abstract (arXiv)

Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail to recognize such subtle or implicit harm. We introduce MemeSense, an adaptive framework designed to generate socially grounded interventions for harmful memes by combining visual and textual understanding with curated, semantically aligned examples enriched with commonsense cues. This enables the model to detect nuanced complexed threats like misogyny, stereotyping, or vulgarity "even in memes lacking overt language". Across multiple benchmark datasets, MemeSense outperforms state-of-the-art methods, achieving up to 35% higher semantic similarity and 9% improvement in BERTScore for non-textual memes, and notable gains for text-rich memes as well. These results highlight MemeSense as a promising step toward safer, more context-aware AI systems for real-world content moderation. Code and data available at: https://github.com/sayantan11995/MemeSense

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 16 Feb 2025.

Builds on

25 of 44 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2023A Survey on Multimodal Large Language Modelscited by 898
  4. 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
  5. 2019A Benchmark Dataset for Learning to Intervene in Online Hate Speechcited by 128
  6. 2021A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor Searchcited by 82
  7. 2024Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directionscited by 66
  8. 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
  9. 2018Cross-topic Argument Mining from Heterogeneous Sources Using Attention-based Neural Networkscited by 58
  10. 2024Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learningcited by 49
  11. 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
  12. 2021Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Gocited by 32
13 more
  1. 2024Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activationscited by 32
  2. 2023Can Multimodal Large Language Models Truly Perform Multimodal In-Context Learning?cited by 31
  3. 2023How to Configure Good In-Context Sequence for Visual Question Answeringcited by 31
  4. 2024What Factors Affect Multi-Modal In-Context Learning? An In-Depth Explorationcited by 31
  5. 2024SafeInfer: Context Adaptive Decoding Time Safety Alignment for Large Language Modelscited by 22
  6. 2018Analyzing the hate and counter speech accounts on Twittercited by 21
  7. 2024MemeGuard: An LLM and VLM-based Framework for Advancing Content Moderation via Meme Interventioncited by 20
  8. 2024On Zero-Shot Counterspeech Generation by LLMscited by 17
  9. 2024Meme-ingful Analysis: Enhanced Understanding of Cyberbullying in Memes Through Multimodal Explanationscited by 13
  10. 2024Can MLLMs Perform Text-to-Image In-Context Learning?cited by 13
  11. 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencingcited by 12
  12. 2023MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched Contextualizationcited by 11
  13. 2024Navigating the Cultural Kaleidoscope: A Hitchhiker's Guide to Sensitivity in Large Language Modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.