MemeLens: Multilingual Multitask VLMs for Memes
Not on the map. Why?
Abstract (arXiv)
Memes are a dominant medium for online communication and manipulation because meaning emerges from interactions between embedded text, imagery, and cultural context. Existing meme research is distributed across tasks (e.g., textithate, misogyny, propaganda, sentiment, humour) and languages, which limits cross-domain generalization. To address this gap, we propose textscMemeLens, a unified multilingual, multitask explanation-enhanced Vision-Language Model (VLM) for meme understanding. We consolidate 38 public meme datasets, filter and map dataset-specific labels into a shared taxonomy of 20 tasks spanning harm, targets, figurative/pragmatic intent, and affect. We present a comprehensive empirical analysis across modeling paradigms, task categories, and datasets. Our findings suggest that robust meme understanding requires multimodal training, varies substantially across semantic categories, and remains sensitive to over-specialization when models are fine-tuned on individual datasets rather than trained in a unified setting. We make the experimental resources (https://github.com/MohamedBayan/MemeLens), model (https://huggingface.co/QCRI/MemeLens-VLM) and datasets (https://huggingface.co/datasets/QCRI/MemeLens) publicly available to the community.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 37 of its 83 references that are in the map. First posted on arXiv 18 Jan 2026.
Builds on
37 of 83 references.
References · 37
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2025Gemma 3 Technical Reportcited by 1,686
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2019Exploring Hate Speech Detection in Multimodal Publicationscited by 103
- 2020SemEval-2020 Task 8: Memotion Analysis -- The Visuo-Lingual Metaphor!cited by 77
25 more
- 2021Detecting Harmful Memes and Their Targetscited by 77
- 2023Prompting for Multimodal Hateful Meme Classificationcited by 68
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2023Decoding the Underlying Meaning of Multimodal Hateful Memescited by 38
- 2024MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classificationcited by 29
- 2024Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Modelscited by 26
- 2023Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learningcited by 20
- 2022What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memescited by 18
- 2023BanglaAbuseMeme: A Dataset for Bengali Abusive Meme Classificationcited by 18
- 2025MIND: A Multi-agent Framework for Zero-shot Harmful Meme Detectioncited by 14
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
- 2025Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisionscited by 13
- 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencingcited by 12
- 2025Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Studycited by 12
- 2024ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Contentcited by 11
- 2025Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detectioncited by 11
- 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMscited by 8
- 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memescited by 8
- 2025PropXplain: Can LLMs Enable Explainable Propaganda Detection?cited by 7
- 2025AdamMeme: Adaptively Probe the Reasoning Capacity of Multimodal Large Language Models on Harmfulnesscited by 7
- 2024LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Contentcited by 6
- 2025ExPO-HM: Learning to Explain-then-Detect for Hateful Meme Detectioncited by 6
- 2024RoMemes: A multimodal meme corpus for the Romanian languagecited by 3
- 2025On VLMs for Diverse Tasks in Multimodal Meme Classificationcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Adapting Reinforcement Learning with Chain-of-Thought Supervision for Explainable Detection of Hateful and Propagandistic Memescited by 1
- 2026MemeBench: What LVLMs Miss When Interpreting Culture-Dependent Memescited by 1
- 2026CritiSense: Critical Digital Literacy and Resilience Against Misinformationcited by 0
- 2026AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memescited by 0
- 2026ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Promptscited by 0
- 2026ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts24 Sep 2026
- 2026MemeBench: What LVLMs Miss When Interpreting Culture-Dependent Memes30 Jul 2026
- 2026AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memes29 Jul 2026
- 2026Adapting Reinforcement Learning with Chain-of-Thought Supervision for Explainable Detection of Hateful and Propagandistic Memes13 Jun 2026
- 2026CritiSense: Critical Digital Literacy and Resilience Against Misinformation17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025MemeReaCon: Probing Contextual Meme Understanding in Large Vision-Language Models
- 2026Beyond a Joke: Multi-Angle Reasoning for Detecting and Explaining Harmful Humor in Memes
- 2025Large Vision-Language Models for Knowledge-Grounded Data Annotation of Memes
- 2026From Native Memes to Global Moderation: Cross-Cultural Evaluation of Vision-Language Models for Hateful Meme Detection
- 2025Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Models
- 2026MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models
- 2025Detecting Offensive Memes with Social Biases in Singapore Context Using Multimodal Large Language Models
- 2026I Came, I Saw, I Explained: Benchmarking Multimodal LLMs on Figurative Meaning in Memes