MER-Bench: A Comprehensive Benchmark for Multimodal Meme Reappraisal
Not on the map. Why?
Abstract (arXiv)
Memes represent a tightly coupled, multimodal form of social expression, in which visual context and overlaid text jointly convey nuanced affect and commentary. Inspired by cognitive reappraisal in psychology, we introduce Meme Reappraisal, a novel multimodal generation task that aims to transform negatively framed memes into constructive ones while preserving their underlying scenario, entities, and structural layout. Unlike prior works on meme understanding or generation, Meme Reappraisal requires emotion-controllable, structure-preserving multimodal transformation under multiple semantic and stylistic constraints. To support this task, we construct MER-Bench, a benchmark of real-world memes with fine-grained multimodal annotations, including source and target emotions, positively rewritten meme text, visual editing specifications, and taxonomy labels covering visual type, sentiment polarity, and layout structure. We further propose a structured evaluation framework based on a multimodal large language model (MLLM)-as-a-Judge paradigm, decomposing performance into modality-level generation quality, affect controllability, structural fidelity, and global affective alignment. Extensive experiments across representative image-editing and multimodal-generation systems reveal substantial gaps in satisfying the constraints of structural preservation, semantic consistency, and affective transformation. We believe MER-Bench establishes a foundation for research on controllable meme editing and emotion-aware multimodal generation. Our code is available at: https://github.com/one-seven17/MER-Bench.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 64 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
43 of 64 references.
References · 43
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025Qwen-Image Technical Reportcited by 973
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
31 more
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
- 2025LongCat-Image Technical Reportcited by 92
- 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
- 2024EmoBench: Evaluating the Emotional Intelligence of Large Language Modelscited by 53
- 2024GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abusecited by 50
- 2023MemeCap: A Dataset for Captioning and Interpreting Memescited by 46
- 2024EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Modelscited by 35
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 35
- 2024Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecturecited by 28
- 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 27
- 2024XMeCap: Meme Caption Generation with Sub-Image Adaptabilitycited by 14
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
- 2023Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memescited by 12
- 2024MM-InstructEval: Zero-Shot Evaluation of (Multimodal) Large Language Models on Multimodal Reasoning Taskscited by 11
- 2024MemeCraft: Contextual and Stance-Driven Multimodal Meme Generationcited by 9
- 2024MOSABench: Multi-Object Sentiment Analysis Benchmark for Evaluating Multimodal Large Language Models Understanding of Complex Imagecited by 9
- 2025STATE ToxiCN: A Benchmark for Span-level Target-Aware Toxicity Extraction in Chinese Hate Speech Detectioncited by 9
- 2026XInsight: Integrative Stage-Consistent Psychological Counseling Support Agents for Digital Well-Beingcited by 9
- 2020memeBot: Towards Automatic Image Meme Generationcited by 8
- 2024Emotion-Aware Multimodal Fusion for Meme Emotion Detectioncited by 7
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modelingcited by 7
- 2024Sentiment-enhanced Graph-based Sarcasm Explanation in Dialoguecited by 6
- 2025Task-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusioncited by 5
- 2019Memeify: A Large-Scale Meme Generation Systemcited by 4
- 2025MemeReaCon: Probing Contextual Meme Understanding in Large Vision-Language Modelscited by 4
- 2025HUMORCHAIN: Theory-Guided Multi-Stage Reasoning for Interpretable Multimodal Humor Generationcited by 4
- 2025EmoCtrl: Controllable Emotional Image Content Generationcited by 4
- 2024LOLgorithm: Integrating Semantic,Syntactic and Contextual Elements for Humor Classificationcited by 2
- 2025From Perception to Punchline: Empowering VLM with the Art of In-the-wild Memecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing Meme Emotion Understanding with Multi-Level Modality Enhancement and Dual-Stage Modal Fusion
- 2026MemeLens: Multilingual Multitask VLMs for Memes
- 2025Large Vision-Language Models for Knowledge-Grounded Data Annotation of Memes
- 2026I Came, I Saw, I Explained: Benchmarking Multimodal LLMs on Figurative Meaning in Memes
- 2023A Review of Vision-Language Models and their Performance on the Hateful Memes Challenge
- 2023Socratis: Are large multimodal models emotionally aware?
- 2023Mapping Memes to Words for Multimodal Hateful Meme Classification
- 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization