AOMD: An Analogy-aware Approach to Offensive Meme Detection on Social Media
Not on the map. Why?
Abstract (arXiv)
This paper focuses on an important problem of detecting offensive analogy meme on online social media where the visual content and the texts/captions of the meme together make an analogy to convey the offensive information. Existing offensive meme detection solutions often ignore the implicit relation between the visual and textual contents of the meme and are insufficient to identify the offensive analogy memes. Two important challenges exist in accurately detecting the offensive analogy memes: i) it is not trivial to capture the analogy that is often implicitly conveyed by a meme; ii) it is also challenging to effectively align the complex analogy across different data modalities in a meme. To address the above challenges, we develop a deep learning based Analogy-aware Offensive Meme Detection (AOMD) framework to learn the implicit analogy from the multi-modal contents of the meme and effectively detect offensive analogy memes. We evaluate AOMD on two real-world datasets from online social media. Evaluation results show that AOMD achieves significant performance gains compared to state-of-the-art baselines by detecting offensive analogy memes more accurately.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 21 Jun 2021.
Builds on
24 of 47 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2016Hierarchical Question-Image Co-Attention for Visual Question Answeringcited by 278
- 2018A Comprehensive Survey of Deep Learning for Image Captioningcited by 213
- 2019Visual Semantic Reasoning for Image-Text Matchingcited by 185
- 2016Visual Question Answering: A Survey of Methods and Datasetscited by 123
12 more
- 2020SemEval-2020 Task 8: Memotion Analysis -- The Visuo-Lingual Metaphor!cited by 77
- 2017Attention-Based Multimodal Fusion for Video Descriptioncited by 75
- 2020Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challengecited by 51
- 2018Hate Speech Detection: A Solved Problem? The Challenging Case of Long Tail on Twittercited by 36
- 2017Anyone Can Become a Troll: Causes of Trolling Behavior in Online Discussionscited by 30
- 2018Improving Deep Visual Representation for Person Re-identification by Global and Local Image-language Associationcited by 29
- 2019Hate Speech in Pixels: Detection of Offensive Memes towards Automatic Moderationcited by 29
- 2018Automatic Detection of Cyberbullying in Social Media Textcited by 25
- 2017A Survey on Optical Character Recognition Systemcited by 23
- 2018A Visual Attention Grounding Neural Model for Multimodal Machine Translationcited by 22
- 2017Detecting the Hate Code on Social Mediacited by 16
- 2017"Like Sheep Among Wolves": Characterizing Hateful Users on Twittercited by 8
Built on by
Citing papers per year: 2022: 3; 2023: 2; 2024: 5; 2025: 1; 2026: 2.
13 papers.
Sort:
By area:
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2022DISARM: Detecting the Victims Targeted by Harmful Memescited by 20
- 2022What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memescited by 18
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
- 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencingcited by 12
- 2024Exploring the Limits of Zero Shot Vision Language Models for Hate Meme Detection: The Vulnerabilities and their Interpretationscited by 10
- 2024Deciphering Hate: Identifying Hateful Memes and Their Targetscited by 7
- 2024What Makes a Meme a Meme? Identifying Memes for Memetics-Aware Dataset Creationcited by 2
- 2025Representation Decomposition for Learning Similarity and Contrastness Across Modalities for Affective Computingcited by 2
- 2023Meme Sentiment Analysis Enhanced with Multimodal Spatial Encoding and Facial Embeddingcited by 1
- 2023Unimodal Intermediate Training for Multimodal Meme Sentiment Classificationcited by 1
- 2026Detecting Hate and Inflammatory Content in Bengali Memes: A New Multimodal Dataset and Co-Attention Frameworkcited by 0
- 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection17 Sep 2026
- 2026Detecting Hate and Inflammatory Content in Bengali Memes: A New Multimodal Dataset and Co-Attention Framework25 Feb 2026
- 2025Representation Decomposition for Learning Similarity and Contrastness Across Modalities for Affective Computing8 Jun 2025
- 2024What Makes a Meme a Meme? Identifying Memes for Memetics-Aware Dataset Creation16 Jul 2024
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities11 Jun 2024
- 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing18 May 2024
- 2024Deciphering Hate: Identifying Hateful Memes and Their Targets16 Mar 2024
- 2024Exploring the Limits of Zero Shot Vision Language Models for Hate Meme Detection: The Vulnerabilities and their Interpretations19 Feb 2024
- 2023Unimodal Intermediate Training for Multimodal Meme Sentiment Classification1 Aug 2023
- 2023Meme Sentiment Analysis Enhanced with Multimodal Spatial Encoding and Facial Embedding3 Mar 2023
- 2022What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memes1 Dec 2022
- 2022DISARM: Detecting the Victims Targeted by Harmful Memes11 May 2022
1 more
- 2022Detecting and Understanding Harmful Memes: A Survey9 May 2022
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2022DISARM: Detecting the Victims Targeted by Harmful Memescited by 20
- 2022What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memescited by 18
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
- 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencingcited by 12
- 2024Deciphering Hate: Identifying Hateful Memes and Their Targetscited by 7
- 2024What Makes a Meme a Meme? Identifying Memes for Memetics-Aware Dataset Creationcited by 2
- 2025Representation Decomposition for Learning Similarity and Contrastness Across Modalities for Affective Computingcited by 2
- 2023Meme Sentiment Analysis Enhanced with Multimodal Spatial Encoding and Facial Embeddingcited by 1
- 2023Unimodal Intermediate Training for Multimodal Meme Sentiment Classificationcited by 1
- 2026Detecting Hate and Inflammatory Content in Bengali Memes: A New Multimodal Dataset and Co-Attention Frameworkcited by 0
- 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detectioncited by 0
- 2026Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection17 Sep 2026
- 2026Detecting Hate and Inflammatory Content in Bengali Memes: A New Multimodal Dataset and Co-Attention Framework25 Feb 2026
- 2025Representation Decomposition for Learning Similarity and Contrastness Across Modalities for Affective Computing8 Jun 2025
- 2024What Makes a Meme a Meme? Identifying Memes for Memetics-Aware Dataset Creation16 Jul 2024
- 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities11 Jun 2024
- 2024MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing18 May 2024
- 2024Deciphering Hate: Identifying Hateful Memes and Their Targets16 Mar 2024
- 2023Unimodal Intermediate Training for Multimodal Meme Sentiment Classification1 Aug 2023
- 2023Meme Sentiment Analysis Enhanced with Multimodal Spatial Encoding and Facial Embedding3 Mar 2023
- 2022What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memes1 Dec 2022
- 2022DISARM: Detecting the Victims Targeted by Harmful Memes11 May 2022
- 2022Detecting and Understanding Harmful Memes: A Survey9 May 2022