mlsanityData to 14 Oct 2026

DisinfoMeme: A Multimodal Dataset for Detecting Meme Intentionally Spreading Out Disinformation

arXiv 2205.12617 ↗First posted 25 May 2022cs.CL cs.AI cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Disinformation has become a serious problem on social media. In particular, given their short format, visual attraction, and humorous nature, memes have a significant advantage in dissemination among online communities, making them an effective vehicle for the spread of disinformation. We present DisinfoMeme to help detect disinformation memes. The dataset contains memes mined from Reddit covering three current topics: the COVID-19 pandemic, the Black Lives Matter movement, and veganism/vegetarianism. The dataset poses multiple unique challenges: limited data and label imbalance, reliance on external knowledge, multimodal reasoning, layout dependency, and noise from OCR. We test multiple widely-used unimodal and multimodal models on this dataset. The experiments show that the room for improvement is still huge for current models.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 39 of its 66 references that are in the map. First posted on arXiv 25 May 2022.

Builds on

39 of 66 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  7. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  8. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  9. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  10. 2015VQA: Visual Question Answeringcited by 2,506
  11. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  12. 2019Towards VQA Models That Can Readcited by 1,718
27 more
  1. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  2. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  4. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
  5. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  6. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
  7. 2021Grounded Language-Image Pre-trainingcited by 1,156
  8. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  9. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  10. 2019Defending Against Neural Fake Newscited by 559
  11. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 556
  12. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
  13. 2019Unified Vision-Language Pre-Training for Image Captioning and VQAcited by 494
  14. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
  15. 2019Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-trainingcited by 451
  16. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  17. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
  18. 2019UNITER: UNiversal Image-TExt Representation Learningcited by 228
  19. 2019Gender Bias in Contextualized Word Embeddingscited by 203
  20. 2017Automatic Detection of Fake Newscited by 145
  21. 2022K-LITE: Learning Transferable Visual Models with External Knowledgecited by 79
  22. 2020Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based Visual Question Answeringcited by 51
  23. 2020Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challengecited by 51
  24. 2018On the Origins of Memes by Means of Fringe Web Communitiescited by 47
  25. 2021A Survey on Multimodal Disinformation Detectioncited by 47
  26. 2020Detecting Cross-Modal Inconsistency to Defend Against Neural Fake Newscited by 42
  27. 2022Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignmentcited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 6; 2024: 3; 2025: 0; 2026: 4.

13 papers.

Sort:

  1. 2023Multimodal Automated Fact-Checking: A Surveycited by 53
  2. 2023MemeCap: A Dataset for Captioning and Interpreting Memescited by 46
  3. 2023Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checkingcited by 35
  4. 2024MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classificationcited by 30
  5. 2024Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicitiescited by 13
  6. 2023TotalDefMeme: A Multi-Attribute Meme dataset on Total Defence in Singaporecited by 12
  7. 2023A Template Is All You Memecited by 9
  8. 2023Social Meme-ing: Measuring Linguistic Variation in Memescited by 5
  9. 2026M-QUEST -- Meme Question-Understanding Evaluation on Semantics and Toxicitycited by 3
  10. 2026Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classificationcited by 1
  11. 2024Hoaxpedia: A Unified Wikipedia Hoax Articles Datasetcited by 0
  12. 2026Unveiling Covert Toxicity in Multimodal Data via Toxicity Association Graphs: A Graph-Based Metric and Interpretable Detection Frameworkcited by 0
1 more
  1. 2026DARC-CLIP: Dynamic Adaptive Refinement with Cross-Attention for Meme Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Effectiveness of Large Multimodal Models in Detecting Disinformation: Experimental Results
  2. 2025Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisions
  3. 2024Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMs
  4. 2025From Recognition to Reasoning: Advancing Multimodal Harmful Meme Detection via Chain-of-Thought Alignment
  5. 2026MemeTrace: A Multimodal LLM-Based Agent for Safety-Aware Meme Provenance Analysis
  6. 2025MemeIntel: Explainable Detection of Propagandistic and Hateful Memes
  7. 2023FACTIFY3M: A Benchmark for Multimodal Fact Verification with Explainability through 5W Question-Answering
  8. 2025Improving Multimodal Hateful Meme Detection Exploiting LMM-Generated Knowledge