mlsanityData to 7 Oct 2026

Findings of Factify 2: Multimodal Fake News Detection

arXiv 2307.10475 ↗First posted 19 Jul 2023cs.CL cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

With social media usage growing exponentially in the past few years, fake news has also become extremely prevalent. The detrimental impact of fake news emphasizes the need for research focused on automating the detection of false information and verifying its accuracy. In this work, we present the outcome of the Factify 2 shared task, which provides a multi-modal fact verification and satire news dataset, as part of the DeFactify 2 workshop at AAAI'23. The data calls for a comparison based approach to the task by pairing social media claims with supporting documents, with both text and image, divided into 5 classes based on multi-modal relations. In the second iteration of this task we had over 60 participants and 9 final test-set submissions. The best performances came from the use of DeBERTa for text and Swinv2 and CLIP for image. The highest F1 score averaged for all five classes was 81.82%.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 22 of its 42 references that are in the map. First posted on arXiv 19 Jul 2023.

Builds on

22 of 42 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  3. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  4. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  5. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  6. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  7. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
  8. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  9. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  10. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
  11. 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 281
  12. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
10 more
  1. 2020Fighting an Infodemic: COVID-19 Fake News Datasetcited by 82
  2. 2019r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detectioncited by 53
  3. 2021A Survey on Multimodal Disinformation Detectioncited by 47
  4. 2023Factify 2: A Multimodal Fake News and Satire News Datasetcited by 23
  5. 2021Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detectioncited by 15
  6. 2023Team Triple-Check at Factify 2: Parameter-Efficient Large Foundation Models with Feature Representations for Multi-Modal Fact Verificationcited by 7
  7. 2021Memotion Analysis through the Lens of Joint Embeddingcited by 6
  8. 2023IMAGINATOR: Pre-Trained Image+Text Joint Embeddings using Word-Level Grounding of Imagescited by 4
  9. 2023INO at Factify 2: Structure Coherence based Multi-Modal Fact Verificationcited by 3
  10. 2023Logically at Factify 2: A Multi-Modal Fact Checking System Based on Evidence Retrieval techniques and Transformer Encoder Architecturecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 1; 2025: 2; 2026: 2.

7 papers.

  1. 2023RED-DOT: Multimodal Fact-checking via Relevant Evidence Detectioncited by 18
  2. 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
  3. 2025A Comprehensive Dataset for Human vs. AI Generated Text Detectioncited by 3
  4. 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
  5. 2024Overview of Factify5WQA: Fact Verification through 5W Question-Answeringcited by 2
  6. 2023MalFake: A Multimodal Fake News Identification for Malayalam using Recurrent Neural Networks and VGG-16cited by 0
  7. 2026Evidence Triangulation for Multimodal Fact-Checking in the Wildcited by 0