mlsanityData to 7 Oct 2026

Image-Text Out-Of-Context Detection Using Synthetic Multimodal Misinformation

arXiv 2403.08783 ↗First posted 29 Jan 2024cs.CV cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Misinformation has become a major challenge in the era of increasing digital information, requiring the development of effective detection methods. We have investigated a novel approach to Out-Of-Context detection (OOCD) that uses synthetic data generation. We created a dataset specifically designed for OOCD and developed an efficient detector for accurate classification. Our experimental findings validate the use of synthetic data generation and demonstrate its efficacy in addressing the data limitations associated with OOCD. The dataset and detector should serve as valuable resources for future research and the development of robust misinformation detection systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 41 of its 53 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

41 of 53 references.

References · 41

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2017Neural Discrete Representation Learningcited by 4,650
29 more
  1. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  2. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  3. 2013Auto-Encoding Variational Bayescited by 3,980
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  5. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
  6. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  7. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
  8. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  9. 2017Generative Adversarial Networks: An Overviewcited by 588
  10. 2021ClipCap: CLIP Prefix for Image Captioningcited by 557
  11. 2019Defending Against Neural Fake Newscited by 553
  12. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  13. 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
  14. 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 281
  15. 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
  16. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
  17. 2022PromptCap: Prompt-Guided Task-Aware Image Captioningcited by 104
  18. 2022Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Trainingcited by 88
  19. 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
  20. 2020Detecting Cross-Modal Inconsistency to Defend Against Neural Fake Newscited by 41
  21. 2020Multimodal Analytics for Real-world News using Measures of Cross-modal Entity Consistencycited by 33
  22. 2018Deep Multimodal Image-Repurposing Detectioncited by 31
  23. 2017Multimedia Semantic Integrity Assessment Using Joint Embedding Of Images And Textcited by 28
  24. 2021COSMOS: Catching Out-of-Context Misinformation with Self-Supervised Learningcited by 26
  25. 2020Generalized Zero and Few-Shot Transfer for Facial Forgery Detectioncited by 18
  26. 2021Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformationcited by 16
  27. 2021Multi-Modal Semantic Inconsistency Detection in Social Media News Postscited by 10
  28. 2023Interpretable Detection of Out-of-Context Misinformation with Neural-Symbolic-Enhanced Large Multimodal Modelcited by 8
  29. 2019AIRD: Adversarial Learning Framework for Image Repurposing Detectioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.