mlsanityData to 14 Oct 2026

Learning Domain-Invariant Features for Out-of-Context News Detection

arXiv 2406.07430 ↗First posted 11 Jun 2024cs.CL cs.MMcited by 3

Not on the map. Why?

Abstract (arXiv)

Out-of-context news is a common type of misinformation on online media platforms. This involves posting a caption, alongside a mismatched news image. Existing out-of-context news detection models only consider the scenario where pre-labeled data is available for each domain, failing to address the out-of-context news detection on unlabeled domains (e.g. news topics or agencies). In this work, we therefore focus on domain adaptive out-of-context news detection. In order to effectively adapt the detection model to unlabeled news topics or agencies, we propose ConDA-TTA (Contrastive Domain Adaptation with Test-Time Adaptation) which applies contrastive learning and maximum mean discrepancy (MMD) to learn domain-invariant features. In addition, we leverage test-time target domain statistics to further assist domain adaptation. Experimental results show that our approach outperforms baselines in most domain adaptation settings on two public datasets, by as much as 2.93% in F1 and 2.08% in accuracy.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 47 references that are in the map. First posted on arXiv 11 Jun 2024.

Builds on

25 of 47 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  3. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  4. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  5. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
  6. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
  7. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  8. 2020What Makes for Good Views for Contrastive Learning?cited by 846
  9. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 469
  10. 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 415
  11. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
  12. 2016Revisiting Batch Normalization For Practical Domain Adaptationcited by 288
13 more
  1. 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
  2. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 107
  3. 2024SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detectioncited by 74
  4. 2023DELTA: degradation-free fully test-time adaptationcited by 72
  5. 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
  6. 2023ConDA: Contrastive Domain Adaptation for AI-generated Text Detectioncited by 37
  7. 2022Zero-Shot Rumor Detection with Propagation Structure via Prompt Learningcited by 32
  8. 2022Domain Adaptive Fake News Detection via Reinforcement Learningcited by 27
  9. 2024Adapting to Distribution Shift by Visual Domain Prompt Generationcited by 23
  10. 2023Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformationcited by 21
  11. 2022Improving Fake News Detection of Influential Domain via Domain- and Instance-Level Transfercited by 19
  12. 2021Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformationcited by 16
  13. 2024Leveraging Chat-Based Large Vision Language Models for Multimodal Out-Of-Context Detectioncited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.

  1. 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?cited by 11
  2. 2025E2LVLM:Evidence-Enhanced Large Vision-Language Model for Multimodal Out-of-Context Misinformation Detectioncited by 7
  3. 2025Out-of-Context Misinformation Detection via Variational Domain-Invariant Learning with Test-Time Trainingcited by 1