mlsanityData to 7 Oct 2026

Exposing Cross-Modal Consistency for Fake News Detection in Short-Form Videos

arXiv 2603.14992 ↗First posted 16 Mar 2026cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Short-form video platforms are major channels for news but also fertile ground for multimodal misinformation where each modality appears plausible alone yet cross-modal relationships are subtly inconsistent, like mismatched visuals and captions. On two benchmark datasets, FakeSV (Chinese) and FakeTT (English), we observe a clear asymmetry: real videos exhibit high text-visual but moderate text-audio consistency, while fake videos show the opposite pattern. Moreover, a single global consistency score forms an interpretable axis along which fake probability and prediction errors vary smoothly. Motivated by these observations, we present MAGIC3 (Modal-Adversarial Gated Interaction and Consistency-Centric Classifier), a detector that explicitly models and exposes cross-tri-modal consistency signals at multiple granularities. MAGIC3 combines explicit pairwise and global consistency modeling with token- and frame-level consistency signals derived from cross-modal attention, incorporates multi-style LLM rewrites to obtain style-robust text representations, and employs an uncertainty-aware classifier for selective VLM routing. Using pre-extracted features, MAGIC3 consistently outperforms the strongest non-VLM baselines on FakeSV and FakeTT. While matching VLM-level accuracy, the two-stage system achieves 18-27x higher throughput and 93% VRAM savings, offering a strong cost-performance tradeoff.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 24 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

8 of 24 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2017Beyond News Contents: The Role of Social Context for Fake News Detectioncited by 91
  4. 2022FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platformscited by 41
  5. 2020Multimodal Analytics for Real-world News using Measures of Cross-modal Entity Consistencycited by 33
  6. 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Processcited by 25
  7. 2024ExHuBERT: Enhancing HuBERT Through Block Extension and Fine-Tuning on 37 Emotion Datasetscited by 11
  8. 2025Consistency-aware Fake Videos Detection on Short Video Platformscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Modality Interactive Mixture-of-Experts for Fake News Detection
  2. 2025Exploring Modality Disruption in Multimodal Fake News Detection
  3. 2023Interpretable Detection of Out-of-Context Misinformation with Neural-Symbolic-Enhanced Large Multimodal Model
  4. 2026HyperClaim: Fine-Grained Cross-Modal Hypergraph Reasoning for Video Misinformation Detection
  5. 2026Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modality
  6. 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection
  7. 2025MM-FusionNet: Context-Aware Dynamic Fusion for Multi-modal Fake News Detection with Large Vision-Language Models
  8. 2025Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baseline