mlsanityData to 14 Oct 2026

Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modality

arXiv 2604.09711 ↗First posted 8 Apr 2026cs.CV cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Multimodal fake news detection (MFND) aims to verify news credibility by jointly exploiting textual and visual evidence. However, real-world news dissemination frequently suffers from missing modality due to deleted images, corrupted screenshots, and similar issues. Thus, robust detection in this scenario requires preserving strong verification ability for each modality, which is challenging in MFND due to insufficient learning of the low-contribution modality and scarce unimodal annotations. To address this issue, we propose Head-wise Modality Specialization within Multimodal Large Language Models (MLLMs) for robust MFND under missing modality. Specifically, we first systematically study attention heads in MLLMs and their relationship with performance under missing modality, showing that modality-critical heads serve as key carriers of unimodal verification ability through their modality specialization. Based on this observation, to better preserve verification ability for the low-contribution modality, we introduce a head-wise specialization mechanism that explicitly allocates these heads to different modalities and preserves their specialization through lower-bound attention constraints. Furthermore, to better exploit scarce unimodal annotations, we propose a Unimodal Knowledge Retention strategy that prevents these heads from drifting away from the unimodal knowledge learned from limited supervision. Experiments show that our method improves robustness under missing modality while preserving performance with full multimodal input.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 40 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

11 of 40 references.

References · 11

  1. 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 856
  2. 2017Automatic Detection of Fake Newscited by 145
  3. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  4. 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 68
  5. 2024Unveiling Visual Perception in Language Models: An Attention Head Analysis Approachcited by 35
  6. 2019Learning Representations from Imperfect Time Series Data via Tensor Rank Regularizationcited by 30
  7. 2023Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attentioncited by 25
  8. 2024Each Fake News is Fake in its Own Way: An Attribution Multi-Granularity Benchmark for Multimodal Fake News Detectioncited by 11
  9. 2025Knowledge Bridger: Towards Training-free Missing Modality Completioncited by 9
  10. 2021Multimodal Fusion with BERT and Attention Mechanism for Fake News Detectioncited by 5
  11. 2024Fake News Detection and Manipulation Reasoning via Large Vision-Language Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection
  2. 2025Modality Interactive Mixture-of-Experts for Fake News Detection
  3. 2025Exploring Modality Disruption in Multimodal Fake News Detection
  4. 2024Large Visual-Language Models Are Also Good Classifiers: A Study of In-Context Multimodal Fake News Detection
  5. 2025MM-FusionNet: Context-Aware Dynamic Fusion for Multi-modal Fake News Detection with Large Vision-Language Models
  6. 2023Interpretable Detection of Out-of-Context Misinformation with Neural-Symbolic-Enhanced Large Multimodal Model
  7. 2025Perception, Understanding and Reasoning, A Multimodal Benchmark for Video Fake News Detection
  8. 2024CoVLM: Leveraging Consensus from Vision-Language Models for Semi-supervised Multi-modal Fake News Detection