mlsanityData to 7 Oct 2026

Where Detectors Fail: Closing the Tail-Domain Gap with Expert-Guided Mutual Distillation

arXiv 2607.26555 ↗First posted 29 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal fake news detectors often generalize poorly across domains because they learn to trust unreliable evidence: domain-specific shortcuts amplified by imbalanced data and semantically inconsistent text-image pairs that make cross-modal evidence unreliable. We propose Expert-Guided Mutual Distillation (EGMD), which learns what evidence to trust across the prediction pipeline. At the input level, input-level calibration encodes pair-level coherence as a shared gain before fusion. At the representation level, an expert-guided teacher aligns domain statistics and encourages domain-specific patterns to concentrate in specialized experts. At the decision level, prototype-anchored domain-specific students use mutual learning and dual-channel distillation to inherit the teacher's feature geometry and calibrated predictions while discouraging local domain priors. We further construct Weibo_Balanced, a domain-balanced benchmark that isolates the effect of imbalance on generalization. Across four datasets in two languages, EGMD achieves state-of-the-art accuracy while reducing domain bias by up to 57.3%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

13 of 32 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021User Preference-aware Fake News Detectioncited by 76
  4. 2025Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecastingcited by 53
  5. 2021Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Cluescited by 48
  6. 2024Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learningcited by 47
  7. 2024Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillationcited by 21
  8. 2021The Authors Matter: Understanding and Mitigating Implicit Bias in Deep Text Classificationcited by 18
  9. 2024COMAE: COMprehensive Attribute Exploration for Zero-shot Hashingcited by 16
  10. 2023Multi-modal Fake News Detection on Social Media via Multi-grained Information Fusioncited by 15
  11. 2025Multi-Modal Multi-Behavior Sequential Recommendation with Conditional Diffusion-Based Feature Denoisingcited by 13
  12. 2023Frequency Spectrum is More Effective for Multimodal Representation and Fusion: A Multimodal Spectrum Rumor Detectorcited by 8
1 more
  1. 2025C2PO: Diagnosing and Disentangling Bias Shortcuts in LLMscited by 5

Built on by

Not cited yet.