# GAMED: Knowledge Adaptive Multi-Experts Decoupling for Multimodal Fake News Detection

arXiv: https://arxiv.org/abs/2412.12164 · HTML: https://mlsanity.com/paper/2412.12164/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 76 references that are in the map.
- First posted on arXiv 11 Dec 2024.

## Builds on (most cited first, 20 of 20)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning](https://mlsanity.com/paper/2305.06500/) (2023)
- [Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization](https://mlsanity.com/paper/1703.06868/) (2017)
- [LXMERT: Learning Cross-Modality Encoder Representations from Transformers](https://mlsanity.com/paper/1908.07490/) (2019)
- [Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning](https://mlsanity.com/paper/1602.07261/) (2016)
- [LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day](https://mlsanity.com/paper/2306.00890/) (2023)
- [FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios](https://mlsanity.com/paper/2307.13528/) (2023)
- [ERNIE 2.0: A Continual Pre-training Framework for Language Understanding](https://mlsanity.com/paper/1907.12412/) (2019)
- [Supervised Multimodal Bitransformers for Classifying Images and Text](https://mlsanity.com/paper/1909.02950/) (2019)
- [SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders](https://mlsanity.com/paper/2206.10207/) (2022)
- [Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection](https://mlsanity.com/paper/2309.12247/) (2023)
- [Embracing Domain Differences in Fake News: Cross-domain Fake News Detection using Multi-modal Data](https://mlsanity.com/paper/2102.06314/) (2021)
- [Multimodal Fake News Detection via CLIP-Guided Learning](https://mlsanity.com/paper/2205.14304/) (2022)
- [LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentation](https://mlsanity.com/paper/2402.11943/) (2024)
- [Bootstrapping Multi-view Representations for Fake News Detection](https://mlsanity.com/paper/2206.05741/) (2022)
- [TI-CNN: Convolutional Neural Networks for Fake News Detection](https://mlsanity.com/paper/1806.00749/) (2018)
- [Characteristics and prevalence of fake social media profiles with AI-generated faces](https://mlsanity.com/paper/2401.02627/) (2024)
- [BotDGT: Dynamicity-aware Social Bot Detection with Dynamic Graph Transformers](https://mlsanity.com/paper/2404.15070/) (2024)
- [Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning](https://mlsanity.com/paper/2402.11816/) (2024)
- [How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models](https://mlsanity.com/paper/2407.00369/) (2024)

## Built on by (most cited first, 11 of 11)

- [Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection](https://mlsanity.com/paper/2504.05411/) (2025)
- [The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection](https://mlsanity.com/paper/2601.15316/) (2026)
- [LL4G: Self-Supervised Dynamic Optimization for Graph-Based Personality Detection](https://mlsanity.com/paper/2504.02146/) (2025)
- [Remember Past, Anticipate Future: Learning Continual Multimodal Misinformation Detectors](https://mlsanity.com/paper/2507.05939/) (2025)
- [EmoPerso: Enhancing Personality Detection with Self-Supervised Emotion-Aware Modelling](https://mlsanity.com/paper/2509.02450/) (2025)
- [CALM: Culturally Self-Aware Language Models](https://mlsanity.com/paper/2601.03483/) (2026)
- [E-CaTCH: Event-Centric Cross-Modal Attention with Temporal Consistency and Class-Imbalance Handling for Misinformation Detection](https://mlsanity.com/paper/2508.11197/) (2025)
- [HIPPD: Brain-Inspired Hierarchical Information Processing for Personality Detection](https://mlsanity.com/paper/2510.09893/) (2025)
- [Agentic Multi-Persona Framework for Evidence-Aware Fake News Detection](https://mlsanity.com/paper/2512.21039/) (2025)
- [SARC: Sentiment-Augmented Deep Role Clustering for Fake News Detection](https://mlsanity.com/paper/2511.04692/) (2025)
- [Multimodal Climate Disinformation Detection: Integrating Vision-Language Models with External Knowledge Sources](https://mlsanity.com/paper/2601.16108/) (2026)

## Abstract (arXiv)

Multimodal fake news detection often involves modelling heterogeneous data sources, such as vision and language. Existing detection methods typically rely on fusion effectiveness and cross-modal consistency to model the content, complicating understanding how each modality affects prediction accuracy. Additionally, these methods are primarily based on static feature modelling, making it difficult to adapt to the dynamic changes and relationships between different data modalities. This paper develops a significantly novel approach, GAMED, for multimodal modelling, which focuses on generating distinctive and discriminative features through modal decoupling to enhance cross-modal synergies, thereby optimizing overall performance in the detection process. GAMED leverages multiple parallel expert networks to refine features and pre-embed semantic knowledge to improve the experts' ability in information selection and viewpoint sharing. Subsequently, the feature distribution of each modality is adaptively adjusted based on the respective experts' opinions. GAMED also introduces a novel classification technique to dynamically manage contributions from different modalities, while improving the explainability of decisions. Experimental results on the Fakeddit and Yang datasets demonstrate that GAMED performs better than recently developed state-of-the-art models. The source code can be accessed at https://github.com/slz0925/GAMED.
