# Improving Fake News Detection by Using an Entity-enhanced Framework to Fuse Diverse Multimodal Clues

arXiv: https://arxiv.org/abs/2108.10509 · HTML: https://mlsanity.com/paper/2108.10509/

## Key facts

- Cited by 48 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Aug 2021.

## Built on by (most cited first, 30 of 48)

- [SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection](https://mlsanity.com/paper/2403.03170/) (2024)
- [Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection](https://mlsanity.com/paper/2309.12247/) (2023)
- [Multimodal Fake News Detection via CLIP-Guided Learning](https://mlsanity.com/paper/2205.14304/) (2022)
- [Generalizing to the Future: Mitigating Entity Bias in Fake News Detection](https://mlsanity.com/paper/2204.09484/) (2022)
- [FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMs](https://mlsanity.com/paper/2403.01988/) (2024)
- [Zoom Out and Observe: News Environment Perception for Fake News Detection](https://mlsanity.com/paper/2203.10885/) (2022)
- [Memory-Guided Multi-View Multi-Domain Fake News Detection](https://mlsanity.com/paper/2206.12808/) (2022)
- [Bootstrapping Multi-view Representations for Fake News Detection](https://mlsanity.com/paper/2206.05741/) (2022)
- [FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Process](https://mlsanity.com/paper/2407.16670/) (2024)
- [Let Silence Speak: Enhancing Fake News Detection with Generated Comments from Large Language Models](https://mlsanity.com/paper/2405.16631/) (2024)
- [Interpretable Multimodal Misinformation Detection with Logic Reasoning](https://mlsanity.com/paper/2305.05964/) (2023)
- [Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities](https://mlsanity.com/paper/2203.13883/) (2022)
- [Multi-modal Fake News Detection on Social Media via Multi-grained Information Fusion](https://mlsanity.com/paper/2304.00827/) (2023)
- [Combating Online Misinformation Videos: Characterization, Detection, and Future Directions](https://mlsanity.com/paper/2302.03242/) (2023)
- [Inconsistent Matters: A Knowledge-guided Dual-consistency Network for Multi-modal Rumor Detection](https://mlsanity.com/paper/2306.02137/) (2023)
- [Detecting Misinformation in Multimedia Content through Cross-Modal Entity Consistency: A Dual Learning Approach](https://mlsanity.com/paper/2409.00022/) (2024)
- [Exploiting User Comments for Early Detection of Fake News Prior to Users' Commenting](https://mlsanity.com/paper/2310.10429/) (2023)
- [TELLER: A Trustworthy Framework for Explainable, Generalizable and Controllable Fake News Detection](https://mlsanity.com/paper/2402.07776/) (2024)
- [Harmfully Manipulated Images Matter in Multimodal Misinformation Detection](https://mlsanity.com/paper/2407.19192/) (2024)
- [Characterizing Multi-Domain False News and Underlying User Effects on Chinese Weibo](https://mlsanity.com/paper/2205.03068/) (2022)
- [GAME-ON: Graph Attention Network based Multimodal Fusion for Fake News Detection](https://mlsanity.com/paper/2202.12478/) (2022)
- [Out-of-distribution Evidence-aware Fake News Detection via Dual Adversarial Debiasing](https://mlsanity.com/paper/2304.12888/) (2023)
- [Similarity-Aware Multimodal Prompt Learning for Fake News Detection](https://mlsanity.com/paper/2304.04187/) (2023)
- [Fake News Detection and Manipulation Reasoning via Large Vision-Language Models](https://mlsanity.com/paper/2407.02042/) (2024)
- [FactGuard: Agentic Video Misinformation Detection via Reinforcement Learning](https://mlsanity.com/paper/2602.22963/) (2026)
- [Exposing Text-Image Inconsistency Using Diffusion Models](https://mlsanity.com/paper/2404.18033/) (2024)
- [LLM-GAN: Construct Generative Adversarial Network Through Large Language Models For Explainable Fake News Detection](https://mlsanity.com/paper/2409.01787/) (2024)
- [Multimodal Inverse Attention Network with Intrinsic Discriminant Feature Exploitation for Fake News Detection](https://mlsanity.com/paper/2502.01699/) (2025)
- [KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection](https://mlsanity.com/paper/2507.09647/) (2025)
- [Emulating Reader Behaviors for Fake News Detection](https://mlsanity.com/paper/2306.15231/) (2023)

## Abstract (arXiv)

Recently, fake news with text and images have achieved more effective diffusion than text-only fake news, raising a severe issue of multimodal fake news detection. Current studies on this issue have made significant contributions to developing multimodal models, but they are defective in modeling the multimodal content sufficiently. Most of them only preliminarily model the basic semantics of the images as a supplement to the text, which limits their performance on detection. In this paper, we find three valuable text-image correlations in multimodal fake news: entity inconsistency, mutual enhancement, and text complementation. To effectively capture these multimodal clues, we innovatively extract visual entities (such as celebrities and landmarks) to understand the news-related high-level semantics of images, and then model the multimodal entity inconsistency and mutual enhancement with the help of visual entities. Moreover, we extract the embedded text in images as the complementation of the original text. All things considered, we propose a novel entity-enhanced multimodal fusion framework, which simultaneously models three cross-modal correlations to detect diverse multimodal fake news. Extensive experiments demonstrate the superiority of our model compared to the state of the art.