mlsanityData to 7 Oct 2026

The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection

arXiv 2601.15316 ↗First posted 16 Jan 2026cs.AI cs.CVcited by 6

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

In recent years, the rapid evolution of large vision-language models (LVLMs) has driven a paradigm shift in multimodal fake news detection (MFND), transforming it from traditional feature-engineering approaches to unified, end-to-end multimodal reasoning frameworks. Early methods primarily relied on shallow fusion techniques to capture correlations between text and images, but they struggled with high-level semantic understanding and complex cross-modal interactions. The emergence of LVLMs has fundamentally changed this landscape by enabling joint modeling of vision and language with powerful representation learning, thereby enhancing the ability to detect misinformation that leverages both textual narratives and visual content. Despite these advances, the field lacks a systematic survey that traces this transition and consolidates recent developments. To address this gap, this paper provides a comprehensive review of MFND through the lens of LVLMs. We first present a historical perspective, mapping the evolution from conventional multimodal detection pipelines to foundation model-driven paradigms. Next, we establish a structured taxonomy covering model architectures, datasets, and performance benchmarks. Furthermore, we analyze the remaining technical challenges, including interpretability, temporal reasoning, and domain generalization. Finally, we outline future research directions to guide the next stage of this paradigm shift. To the best of our knowledge, this is the first comprehensive survey to systematically document and analyze the transformative role of LVLMs in combating multimodal fake news. The summary of existing methods mentioned is in our Github: hrefhttps://github.com/Tan-YiLong/Overview-of-Fake-News-Detectionhttps://github.com/Tan-YiLong/Overview-of-Fake-News-Detection.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 141 of its 253 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

141 of 253 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Debunk and Infer: Multimodal Fake News Detection via Diffusion-Generated Evidence and LLM Reasoning11 Jun
  2. 2025CMIE: Combining MLLM Insights with External Evidence for Explainable Out-of-Context Misinformation Detection29 May
  3. 2024MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language Models17 Jun

Other references · 138

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2024GPT-4o System Cardcited by 4,467
  10. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  11. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  12. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
38 more
  1. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  3. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  4. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  8. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  9. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2024Qwen2 Technical Reportcited by 2,076
  12. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  13. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  14. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  15. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  16. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
  17. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  18. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  19. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  20. 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 626
  21. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  22. 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 548
  23. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
  24. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  25. 2024InternLM2 Technical Reportcited by 391
  26. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
  27. 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
  28. 2023PandaGPT: One Model To Instruction-Follow Them Allcited by 330
  29. 2021An Empirical Study of Training End-to-End Vision-and-Language Transformerscited by 271
  30. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  31. 2024Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decodingcited by 198
  32. 2017Automatic Detection of Fake Newscited by 145
  33. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  34. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
  35. 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 105
  36. 2017CSI: A Hybrid Deep Model for Fake News Detectioncited by 101
  37. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
  38. 2017Beyond News Contents: The Role of Social Context for Fake News Detectioncited by 91

50 most cited of 138 All 138 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Large Visual-Language Models Are Also Good Classifiers: A Study of In-Context Multimodal Fake News Detection
  2. 2024CoVLM: Leveraging Consensus from Vision-Language Models for Semi-supervised Multi-modal Fake News Detection
  3. 2025KGAlign: Joint Semantic-Structural Knowledge Encoding for Multimodal Fake News Detection
  4. 2025MM-FusionNet: Context-Aware Dynamic Fusion for Multi-modal Fake News Detection with Large Vision-Language Models
  5. 2026Retrieval-Augmented Multimodal Model for Fake News Detection
  6. 2025Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baseline
  7. 2026Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modality
  8. 2026Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?