DF-LLaVA: Unlocking MLLMs for Synthetic Image Detection via Knowledge Injection and Conflict-Driven Self-Reflection
Not on the map. Why?
Abstract (arXiv)
With the increasing prevalence of synthetic images, evaluating image authenticity and locating forgeries accurately while maintaining human interpretability remains a challenging task. Existing detection models primarily focus on simple authenticity classification, ultimately providing only a forgery probability or binary judgment, which offers limited explanatory insights into image authenticity. Moreover, while MLLM-based detection methods can provide more interpretable results, they still lag behind expert models in terms of pure authenticity classification accuracy. To address this, we propose DF-LLaVA, a novel and effective framework that unlocks the intrinsic discrimination potential of MLLMs. Our approach first mines latent knowledge from the MLLM itself and then injects it into the model via fine-tuning. During inference, conflict signals arising from the model's predictions activate a self-reflection process, leading to the final refined responses. This framework allows LLaVA to achieve outstanding detection accuracy exceeding expert models while still maintaining the interpretability offered by MLLMs. Extensive experiments confirm the superiority of DF-LLaVA, achieving both high accuracy and explainability in synthetic image detection. Code is available online at: https://github.com/Eliot-Shen/DF-LLaVA.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 63 references that are in the map. First posted on arXiv 18 Sep 2025.
Builds on
37 of 63 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023Teaching Large Language Models to Self-Debugcited by 988
25 more
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 323
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 238
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2020Learning Self-Consistency for Deepfake Detectioncited by 179
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 69
- 2024Vision-Language Models Can Self-Improve Reasoning via Reflectioncited by 69
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2024KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generationcited by 67
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
- 2025Qwen Look Again: Guiding Vision-Language Reasoning Models to Re-attention Visual Informationcited by 28
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection
- 2025Identity-Aware Vision-Language Model for Explainable Face Forgery Detection
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection
- 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline
- 2025Explainable Detection of AI-Generated Images with Artifact Localization Using Faster-Than-Lies and Vision-Language Models for Edge Devices
- 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Models
- 2026DVAR: Adversarial Multi-Agent Debate for Video Authenticity Detection