mlsanityData to 7 Oct 2026

EvolveReason: Self-Evolving Reasoning Paradigm for Explainable Deepfake Facial Image Identification

arXiv 2603.07515 ↗First posted 8 Mar 2026cs.CVcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data

Abstract (arXiv)

With the rapid advancement of AIGC technology, developing identification methods to address the security challenges posed by deepfakes has become urgent. Face forgery identification techniques can be categorized into two types: traditional classification methods and explainable VLM approaches. The former provides classification results but lacks explanatory ability, while the latter, although capable of providing coarse-grained explanations, often suffers from hallucinations and insufficient detail. To overcome these limitations, we propose EvolveReason, which mimics the reasoning and observational processes of human auditors when identifying face forgeries. By constructing a chain-of-thought dataset, CoT-Face, tailored for advanced VLMs, our approach guides the model to think in a human-like way, prompting it to output reasoning processes and judgment results. This provides practitioners with reliable analysis and helps alleviate hallucination. Additionally, our framework incorporates a forgery latent-space distribution capture module, enabling EvolveReason to identify high-frequency forgery cues difficult to extract from the original images. To further enhance the reliability of textual explanations, we introduce a self-evolution exploration strategy, leveraging reinforcement learning to allow the model to iteratively explore and optimize its textual descriptions in a two-stage process. Experimental results show that EvolveReason not only outperforms the current state-of-the-art methods in identification performance but also accurately identifies forgery details and demonstrates generalization capabilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 44 of its 50 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

44 of 50 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  7. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  8. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  9. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  10. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  11. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
  12. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
32 more
  1. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  2. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  3. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  4. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  5. 2023DIRE for Diffusion-Generated Image Detectioncited by 386
  6. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
  7. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
  8. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
  9. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  10. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 124
  11. 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
  12. 2021Representative Forgery Mining for Fake Face Detectioncited by 108
  13. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
  14. 2020DeepFake Detection by Analyzing Convolutional Tracescited by 81
  15. 2024Preserving Fairness Generalization in Deepfake Detectioncited by 70
  16. 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
  17. 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 68
  18. 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
  19. 2024Common Sense Reasoning for Deepfake Detectioncited by 64
  20. 2023T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Mixed Large Language Model Signals for Science Question Answeringcited by 59
  21. 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 59
  22. 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Modelscited by 51
  23. 2024Interleaved-Modal Chain-of-Thoughtcited by 47
  24. 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
  25. 2020FakeLocator: Robust Localization of GAN-Based Face Manipulationscited by 40
  26. 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detectioncited by 40
  27. 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
  28. 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
  29. 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
  30. 2025Toward Generalizable Forgery Detection and Reasoningcited by 20
  31. 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detectioncited by 3
  32. 2025CorrDetail: Visual Detail Enhanced Self-Correction for Face Forgery Detectioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Identity-Aware Vision-Language Model for Explainable Face Forgery Detection
  2. 2025DevFD: Developmental Face Forgery Detection by Learning Shared and Orthogonal LoRA Subspaces
  3. 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector
  4. 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning
  5. 2024A Hitchhikers Guide to Fine-Grained Face Forgery Detection Using Common Sense Reasoning
  6. 2026Perception, Verdict, and Evolution: Hindsight-Driven Self-Refining Forensics Agent for AI-Generated Image Detection
  7. 2025LLMs Are Not Yet Ready for Deepfake Image Detection
  8. 2024Deepfake Generation and Detection: A Benchmark and Survey