mlsanityData to 14 Oct 2026

PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detection

arXiv 2509.26272 ↗First posted 30 Sep 2025cs.CV cs.LGcited by 5

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

The rapid rise of synthetic media has made deepfake detection a critical challenge for online safety and trust. Progress remains constrained by the scarcity of large, high-quality datasets. Although multimodal large language models (LLMs) exhibit strong reasoning capabilities, their performance on deepfake detection is poor, often producing explanations that are misaligned with visual evidence or hallucinatory. To address this limitation, we introduce a reasoning-annotated dataset for deepfake detection and propose Paragraph-level Relative Policy Optimization (PRPO), a reinforcement learning algorithm that aligns LLM reasoning with image content at the paragraph level. Experiments show that PRPO improves detection accuracy by a wide margin and achieves the highest reasoning score of 4.55/5.0. Ablation studies further demonstrate that PRPO significantly outperforms GRPO under test-time conditions. These results underscore the importance of grounding multimodal reasoning in visual evidence to enable more reliable and interpretable deepfake detection.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 60 of its 83 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

60 of 83 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Improve Vision Language Model Chain-of-thought Reasoning21 Oct

Other references · 59

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2017Proximal Policy Optimization Algorithmscited by 15,215
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  8. 2020Denoising Diffusion Implicit Modelscited by 9,781
  9. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  11. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  12. 2023Visual Instruction Tuningcited by 7,869
38 more
  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  10. 2017Deep reinforcement learning from human preferencescited by 3,912
  11. 2022A ConvNet for the 2020scited by 3,579
  12. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  13. 2022Video Diffusion Modelscited by 2,305
  14. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  15. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  16. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  17. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  18. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  19. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  20. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  21. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  22. 2025Process Reinforcement through Implicit Rewardscited by 504
  23. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  24. 2025TTRL: Test-Time Reinforcement Learningcited by 275
  25. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  26. 2025Learning to Reason without External Rewardscited by 210
  27. 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
  28. 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
  29. 2024Pixtral 12Bcited by 179
  30. 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
  31. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  32. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  33. 2022Towards the Detection of Diffusion Model Deepfakescited by 111
  34. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  35. 2019Deep Learning for Deepfakes Creation and Detection: A Surveycited by 102
  36. 2021SiT: Self-supervised vIsion Transformercited by 99
  37. 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 66
  38. 2024Common Sense Reasoning for Deepfake Detectioncited by 65

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detection
  2. 2026MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models
  3. 2025Can Multi-modal (reasoning) LLMs work as deepfake detectors?
  4. 2025AuthGuard: Generalizable Deepfake Detection via Language Guidance
  5. 2025TruthLens:A Training-Free Paradigm for DeepFake Detection
  6. 2026VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection
  7. 2025LLMs Are Not Yet Ready for Deepfake Image Detection
  8. 2025RAIDX: A Retrieval-Augmented Generation and GRPO Reinforcement Learning Framework for Explainable Deepfake Detection