PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detection
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The rapid rise of synthetic media has made deepfake detection a critical challenge for online safety and trust. Progress remains constrained by the scarcity of large, high-quality datasets. Although multimodal large language models (LLMs) exhibit strong reasoning capabilities, their performance on deepfake detection is poor, often producing explanations that are misaligned with visual evidence or hallucinatory. To address this limitation, we introduce a reasoning-annotated dataset for deepfake detection and propose Paragraph-level Relative Policy Optimization (PRPO), a reinforcement learning algorithm that aligns LLM reasoning with image content at the paragraph level. Experiments show that PRPO improves detection accuracy by a wide margin and achieves the highest reasoning score of 4.55/5.0. Ablation studies further demonstrate that PRPO significantly outperforms GRPO under test-time conditions. These results underscore the importance of grounding multimodal reasoning in visual evidence to enable more reliable and interpretable deepfake detection.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 60 of its 83 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
60 of 83 references.
Closest ancestors · 1
Same direction, newest first
Other references · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Visual Instruction Tuningcited by 7,869
38 more
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2022A ConvNet for the 2020scited by 3,579
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2022Video Diffusion Modelscited by 2,305
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2025Process Reinforcement through Implicit Rewardscited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2020The Creation and Detection of Deepfakes: A Surveycited by 247
- 2025Learning to Reason without External Rewardscited by 210
- 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2024Pixtral 12Bcited by 179
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2022Towards the Detection of Diffusion Model Deepfakescited by 111
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2019Deep Learning for Deepfakes Creation and Detection: A Surveycited by 102
- 2021SiT: Self-supervised vIsion Transformercited by 99
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 66
- 2024Common Sense Reasoning for Deepfake Detectioncited by 65
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
- 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Modelscited by 3
- 2026Evidence Packing for Cross-Domain Image Deepfake Detection with LVLMscited by 0
- 2026Specialist-Generalist Fusion with Outcome-Supervised Rationales for Deepfake Detectioncited by 0
- 2026MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Taskscited by 0
- 2026MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Tasks27 Sep 2026
- 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models14 Jun 2026
- 2026Specialist-Generalist Fusion with Outcome-Supervised Rationales for Deepfake Detection29 May 2026
- 2026Evidence Packing for Cross-Domain Image Deepfake Detection with LVLMs18 Mar 2026
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detection18 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detection
- 2026MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models
- 2025Can Multi-modal (reasoning) LLMs work as deepfake detectors?
- 2025AuthGuard: Generalizable Deepfake Detection via Language Guidance
- 2025TruthLens:A Training-Free Paradigm for DeepFake Detection
- 2026VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection
- 2025LLMs Are Not Yet Ready for Deepfake Image Detection
- 2025RAIDX: A Retrieval-Augmented Generation and GRPO Reinforcement Learning Framework for Explainable Deepfake Detection