mlsanityData to 14 Oct 2026

AvatarShield: Visual Reinforcement Learning for Human-Centric Synthetic Video Detection

arXiv 2505.15173 ↗First posted 21 May 2025cs.CV cs.AIcited by 6

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Recent advances in Artificial Intelligence Generated Content have led to highly realistic synthetic videos, particularly in human-centric scenarios involving speech, gestures, and full-body motion, posing serious threats to information authenticity and public trust. Unlike DeepFake techniques that focus on localized facial manipulation, human-centric video generation methods can synthesize entire human bodies with controllable movements, enabling complex interactions with environments, objects, and even other people. However, existing detection methods largely overlook the growing risks posed by such full-body synthetic content. Meanwhile, a growing body of research has explored leveraging LLMs for interpretable fake detection, aiming to explain decisions in natural language. Yet these approaches heavily depend on supervised fine-tuning, which introduces limitations such as annotation bias, hallucinated supervision, and weakened generalization. To address these challenges, we propose AvatarShield, a novel multimodal human-centric synthetic video detection framework that eliminates the need for dense textual supervision by adopting Group Relative Policy Optimization, enabling LLMs to develop reasoning capabilities from simple binary labels. Our architecture combines a discrete vision tower for high-level semantic inconsistencies and a residual extractor for fine-grained artifact analysis. We further introduce FakeHumanVid, a large-scale benchmark containing 15K real and synthetic videos across nine state-of-the-art human generation methods driven by text, pose, or audio. Extensive experiments demonstrate that AvatarShield outperforms existing methods in both in-domain and cross-domain settings.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 73 of its 122 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

73 of 122 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learning7 Mar
  2. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training28 Jan

Other references · 71

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2017Neural Discrete Representation Learningcited by 4,712
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2021Video Swin Transformercited by 1,091
38 more
  1. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  2. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  3. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  4. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  5. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  6. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  7. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  8. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  9. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  10. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  11. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  12. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
  13. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  14. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  15. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  16. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  17. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
  18. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
  19. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
  20. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
  21. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  22. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  23. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 127
  24. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
  25. 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
  26. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 122
  27. 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
  28. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  29. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  30. 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Modelscited by 99
  31. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
  32. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
  33. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
  34. 2023BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPTcited by 65
  35. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  36. 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
  37. 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 59
  38. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMs
  2. 2025VidGuard-R1: AI-Generated Video Detection and Explanation via Reasoning MLLMs and RL
  3. 2024VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis
  4. 2025SynthGuard: An Open Platform for Detecting AI-Generated Multimedia with Multimodal LLMs
  5. 2026VidForensics-M1: Meta-Detection Reinforcement Learning with Verifiable Temporal Grounding for AI-Generated Video Forensics
  6. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges
  7. 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection
  8. 2025ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detection