mlsanityData to 14 Oct 2026

Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMs

arXiv 2509.22646 ↗First posted 26 Sep 2025cs.CV cs.AI cs.CLcited by 17

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Can humans identify AI-generated (fake) videos and provide grounded reasons? While video generation models have advanced rapidly, a critical dimension -- whether humans can detect deepfake traces within a generated video, i.e., spatiotemporal grounded visual artifacts that reveal a video as machine generated -- has been largely overlooked. We introduce DeeptraceReward, the first fine-grained, spatially- and temporally- aware benchmark that annotates human-perceived fake traces for video generation reward. The dataset comprises 4.3K detailed annotations across 3.3K high-quality generated videos. Each annotation provides a natural-language explanation, pinpoints a bounding-box region containing the perceived trace, and marks precise onset and offset timestamps. We consolidate these annotations into 9 major categories of deepfake traces that lead humans to identify a video as AI-generated, and train multimodal language models (LMs) as reward models to mimic human judgments and localizations. On DeeptraceReward, our 7B reward model outperforms GPT-5 by 34.7% on average across fake clue identification, grounding, and explanation. Interestingly, we observe a consistent difficulty gradient: binary fake v.s. real classification is substantially easier than fine-grained deepfake trace detection; within the latter, performance degrades from natural language explanations (easiest), to spatial grounding, to temporal labeling (hardest). By foregrounding human-perceived deepfake traces, DeeptraceReward provides a rigorous testbed and training signal for socially aware and trustworthy video generation.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 32 of its 48 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

32 of 48 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmark28 Nov

Other references · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  11. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  12. 2024Phi-4 Technical Reportcited by 711
19 more
  1. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  2. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  3. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
  4. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  5. 2025Improving Video Generation with Human Feedbackcited by 284
  6. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
  7. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  8. 2018A Note on the Inception Scorecited by 226
  9. 2017GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibriumcited by 213
  10. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
  11. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  12. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  13. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
  14. 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
  15. 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Designcited by 54
  16. 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 49
  17. 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 45
  18. 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionalitycited by 44
  19. 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinementcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 15.

17 papers.

Sort:

By area:

  1. 2025Skyra: AI-Generated Video Detection via Grounded Artifact Reasoningcited by 25
  2. 2026VideoVeritas: AI-Generated Video Detection via Perception Pretext Reinforcement Learningcited by 11
  3. 2026Can Textual Reasoning Improve the Performance of MLLMs on Fine-grained Visual Classification?cited by 8
  4. 2026Preserving Forgery Artifacts: AI-Generated Video Detection at Native Scalecited by 8
  5. 2025ViBES: A Conversational Agent with Behaviorally-Intelligent 3D Virtual Bodycited by 6
  6. 2026FusionAgent: A Multimodal Agent with Dynamic Model Selection for Human Recognitioncited by 4
  7. 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoningcited by 4
  8. 2026When Images Look Right and Retrieve Wrong: Coverage-Guided Cross-Scale Re-Indexing for Knowledge-Faithful Generative Perceptioncited by 3
  9. 2026Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Datacited by 2
  10. 2026AutoCRAT: Within-trajectory Joint Control of Stochasticity and Compute for LLM Reasoningcited by 2
  11. 2026Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detectioncited by 1
  12. 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
5 more
  1. 2026VidForensics-M1: Meta-Detection Reinforcement Learning with Verifiable Temporal Grounding for AI-Generated Video Forensicscited by 1
  2. 2026EA-Swin: An Embedding-Agnostic Swin Transformer for AI-Generated Video Detectioncited by 0
  3. 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesiscited by 0
  4. 2026Noise Floor Audit for Agent Benchmarkscited by 0
  5. 2026When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024The Tug-of-War Between Deepfake Generation and Detection
  2. 2025AvatarShield: Visual Reinforcement Learning for Human-Centric Synthetic Video Detection
  3. 2026HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationales
  4. 2023Undercover Deepfakes: Detecting Fake Segments in Videos
  5. 2025AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequences
  6. 2026IsoVRBench: Video Reward Modeling Without Human Feedback
  7. 2025DAVID-XR1: Detecting AI-Generated Videos with Explainable Reasoning
  8. 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection