mlsanityData to 7 Oct 2026

HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationales

arXiv 2607.08705 ↗First posted 9 Jul 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Rapid advancements in video diffusion models and temporal editing tools have enabled the generation of highly realistic human-centric videos, presenting unprecedented challenges to digital content forensics. Existing benchmarks primarily focus on face-swapping or global text-to-video synthesis, overlooking the crucial dimensions of multimodal alignment and complex human-object or human-human interactions. To address these limitations, we introduce HumanForge, a unified, large-scale, and multi-paradigm human-centric video forgery benchmark containing over 18,000 synthesized videos across four distinct scenarios: audio-driven, pose-driven, semantic-driven, and interaction. To construct and annotate this dataset without labor-intensive manual labeling or blind monolithic prompting, we propose Gen2Anno (Generation-to-Annotation), a cooperative multi-agent pipeline. Gen2Anno orchestrates six specialized agents-ranging from driving asset profiling to MoE-based reference analysis and closed-loop verification-to dynamically execute video synthesis and produce structured annotations containing binary authenticity labels, generative model attribution, and natural-language contrastive forgery rationales. By systematically contrasting expected states derived from generation provenance with actual visual observations, the framework generates logically grounded forensic reasoning chains. Extensive benchmarks using state-of-the-art traditional detectors and Vision-Language Models demonstrate the significant challenges of cross-generator generalization, perturbation robustness, and explainable reasoning on HumanForge. The code and dataset will be publicly released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 40 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

24 of 40 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  5. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  7. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  8. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
  9. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
  10. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
  11. 2021Face Forensics in the Wildcited by 87
  12. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
12 more
  1. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 85
  2. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
  3. 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 43
  4. 2026OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoningcited by 25
  5. 2026Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligencecited by 25
  6. 2026SkyReels-V3 Technique Reportcited by 19
  7. 2025OmniAID: Decoupling Semantics and Artifacts for Universal AI-Generated Image Detection in the Wildcited by 12
  8. 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfercited by 9
  9. 2025A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery Localizationcited by 8
  10. 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learningcited by 5
  11. 2025HumanSAM: Classifying Human-centric Forgery Videos in Human Spatial, Appearance, and Motion Anomalycited by 4
  12. 2026ActivityForensics: A Comprehensive Benchmark for Localizing Manipulated Activity in Videoscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
  2. 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos
  3. 2026Multi-Agent Forensic Reasoning for Generalizable Deepfake Video Detection
  4. 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMs
  5. 2026CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection
  6. 2024The Tug-of-War Between Deepfake Generation and Detection
  7. 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection
  8. 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection