HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationales
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Rapid advancements in video diffusion models and temporal editing tools have enabled the generation of highly realistic human-centric videos, presenting unprecedented challenges to digital content forensics. Existing benchmarks primarily focus on face-swapping or global text-to-video synthesis, overlooking the crucial dimensions of multimodal alignment and complex human-object or human-human interactions. To address these limitations, we introduce HumanForge, a unified, large-scale, and multi-paradigm human-centric video forgery benchmark containing over 18,000 synthesized videos across four distinct scenarios: audio-driven, pose-driven, semantic-driven, and interaction. To construct and annotate this dataset without labor-intensive manual labeling or blind monolithic prompting, we propose Gen2Anno (Generation-to-Annotation), a cooperative multi-agent pipeline. Gen2Anno orchestrates six specialized agents-ranging from driving asset profiling to MoE-based reference analysis and closed-loop verification-to dynamically execute video synthesis and produce structured annotations containing binary authenticity labels, generative model attribution, and natural-language contrastive forgery rationales. By systematically contrasting expected states derived from generation provenance with actual visual observations, the framework generates logically grounded forensic reasoning chains. Extensive benchmarks using state-of-the-art traditional detectors and Vision-Language Models demonstrate the significant challenges of cross-generator generalization, perturbation robustness, and explainable reasoning on HumanForge. The code and dataset will be publicly released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 40 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
24 of 40 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2021Face Forensics in the Wildcited by 87
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
12 more
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 85
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
- 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 43
- 2026OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoningcited by 25
- 2026Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligencecited by 25
- 2026SkyReels-V3 Technique Reportcited by 19
- 2025OmniAID: Decoupling Semantics and Artifacts for Universal AI-Generated Image Detection in the Wildcited by 12
- 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfercited by 9
- 2025A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery Localizationcited by 8
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learningcited by 5
- 2025HumanSAM: Classifying Human-centric Forgery Videos in Human Spatial, Appearance, and Motion Anomalycited by 4
- 2026ActivityForensics: A Comprehensive Benchmark for Localizing Manipulated Activity in Videoscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos
- 2026Multi-Agent Forensic Reasoning for Generalizable Deepfake Video Detection
- 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMs
- 2026CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection
- 2024The Tug-of-War Between Deepfake Generation and Detection
- 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection