DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer
On the map: Diffusion models → Video generation
Abstract (arXiv)
Video Face Swapping (VFS) requires seamlessly injecting a source identity into a target video while meticulously preserving the original pose, expression, lighting, background, and dynamic information. Existing methods struggle to maintain identity similarity and attribute preservation while preserving temporal consistency. To address the challenge, we propose a comprehensive framework to seamlessly transfer the superiority of Image Face Swapping (IFS) to the video domain. We first introduce a novel data pipeline SyncID-Pipe that pre-trains an Identity-Anchored Video Synthesizer and combines it with IFS models to construct bidirectional ID quadruplets for explicit supervision. Building upon paired data, we propose the first Diffusion Transformer-based framework DreamID-V, employing a core Modality-Aware Conditioning module to discriminatively inject multi-model conditions. Meanwhile, we propose a Synthetic-to-Real Curriculum mechanism and an Identity-Coherence Reinforcement Learning strategy to enhance visual realism and identity consistency under challenging scenarios. To address the issue of limited benchmarks, we introduce IDBench-V, a comprehensive benchmark encompassing diverse scenes. Extensive experiments demonstrate DreamID-V outperforms state-of-the-art methods and further exhibits exceptional versatility, which can be seamlessly adapted to various swap-related tasks.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 49 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
41 of 49 references.
Closest ancestors · 5
Same direction, newest first
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2022Video Diffusion Models7 Apr
Other references · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
24 more
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 107
- 2024Diffusion-based Reinforcement Learning via Q-weighted Variational Policy Optimizationcited by 99
- 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
- 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
- 2024On the Content Bias in Fr'echet Video Distancecited by 51
- 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 35
- 2022FSGANv2: Improved Subject Agnostic Face Swapping and Reenactmentcited by 33
- 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 27
- 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2024VividFace: A Diffusion-Based Hybrid Framework for High-Fidelity Video Face Swappingcited by 6
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 19
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
- 2026Beyond the Golden Data: Resolving the Motion-Vision Quality Dilemma via Timestep Selective Trainingcited by 3
- 2026CoInteract: Physically-Consistent Human-Object Interaction Video Synthesis via Spatially-Structured Co-Generationcited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026MoZoo:Unleashing Video Diffusion power in animal fur and muscle simulationcited by 1
- 2026Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swappingcited by 0
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routingcited by 0
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generationcited by 0
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation17 Aug 2026
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routing5 Aug 2026
- 2026Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping23 Jul 2026
- 2026CoInteract: Physically-Consistent Human-Object Interaction Video Synthesis via Spatially-Structured Co-Generation21 Apr 2026
- 2026MoZoo:Unleashing Video Diffusion power in animal fur and muscle simulation8 Apr 2026
- 2026Beyond the Golden Data: Resolving the Motion-Vision Quality Dilemma via Timestep Selective Training26 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generation12 Feb 2026
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer20 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping
- 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors
- 2025StableAnimator++: Overcoming Pose Misalignment and Face Distortion for Human Image Animation
- 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation
- 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generation
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization