mlsanityData to 7 Oct 2026

DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer

arXiv 2601.01425 ↗First posted 4 Jan 2026cs.CVcited by 9

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video Face Swapping (VFS) requires seamlessly injecting a source identity into a target video while meticulously preserving the original pose, expression, lighting, background, and dynamic information. Existing methods struggle to maintain identity similarity and attribute preservation while preserving temporal consistency. To address the challenge, we propose a comprehensive framework to seamlessly transfer the superiority of Image Face Swapping (IFS) to the video domain. We first introduce a novel data pipeline SyncID-Pipe that pre-trains an Identity-Anchored Video Synthesizer and combines it with IFS models to construct bidirectional ID quadruplets for explicit supervision. Building upon paired data, we propose the first Diffusion Transformer-based framework DreamID-V, employing a core Modality-Aware Conditioning module to discriminatively inject multi-model conditions. Meanwhile, we propose a Synthetic-to-Real Curriculum mechanism and an Identity-Coherence Reinforcement Learning strategy to enhance visual realism and identity consistency under challenging scenarios. To address the issue of limited benchmarks, we introduce IDBench-V, a comprehensive benchmark encompassing diverse scenes. Extensive experiments demonstrate DreamID-V outperforms state-of-the-art methods and further exhibits exceptional versatility, which can be seamlessly adapted to various swap-related tasks.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 49 references that are in the map. First posted on arXiv 4 Jan 2026.

Builds on

41 of 49 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  4. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  5. 2022Video Diffusion Models7 Apr

Other references · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2015Continuous control with deep reinforcement learningcited by 3,279
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  9. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
24 more
  1. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  2. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  3. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  4. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
  5. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  6. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  7. 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
  8. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  9. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 107
  10. 2024Diffusion-based Reinforcement Learning via Q-weighted Variational Policy Optimizationcited by 99
  11. 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
  12. 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
  13. 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
  14. 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
  15. 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
  16. 2024On the Content Bias in Fr'echet Video Distancecited by 51
  17. 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
  18. 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 35
  19. 2022FSGANv2: Improved Subject Agnostic Face Swapping and Reenactmentcited by 33
  20. 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 27
  21. 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
  22. 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
  23. 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
  24. 2024VividFace: A Diffusion-Based Hybrid Framework for High-Fidelity Video Face Swappingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping
  2. 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors
  3. 2025StableAnimator++: Overcoming Pose Misalignment and Face Distortion for Human Image Animation
  4. 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning
  5. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation
  6. 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generation
  7. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
  8. 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization