VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
We present a training-free, plug-and-play method, namely VFace, for high-quality face swapping in videos. It can be seamlessly integrated with image-based face swapping approaches built on diffusion models. First, we introduce a Frequency Spectrum Attention Interpolation technique to facilitate generation and intact key identity characteristics. Second, we achieve Target Structure Guidance via plug-and-play attention injection to better align the structural features from the target frame to the generation. Third, we present a Flow-Guided Attention Temporal Smoothening mechanism that enforces spatiotemporal coherence without modifying the underlying diffusion model to reduce temporal inconsistencies typically encountered in frame-wise generation. Our method requires no additional training or video-specific fine-tuning. Extensive experiments show that our method significantly enhances temporal consistency and visual fidelity, offering a practical and modular solution for video-based face swapping. Our code is available at https://github.com/Sanoojan/VFace.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 33 of its 44 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
33 of 44 references.
Closest ancestors · 6
Same direction, newest first
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control21 May
- 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance27 Dec
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
Other references · 27
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 262
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
15 more
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
- 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
- 2025Temporal Regularization Makes Your Video Generator Strongercited by 10
- 2022FlowFace: Semantic Flow-guided Shape-aware Face Swappingcited by 6
- 2025Zero-Shot Head Swapping in Real-World Scenarioscited by 4
- 2022FaceOff: A Video-to-Video Face Swapping Systemcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024VividFace: A Diffusion-Based Hybrid Framework for High-Fidelity Video Face Swapping
- 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer
- 2024HiFiVFS: High Fidelity Video Face Swapping
- 2025VividFace: High-Quality and Efficient One-Step Diffusion For Video Face Enhancement
- 2022Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encoding
- 2025Controllable and Expressive One-Shot Video Head Swapping
- 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning