mlsanityData to 14 Oct 2026

VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping

arXiv 2602.07835 ↗First posted 8 Feb 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We present a training-free, plug-and-play method, namely VFace, for high-quality face swapping in videos. It can be seamlessly integrated with image-based face swapping approaches built on diffusion models. First, we introduce a Frequency Spectrum Attention Interpolation technique to facilitate generation and intact key identity characteristics. Second, we achieve Target Structure Guidance via plug-and-play attention injection to better align the structural features from the target frame to the generation. Third, we present a Flow-Guided Attention Temporal Smoothening mechanism that enforces spatiotemporal coherence without modifying the underlying diffusion model to reduce temporal inconsistencies typically encountered in frame-wise generation. Our method requires no additional training or video-specific fine-tuning. Extensive experiments show that our method significantly enhances temporal consistency and visual fidelity, offering a practical and modular solution for video-based face swapping. Our code is available at https://github.com/Sanoojan/VFace.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 33 of its 44 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

33 of 44 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep
  2. 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control21 May
  3. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  5. 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance27 Dec
  6. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov

Other references · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  6. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  7. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  8. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
  9. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  10. 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 262
  11. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  12. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
15 more
  1. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
  2. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
  3. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  4. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
  5. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
  6. 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
  7. 2021One Shot Face Swapping on Megapixelscited by 105
  8. 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
  9. 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
  10. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  11. 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
  12. 2025Temporal Regularization Makes Your Video Generator Strongercited by 10
  13. 2022FlowFace: Semantic Flow-guided Shape-aware Face Swappingcited by 6
  14. 2025Zero-Shot Head Swapping in Real-World Scenarioscited by 4
  15. 2022FaceOff: A Video-to-Video Face Swapping Systemcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024VividFace: A Diffusion-Based Hybrid Framework for High-Fidelity Video Face Swapping
  2. 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors
  3. 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer
  4. 2024HiFiVFS: High Fidelity Video Face Swapping
  5. 2025VividFace: High-Quality and Efficient One-Step Diffusion For Video Face Enhancement
  6. 2022Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encoding
  7. 2025Controllable and Expressive One-Shot Video Head Swapping
  8. 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning