Preserving Source Video Realism: High-Fidelity Face Swapping for Cinematic Quality
Not on the map. Why?
Abstract (arXiv)
Video face swapping is crucial in film and entertainment production, where achieving high fidelity and temporal consistency over long and complex video sequences remains a significant challenge. Inspired by recent advances in reference-guided image editing, we explore whether rich visual attributes from source videos can be similarly leveraged to enhance both fidelity and temporal coherence in video face swapping. Building on this insight, this work presents LivingSwap, the first video reference guided face swapping model. Our approach employs keyframes as conditioning signals to inject the target identity, enabling flexible and controllable editing. By combining keyframe conditioning with video reference guidance, the model performs temporal stitching to ensure stable identity preservation and high-fidelity reconstruction across long video sequences. To address the scarcity of data for reference-guided training, we construct a paired face-swapping dataset, Face2Face, and further reverse the data pairs to ensure reliable ground-truth supervision. Extensive experiments demonstrate that our method achieves state-of-the-art results, seamlessly integrating the target identity with the source video's expressions, lighting, and motion, while significantly reducing manual effort in production workflows. Project webpage: https://aim-uofa.github.io/LivingSwap
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 53 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
42 of 53 references.
References · 42
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024GPT-4o System Cardcited by 4,467
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2025Qwen-Image Technical Reportcited by 973
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
30 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
- 2023Direct Inversion: Boosting Diffusion-based Editing with 3 Lines of Codecited by 145
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 103
- 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
- 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
- 2022L2CS-Net: Fine-Grained Gaze Estimation in Unconstrained Environmentscited by 65
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
- 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 37
- 2023Object-aware Inversion and Reassembly for Image Editingcited by 29
- 2024Framer: Interactive Frame Interpolationcited by 24
- 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
- 2023Local Conditional Controlling for Text-to-Image Diffusion Modelscited by 13
- 2025VividFace: High-Quality and Efficient One-Step Diffusion For Video Face Enhancementcited by 10
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 20253D Object Manipulation in a Single Image using Generative Modelscited by 7
Built on by
Citing papers per year: 2025: 1.
1 paper.