HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swapping
Not on the map. Why?
Abstract (arXiv)
In this work, we propose a high fidelity face swapping method, called HifiFace, which can well preserve the face shape of the source face and generate photo-realistic results. Unlike other existing face swapping works that only use face recognition model to keep the identity similarity, we propose 3D shape-aware identity to control the face shape with the geometric supervision from 3DMM and 3D face reconstruction method. Meanwhile, we introduce the Semantic Facial Fusion module to optimize the combination of encoder and decoder features and make adaptive blending, which makes the results more photo-realistic. Extensive experiments on faces in the wild demonstrate that our method can preserve better identity, especially on the face shape, and can generate more photo-realistic results than previous state-of-the-art methods.
Key facts. Cited by 92 papers in the map (data through 14 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 18 Jun 2021.
Builds on
22 of 35 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
10 more
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
- 2020Blind Face Restoration via Deep Multi-scale Component Dictionariescited by 106
- 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
- 2018FSNet: An Identity-Aware Generative Model for Image-based Face Swappingcited by 29
- 2020AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detectioncited by 16
- 2018Identity Preserving Generative Adversarial Network for Cross-Domain Person Re-identificationcited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 17; 2023: 21; 2024: 22; 2025: 18; 2026: 12.
92 papers.
Sort:
By area:
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 50
- 2022Region-Aware Face Swappingcited by 45
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
38 more
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2021Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothnesscited by 30
- 2024Towards a Simultaneous and Granular Identity-Expression Control in Personalized Face Generationcited by 26
- 2023DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Cluescited by 23
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 21
- 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priorscited by 20
- 2022Deep Convolutional Pooling Transformer for Deepfake Detectioncited by 19
- 2024Face Anonymization Made Simplecited by 18
- 2023A Generalist FaceX via Learning Unified Facial Representationcited by 14
- 2023FIVA: Facial Image and Video Anonymization and Anonymization Defensecited by 12
- 2023Reinforced Disentanglement for Face Swapping without Skip Connectioncited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priorscited by 10
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generatorcited by 9
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2024Face De-identification: State-of-the-art Methods and Comparative Studiescited by 9
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2025MAVOS-DD: Multilingual Audio-Video Open-Set Deepfake Detection Benchmarkcited by 9
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformercited by 9
- 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervisioncited by 8
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
- 2024FaceShield: Defending Facial Image against Deepfake Threatscited by 8
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
- 2022FlowFace: Semantic Flow-guided Shape-aware Face Swappingcited by 6
- 2023Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detectioncited by 6
- 2024VividFace: A Diffusion-Based Hybrid Framework for High-Fidelity Video Face Swappingcited by 6
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Resultscited by 6
- 2022PixelFolder: An Efficient Progressive Pixel Synthesis Network for Image Generationcited by 5
- 2022DFGC 2022: The Second DeepFake Game Competitioncited by 5
- 2024Monocular Identity-Conditioned Facial Reflectance Reconstructioncited by 5
- 2025GHOST 2.0: generative high-fidelity one shot transfer of headscited by 5
- 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioningcited by 5
- 2025WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networkscited by 5
- 2025Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuningcited by 5
- 2023Vulnerability of Automatic Identity Recognition to Audio-Visual Deepfakescited by 4
50 most cited of 92 All 92 (JSON)
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Foundation Models are Implicit Deepfake Detectors10 Aug 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping8 Feb 2026
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editing30 Jan 2026
- 2026AlphaFace: High Fidelity and Real-time Face Swapper Robust to Facial Pose23 Jan 2026
- 2026APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swapping21 Jan 2026
- 2026Safeguarding Facial Identity against Diffusion-based Face Swapping via Cascading Pathway Disruption21 Jan 2026
- 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splatting9 Jan 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
38 more
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection11 Dec 2025
- 2025Towards Robust Protective Perturbation against DeepFake Face Swapping8 Dec 2025
- 2025DiffSwap++: 3D Latent-Controlled Diffusion for Identity-Preserving Face Swapping4 Nov 2025
- 2025PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymization24 Sep 2025
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics24 Jul 2025
- 2025De-Fake: Style based Anomaly Deepfake Detection4 Jul 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025NTIRE 2025 XGC Quality Assessment Challenge: Methods and Results3 Jun 2025
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakes26 May 2025
- 2025Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuning19 May 2025
- 2025MAVOS-DD: Multilingual Audio-Video Open-Set Deepfake Detection Benchmark16 May 2025
- 2025WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networks13 May 2025
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learning20 Apr 2025
- 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning28 Mar 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2025GHOST 2.0: generative high-fidelity one shot transfer of heads25 Feb 2025
- 2025Learning Semantic Facial Descriptors for Accurate Face Animation29 Jan 2025
- 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priors15 Jan 2025
- 2024Dense-Face: Personalized Face Generation Model via Dense Annotation Prediction24 Dec 2024
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Content16 Dec 2024
- 2024VividFace: A Diffusion-Based Hybrid Framework for High-Fidelity Video Face Swapping15 Dec 2024
- 2024FaceShield: Defending Facial Image against Deepfake Threats13 Dec 2024
- 2024FaceTracer: Unveiling Source Identities from Swapped Face Images and Videos for Fraud Prevention11 Dec 2024
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024Face De-identification: State-of-the-art Methods and Comparative Studies15 Nov 2024
- 2024Face Anonymization Made Simple1 Nov 2024
- 2024CausalVE: Face Video Privacy Encryption via Causal Video Prediction28 Sep 2024
- 2024Shaking the Fake: Detecting Deepfake Videos in Real Time via Active Probes17 Sep 2024
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep 2024
- 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors18 Aug 2024
- 2024IDRetracor: Towards Visual Forensics Against Malicious Face Swapping13 Aug 2024
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control21 May 2024
- 2024SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space9 May 2024
- 2024Monocular Identity-Conditioned Facial Reflectance Reconstruction30 Mar 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024LatentSwap: An Efficient Latent Code Mapping Framework for Face Swapping28 Feb 2024
- 2024SelfSwapper: Self-Supervised Face Swapping via Shape Agnostic Masked AutoEncoder12 Feb 2024
50 newest of 92 All 92 (JSON)
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2024Towards a Simultaneous and Granular Identity-Expression Control in Personalized Face Generationcited by 26
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generatorcited by 9
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applicationscited by 9
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformercited by 9
- 2024Dense-Face: Personalized Face Generation Model via Dense Annotation Predictioncited by 3
- 2026Safeguarding Facial Identity against Diffusion-based Face Swapping via Cascading Pathway Disruptioncited by 1
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
12 most cited of 13 All 13 (JSON)
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping8 Feb 2026
- 2026Safeguarding Facial Identity against Diffusion-based Face Swapping via Cascading Pathway Disruption21 Jan 2026
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer4 Jan 2026
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learning20 Apr 2025
- 2024Dense-Face: Personalized Face Generation Model via Dense Annotation Prediction24 Dec 2024
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep 2024
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Control21 May 2024
- 2024Towards a Simultaneous and Granular Identity-Expression Control in Personalized Face Generation2 Jan 2024
- 2023From Pixels to Portraits: A Comprehensive Survey of Talking Head Generation Techniques and Applications30 Aug 2023
- 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator4 May 2023
12 newest of 13 All 13 (JSON)
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
- 2023Character-LLM: A Trainable Agent for Role-Playing16 Oct 2023
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 50
- 2022Region-Aware Face Swappingcited by 45
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2021Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothnesscited by 30
- 2023DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Cluescited by 23
12 most cited of 77 All 77 (JSON)
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Foundation Models are Implicit Deepfake Detectors10 Aug 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editing30 Jan 2026
- 2026AlphaFace: High Fidelity and Real-time Face Swapper Robust to Facial Pose23 Jan 2026
- 2026APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swapping21 Jan 2026
- 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splatting9 Jan 2026
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection11 Dec 2025
- 2025Towards Robust Protective Perturbation against DeepFake Face Swapping8 Dec 2025
- 2025DiffSwap++: 3D Latent-Controlled Diffusion for Identity-Preserving Face Swapping4 Nov 2025
- 2025PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymization24 Sep 2025
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics24 Jul 2025
12 newest of 77 All 77 (JSON)