FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swapping
Not on the map. Why?
Abstract (arXiv)
In this work, we present a new single-stage method for subject agnostic face swapping and identity transfer, named FaceDancer. We have two major contributions: Adaptive Feature Fusion Attention (AFFA) and Interpreted Feature Similarity Regularization (IFSR). The AFFA module is embedded in the decoder and adaptively learns to fuse attribute features and features conditioned on identity information without requiring any additional facial segmentation process. In IFSR, we leverage the intermediate features in an identity encoder to preserve important attributes such as head pose, facial expression, lighting, and occlusion in the target face, while still transferring the identity of the source face with high fidelity. We conduct extensive quantitative and qualitative experiments on various datasets and show that the proposed FaceDancer outperforms other state-of-the-art networks in terms of identityn transfer, while having significantly better pose preservation than most of the previous methods.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 19 Oct 2022.
Builds on
34 of 46 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
22 more
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 624
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 20193D Morphable Face Models -- Past, Present and Futurecited by 270
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
- 2018Face Alignment in Full Pose Range: A 3D Total Solutioncited by 148
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
- 2018A Compact Embedding for Facial Expression Similaritycited by 41
- 2021FaceController: Controllable Attribute Editing for Face in the Wildcited by 22
Built on by
Citing papers per year: 2023: 1; 2024: 12; 2025: 17; 2026: 14.
44 papers.
Sort:
By area:
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 43
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2024Face Anonymization Made Simplecited by 18
- 2024Unified Physical-Digital Face Attack Detectioncited by 17
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2023FIVA: Facial Image and Video Anonymization and Anonymization Defensecited by 12
- 2025TalkingHeadBench: A Multi-Modal Benchmark & Analysis of Talking-Head DeepFake Detectioncited by 11
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
32 more
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2024Joint Physical-Digital Facial Attack Detection Via Simulating Spoofing Cluescited by 8
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysiscited by 7
- 2025FantasyID: A dataset for detecting digital manipulations of ID-documentscited by 6
- 2025Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuningcited by 5
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learningcited by 5
- 2024Unified Physical-Digital Attack Detection Challengecited by 3
- 2025De-Fake: Style based Anomaly Deepfake Detectioncited by 1
- 2026AlphaFace: High Fidelity and Real-time Face Swapper Robust to Facial Posecited by 1
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
- 2024Revisiting Face Forgery Detection: From Facial Representation to Forgery Detectioncited by 0
- 2025Unified Face Matching and Physical-Digital Spoofing Attack Detectioncited by 0
- 2025DFCon: Attention-Driven Supervised Contrastive Learning for Robust Deepfake Detectioncited by 0
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidencecited by 0
- 2025Assessing the Use of Face Swapping Methods as Face Anonymizers in Videoscited by 0
- 2025Spotting tell-tale visual artifacts in face swapping videos: strengths and pitfalls of CNN detectorscited by 0
- 2025Morphology-optimized Multi-Scale Fusion: Combining Local Artifacts and Mesoscopic Semantics for Deepfake Detection and Localizationcited by 0
- 2025R2M: Real-Aware Residual Model Merging for Robust and Generalizable Deepfake Detectioncited by 0
- 2025DeepForgeSeal: Latent Space-Driven Semi-Fragile Watermarking for Deepfake Detection Using Adversarial Reinforcement Learningcited by 0
- 2025DiffSwap++: 3D Latent-Controlled Diffusion for Identity-Preserving Face Swappingcited by 0
- 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splattingcited by 0
- 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detectioncited by 0
- 2026APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swappingcited by 0
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026Optimizing ID Consistency in Multimodal Large Models: Facial Restoration via Alignment, Entanglement, and Disentanglementcited by 0
- 2026SAiW: Source-Attributable Invisible Watermarking for Proactive Deepfake Defensecited by 0
- 2026Generalizable Face Forgery Detection via Separable Prompt Learningcited by 0
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detectioncited by 0
- 2026FakeIDet3-DB: Refining Digital Attacks and Patch Extraction for Secure ID Benchmarkingcited by 0
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detectioncited by 0
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approachcited by 0
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Studycited by 0
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Study22 Sep 2026
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detection3 Sep 2026
- 2026FakeIDet3-DB: Refining Digital Attacks and Patch Extraction for Secure ID Benchmarking29 Jul 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026Generalizable Face Forgery Detection via Separable Prompt Learning19 Apr 2026
- 2026SAiW: Source-Attributable Invisible Watermarking for Proactive Deepfake Defense24 Mar 2026
- 2026Optimizing ID Consistency in Multimodal Large Models: Facial Restoration via Alignment, Entanglement, and Disentanglement21 Feb 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2026AlphaFace: High Fidelity and Real-time Face Swapper Robust to Facial Pose23 Jan 2026
- 2026APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swapping21 Jan 2026
32 more
- 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detection17 Jan 2026
- 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splatting9 Jan 2026
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
- 2025DeepForgeSeal: Latent Space-Driven Semi-Fragile Watermarking for Deepfake Detection Using Adversarial Reinforcement Learning7 Nov 2025
- 2025DiffSwap++: 3D Latent-Controlled Diffusion for Identity-Preserving Face Swapping4 Nov 2025
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysis29 Oct 2025
- 2025R2M: Real-Aware Residual Model Merging for Robust and Generalizable Deepfake Detection29 Sep 2025
- 2025Morphology-optimized Multi-Scale Fusion: Combining Local Artifacts and Mesoscopic Semantics for Deepfake Detection and Localization17 Sep 2025
- 2025FantasyID: A dataset for detecting digital manipulations of ID-documents28 Jul 2025
- 2025De-Fake: Style based Anomaly Deepfake Detection4 Jul 2025
- 2025Spotting tell-tale visual artifacts in face swapping videos: strengths and pitfalls of CNN detectors19 Jun 2025
- 2025TalkingHeadBench: A Multi-Modal Benchmark & Analysis of Talking-Head DeepFake Detection30 May 2025
- 2025Assessing the Use of Face Swapping Methods as Face Anonymizers in Videos27 May 2025
- 2025Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuning19 May 2025
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learning20 Apr 2025
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes7 Apr 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2025DFCon: Attention-Driven Supervised Contrastive Learning for Robust Deepfake Detection28 Jan 2025
- 2025Unified Face Matching and Physical-Digital Spoofing Attack Detection16 Jan 2025
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024Face Anonymization Made Simple1 Nov 2024
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detection8 Oct 2024
- 2024Revisiting Face Forgery Detection: From Facial Representation to Forgery Detection25 Sep 2024
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep 2024
- 2024DF40: Toward Next-Generation Deepfake Detection19 Jun 2024
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving25 Apr 2024
- 2024Joint Physical-Digital Facial Attack Detection Via Simulating Spoofing Clues12 Apr 2024
- 2024Unified Physical-Digital Attack Detection Challenge9 Apr 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024Unified Physical-Digital Face Attack Detection31 Jan 2024
- 2023FIVA: Facial Image and Video Anonymization and Anonymization Defense8 Sep 2023
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learning20 Apr 2025
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep 2024
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 43
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2024Face Anonymization Made Simplecited by 18
- 2024Unified Physical-Digital Face Attack Detectioncited by 17
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2023FIVA: Facial Image and Video Anonymization and Anonymization Defensecited by 12
- 2025TalkingHeadBench: A Multi-Modal Benchmark & Analysis of Talking-Head DeepFake Detectioncited by 11
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2024Joint Physical-Digital Facial Attack Detection Via Simulating Spoofing Cluescited by 8
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysiscited by 7
12 most cited of 37 All 37 (JSON)
- 2026Adversarial Attacks and Identity Leakage in De-Identification Systems: An Empirical Study22 Sep 2026
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detection3 Sep 2026
- 2026FakeIDet3-DB: Refining Digital Attacks and Patch Extraction for Secure ID Benchmarking29 Jul 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Generalizable Face Forgery Detection via Separable Prompt Learning19 Apr 2026
- 2026Optimizing ID Consistency in Multimodal Large Models: Facial Restoration via Alignment, Entanglement, and Disentanglement21 Feb 2026
- 2026AlphaFace: High Fidelity and Real-time Face Swapper Robust to Facial Pose23 Jan 2026
- 2026APPLE: Attribute-Preserving Pseudo-Labeling for Diffusion-Based Face Swapping21 Jan 2026
- 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detection17 Jan 2026
- 2026GaussianSwap: Animatable Video Face Swapping with 3D Gaussian Splatting9 Jan 2026
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
12 newest of 37 All 37 (JSON)