Few-Shot Head Swapping in the Wild
Not on the map. Why?
Abstract (arXiv)
The head swapping task aims at flawlessly placing a source head onto a target body, which is of great importance to various entertainment scenarios. While face swapping has drawn much attention, the task of head swapping has rarely been explored, particularly under the few-shot setting. It is inherently challenging due to its unique needs in head modeling and background blending. In this paper, we present the Head Swapper (HeSer), which achieves few-shot head swapping in the wild through two delicately designed modules. Firstly, a Head2Head Aligner is devised to holistically migrate pose and expression information from the target to the source head by examining multi-scale information. Secondly, to tackle the challenges of skin color variations and head-background mismatches in the swapping procedure, a Head2Scene Blender is introduced to simultaneously modify facial skin color and fill mismatched gaps in the background around the head. Particularly, seamless blending is achieved with the help of a Semantic-Guided Color Reference Creation procedure and a Blending UNet. Extensive experiments demonstrate that the proposed method produces superior head swapping results in a variety of scenes.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 39 of its 51 references that are in the map. First posted on arXiv 27 Apr 2022.
Builds on
39 of 51 references.
References · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Generative Adversarial Networkscited by 5,627
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2020First Order Motion Model for Image Animationcited by 704
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
27 more
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2018Deep Video Portraitscited by 267
- 2021Motion Representations for Articulated Animationcited by 255
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2018Talking Face Generation by Adversarially Disentangled Audio-Visual Representationcited by 212
- 2018Animating Arbitrary Objects via Deep Motion Transfercited by 208
- 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 131
- 2020Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatarscited by 118
- 2020Cross-domain Correspondence Learning for Exemplar-based Image Translationcited by 116
- 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2019Deep Exemplar-based Video Colorizationcited by 75
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
- 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 64
- 2021Style and Pose Control for Image Synthesis of Humans from a Single Monocular Viewcited by 53
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2022MobileFaceSwap: A Lightweight Framework for Video Face Swappingcited by 39
- 2021Live Speech Portraits: Real-Time Photorealistic Talking-Head Animationcited by 36
- 2021FaceController: Controllable Attribute Editing for Face in the Wildcited by 22
- 2020Learning Oracle Attention for High-fidelity Face Completioncited by 21
- 2021PSGAN++: Robust Detail-Preserving Makeup Transfer and Removalcited by 17
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 6; 2025: 4; 2026: 5.
21 papers.
Sort:
By area:
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023A Generalist FaceX via Learning Unified Facial Representationcited by 14
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 13
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
- 2023Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detectioncited by 6
- 2025GHOST 2.0: generative high-fidelity one shot transfer of headscited by 5
- 2025Controllable and Expressive One-Shot Video Head Swappingcited by 2
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Modelcited by 2
9 more
- 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Priorcited by 1
- 2024Towards High-fidelity Head Blending with Chroma Keying for Industrial Applicationscited by 1
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
- 2024In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocolcited by 0
- 2025DirectSwap: Paired, Mask-Free Video Head Swapping with Full-Reference Evaluationcited by 0
- 2026UniBioTransfer: A Unified Framework for Multiple Biometrics Transfercited by 0
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Fieldcited by 0
- 2026AHS: Adaptive Head Synthesis via Synthetic Data Augmentationscited by 0
- 2026HairPort: In-context 3D-aware Hair Import and Transfer for Imagescited by 0
- 2026HairPort: In-context 3D-aware Hair Import and Transfer for Images10 Jun 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026AHS: Adaptive Head Synthesis via Synthetic Data Augmentations17 Apr 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026UniBioTransfer: A Unified Framework for Multiple Biometrics Transfer20 Mar 2026
- 2025DirectSwap: Paired, Mask-Free Video Head Swapping with Full-Reference Evaluation10 Dec 2025
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Model10 Jul 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025GHOST 2.0: generative high-fidelity one shot transfer of heads25 Feb 2025
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications1 Nov 2024
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep 2024
9 more
- 2024In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocol1 May 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2023A Generalist FaceX via Learning Unified Facial Representation31 Dec 2023
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversion23 Oct 2023
- 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Prior27 Apr 2023
- 2023Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detection30 Mar 2023
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swapping13 Dec 2022
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swapping27 Sep 2022
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 36
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 13
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Modelcited by 2
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Model10 Jul 2025
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models11 Sep 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swapping13 Dec 2022
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2023A Generalist FaceX via Learning Unified Facial Representationcited by 14
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
- 2023Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detectioncited by 6
- 2025GHOST 2.0: generative high-fidelity one shot transfer of headscited by 5
- 2025Controllable and Expressive One-Shot Video Head Swappingcited by 2
- 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Priorcited by 1
- 2024Towards High-fidelity Head Blending with Chroma Keying for Industrial Applicationscited by 1
- 2024In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocolcited by 0
- 2025DirectSwap: Paired, Mask-Free Video Head Swapping with Full-Reference Evaluationcited by 0
- 2026UniBioTransfer: A Unified Framework for Multiple Biometrics Transfercited by 0
12 most cited of 15 All 15 (JSON)
- 2026HairPort: In-context 3D-aware Hair Import and Transfer for Images10 Jun 2026
- 2026AHS: Adaptive Head Synthesis via Synthetic Data Augmentations17 Apr 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2026UniBioTransfer: A Unified Framework for Multiple Biometrics Transfer20 Mar 2026
- 2025DirectSwap: Paired, Mask-Free Video Head Swapping with Full-Reference Evaluation10 Dec 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025GHOST 2.0: generative high-fidelity one shot transfer of heads25 Feb 2025
- 2024Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications1 Nov 2024
- 2024In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocol1 May 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2023A Generalist FaceX via Learning Unified Facial Representation31 Dec 2023
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversion23 Oct 2023
12 newest of 15 All 15 (JSON)