Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothness
Not on the map. Why?
Abstract (arXiv)
Face-swapping models have been drawing attention for their compelling generation quality, but their complex architectures and loss functions often require careful tuning for successful training. We propose a new face-swapping model called `Smooth-Swap', which excludes complex handcrafted designs and allows fast and stable training. The main idea of Smooth-Swap is to build smooth identity embedding that can provide stable gradients for identity change. Unlike the one used in previous models trained for a purely discriminative task, the proposed embedding is trained with a supervised contrastive loss promoting a smoother space. With improved smoothness, Smooth-Swap suffices to be composed of a generic U-Net-based generator and three basic loss functions, a far simpler design compared with the previous models. Extensive experiments on face-swapping benchmarks (FFHQ, FaceForensics++) and face images in the wild show that our model is also quantitatively and qualitatively comparable or even superior to the existing methods.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 11 Dec 2021.
Builds on
27 of 39 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2020Supervised Contrastive Learningcited by 2,803
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
15 more
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
- 2018RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spacescited by 50
- 2018FSNet: An Identity-Aware Generative Model for Image-based Face Swappingcited by 29
Built on by
Citing papers per year: 2022: 5; 2023: 9; 2024: 10; 2025: 3; 2026: 3.
30 papers.
Sort:
By area:
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusioncited by 22
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 12
- 2023Reinforced Disentanglement for Face Swapping without Skip Connectioncited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervisioncited by 8
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
18 more
- 2022FlowFace: Semantic Flow-guided Shape-aware Face Swappingcited by 6
- 2024SelfSwapper: Self-Supervised Face Swapping via Shape Agnostic Masked AutoEncodercited by 4
- 2024PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Servicescited by 4
- 2023MFIM: Megapixel Facial Identity Manipulationcited by 3
- 2024Face Swap via Diffusion Modelcited by 3
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detectioncited by 2
- 2023FlowFace++: Explicit Semantic Flow-supervised End-to-End Face Swappingcited by 2
- 2023Generalized Deepfakes Detection with Reconstructed-Blended Images and Multi-scale Feature Reconstruction Networkcited by 2
- 2024FaceTracer: Unveiling Source Identities from Swapped Face Images and Videos for Fraud Preventioncited by 2
- 2025Controllable and Expressive One-Shot Video Head Swappingcited by 2
- 2024LatentSwap: An Efficient Latent Code Mapping Framework for Face Swappingcited by 1
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
- 2026Why Fake ? Unveiling the Semantic Vocabulary of Deepfake Detectorscited by 1
- 2023Watch Out for the Confusing Faces: Detecting Face Swapping with the Probability Distribution of Face Identification Modelscited by 0
- 2024SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Spacecited by 0
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidencecited by 0
- 2025PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymizationcited by 0
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Fieldcited by 0
- 2026Why Fake ? Unveiling the Semantic Vocabulary of Deepfake Detectors8 Jul 2026
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2025PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymization24 Sep 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2024FaceTracer: Unveiling Source Identities from Swapped Face Images and Videos for Fraud Prevention11 Dec 2024
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Services1 Aug 2024
- 2024SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space9 May 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
18 more
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024Face Swap via Diffusion Model2 Mar 2024
- 2024LatentSwap: An Efficient Latent Code Mapping Framework for Face Swapping28 Feb 2024
- 2024SelfSwapper: Self-Supervised Face Swapping via Shape Agnostic Masked AutoEncoder12 Feb 2024
- 2023Generalized Deepfakes Detection with Reconstructed-Blended Images and Multi-scale Feature Reconstruction Network13 Dec 2023
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversion23 Oct 2023
- 2023MFIM: Megapixel Facial Identity Manipulation3 Aug 2023
- 2023BlendFace: Re-designing Identity Encoders for Face-Swapping20 Jul 2023
- 2023Reinforced Disentanglement for Face Swapping without Skip Connection16 Jul 2023
- 2023FlowFace++: Explicit Semantic Flow-supervised End-to-End Face Swapping22 Jun 2023
- 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervision8 Jun 2023
- 2023Watch Out for the Confusing Faces: Detecting Face Swapping with the Probability Distribution of Face Identification Models23 Mar 2023
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusion23 Mar 2023
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance27 Dec 2022
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swapping13 Dec 2022
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection12 Dec 2022
- 2022FlowFace: Semantic Flow-guided Shape-aware Face Swapping6 Dec 2022
- 2022Fine-Grained Face Swapping via Regional GAN Inversion25 Nov 2022
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidancecited by 77
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusioncited by 22
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 12
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2024Face Swap via Diffusion Modelcited by 3
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
- 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark27 Apr 2026
- 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2024Face Swap via Diffusion Model2 Mar 2024
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusion23 Mar 2023
- 2022DiffFace: Diffusion-based Face Swapping with Facial Guidance27 Dec 2022
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swapping13 Dec 2022
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023Reinforced Disentanglement for Face Swapping without Skip Connectioncited by 10
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervisioncited by 8
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
- 2022FlowFace: Semantic Flow-guided Shape-aware Face Swappingcited by 6
- 2024SelfSwapper: Self-Supervised Face Swapping via Shape Agnostic Masked AutoEncodercited by 4
- 2024PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Servicescited by 4
- 2023MFIM: Megapixel Facial Identity Manipulationcited by 3
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detectioncited by 2
12 most cited of 23 All 23 (JSON)
- 2026Why Fake ? Unveiling the Semantic Vocabulary of Deepfake Detectors8 Jul 2026
- 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Field24 Mar 2026
- 2025PerFace: Metric Learning in Perceptual Facial Similarity for Enhanced Face Anonymization24 Sep 2025
- 2025Controllable and Expressive One-Shot Video Head Swapping20 Jun 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2024FaceTracer: Unveiling Source Identities from Swapped Face Images and Videos for Fraud Prevention11 Dec 2024
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Services1 Aug 2024
- 2024SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space9 May 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024LatentSwap: An Efficient Latent Code Mapping Framework for Face Swapping28 Feb 2024
- 2024SelfSwapper: Self-Supervised Face Swapping via Shape Agnostic Masked AutoEncoder12 Feb 2024
12 newest of 23 All 23 (JSON)