mlsanityData to 7 Oct 2026

Region-Aware Face Swapping

arXiv 2203.04564 ↗First posted 9 Mar 2022cs.CVcited by 45

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel Region-Aware Face Swapping (RAFSwap) network to achieve identity-consistent harmonious high-resolution face generation in a local-global manner: 1) Local Facial Region-Aware (FRA) branch augments local identity-relevant features by introducing the Transformer to effectively model misaligned cross-scale semantic interaction. 2) Global Source Feature-Adaptive (SFA) branch further complements global identity-relevant cues for generating identity-consistent swapped faces. Besides, we propose a textitFace Mask Predictor (FMP) module incorporated with StyleGAN2 to predict identity-relevant soft facial masks in an unsupervised manner that is more practical for generating harmonious high-resolution faces. Abundant experiments qualitatively and quantitatively demonstrate the superiority of our method for generating more identity-consistent high-resolution swapped faces over SOTA methods, eg, obtaining 96.70 ID retrieval that outperforms SOTA MegaFS by 5.87uparrow.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 42 of its 61 references that are in the map. First posted on arXiv 9 Mar 2022.

Builds on

42 of 61 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  9. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  10. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  11. 2017Non-local Neural Networkscited by 2,290
  12. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
30 more
  1. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  2. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  3. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  4. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  5. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  6. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  7. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  8. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  9. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  10. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  11. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  12. 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 333
  13. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  14. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  15. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  16. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
  17. 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
  18. 2021One Shot Face Swapping on Megapixelscited by 105
  19. 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
  20. 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
  21. 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
  22. 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
  23. 2019PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfercited by 66
  24. 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 63
  25. 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
  26. 2018FSNet: An Identity-Aware Generative Model for Image-based Face Swappingcited by 29
  27. 2020Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Posecited by 26
  28. 2021FaceController: Controllable Attribute Editing for Face in the Wildcited by 22
  29. 2021Analogous to Evolutionary Algorithm: Designing a Unified Sequence Modelcited by 20
  30. 2021ShapeEditer: a StyleGAN Encoder for Face Swappingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 14; 2024: 14; 2025: 5; 2026: 7.

45 papers.

Sort:

By area:

  1. 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
  2. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
  3. 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
  4. 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
  5. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
  6. 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
  7. 2024Exploiting Style Latent Flows for Generalizing Deepfake Video Detectioncited by 58
  8. 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 35
  9. 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
  10. 2022Digital and Physical Face Attacks: Reviewing and One Step Furthercited by 17
  11. 2024ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performercited by 16
  12. 2023Automatic Animation of Hair Blowing in Still Portrait Photoscited by 13
33 more
  1. 2023A Generalist FaceX via Learning Unified Facial Representationcited by 13
  2. 2022Learning Disentangled Representation for One-shot Progressive Face Swappingcited by 12
  3. 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 12
  4. 2023Reinforced Disentanglement for Face Swapping without Skip Connectioncited by 10
  5. 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
  6. 2023Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generatorcited by 9
  7. 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
  8. 2023Disguise without Disruption: Utility-Preserving Face De-Identificationcited by 8
  9. 2023ReliableSwap: Boosting General Face Swapping Via Reliable Supervisioncited by 8
  10. 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
  11. 2024FaceShield: Defending Facial Image against Deepfake Threatscited by 8
  12. 2025Fair Deepfake Detectors Can Generalizecited by 7
  13. 2022FlowFace: Semantic Flow-guided Shape-aware Face Swappingcited by 6
  14. 2025Learning Real Facial Concepts for Independent Deepfake Detectioncited by 6
  15. 2024Monocular Identity-Conditioned Facial Reflectance Reconstructioncited by 5
  16. 2023Fooling State-of-the-Art Deepfake Detection with High-Quality Deepfakescited by 3
  17. 2023FlowFace++: Explicit Semantic Flow-supervised End-to-End Face Swappingcited by 2
  18. 2024MIMAFace: Face Animation via Motion-Identity Modulated Appearance Feature Learningcited by 2
  19. 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencodercited by 2
  20. 2023End-to-end Face-swapping via Adaptive Latent Representation Learningcited by 1
  21. 2023Towards Generalizable Deepfake Detection by Primary Region Regularizationcited by 1
  22. 2024The Tug-of-War Between Deepfake Generation and Detectioncited by 1
  23. 2024Towards High-fidelity Head Blending with Chroma Keying for Industrial Applicationscited by 1
  24. 2025ROFI: A Deep Learning-Based Ophthalmic Sign-Preserving and Reversible Patient Face Anonymizercited by 1
  25. 2026AlphaFace: High Fidelity and Real-time Face Swapper Robust to Facial Posecited by 1
  26. 2026Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmarkcited by 1
  27. 2024SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Spacecited by 0
  28. 2025Suppressing Gradient Conflict for Generalizable Deepfake Detectioncited by 0
  29. 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detectioncited by 0
  30. 2026Towards Generalizable Deepfake Detection via Real Distribution Bias Correctioncited by 0
  31. 2026GSwap: Realistic Head Swapping with Dynamic Neural Gaussian Fieldcited by 0
  32. 2026ID-Eraser: Proactive Defense Against Face Swapping via Identity Perturbationcited by 0
  33. 2026Only Train Once: Uncertainty-Aware One-Class Learning for Face Authenticity Detectioncited by 0