Generative Face Completion
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose an effective face completion algorithm using a deep generative model. Different from well-studied background completion, the face completion task is more challenging as it often requires to generate semantically new pixels for the missing key components (e.g., eyes and mouths) that contain large appearance variations. Unlike existing nonparametric algorithms that search for patches to synthesize, our algorithm directly generates contents for missing regions based on a neural network. The model is trained with a combination of a reconstruction loss, two adversarial losses and a semantic parsing loss, which ensures pixel faithfulness and local-global contents consistency. With extensive experimental results, we demonstrate qualitatively and quantitatively that our model is able to deal with a large area of missing pixels in arbitrary shapes and generate realistic face completion results.
Key facts. Cited by 79 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 21; 2023: 13; 2024: 9; 2025: 3; 2026: 1.
79 papers.
Sort:
By area:
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2022Synthesizing Informative Training Samples with GANcited by 77
- 2022Synthetic Data -- what, why and how?cited by 67
- 2023Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancementcited by 57
- 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2022NeRF-In: Free-Form NeRF Inpainting with RGB-D Priorscited by 43
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Modelscited by 34
- 2021DeFLOCNet: Deep Image Editing via Flexible Low-level Controlscited by 26
38 more
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
- 2021RoI Tanh-polar Transformer Network for Face Parsing in the Wildcited by 23
- 2021Perceptual Indistinguishability-Net (PI-Net): Facial Image Obfuscation with Manipulable Semanticscited by 20
- 2021AGRNet: Adaptive Graph Representation Learning and Reasoning for Face Parsingcited by 16
- 2024FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Featurescited by 14
- 2021Vision-based Neural Scene Representations for Spacecraftcited by 12
- 2023RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detectioncited by 12
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detectioncited by 12
- 2021Biometrics in the Era of COVID-19: Challenges and Opportunitiescited by 11
- 2021FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpaintingcited by 11
- 2022Generative Adversarial Networks for Image Super-Resolution: A Surveycited by 11
- 2023Reference-Guided Large-Scale Face Inpainting with Identity and Texture Controlcited by 10
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Trackingcited by 9
- 2022Enhancement of Novel View Synthesis Using Omnidirectional Image Completioncited by 9
- 2023Parameter Efficient Local Implicit Image Function Network for Face Segmentationcited by 8
- 2021Temporally coherent video anonymization through GAN inpaintingcited by 7
- 2021Deep Face Video Inpainting via UV Mappingcited by 7
- 2021Generative Memory-Guided Semantic Reasoning Model for Image Inpaintingcited by 7
- 2021Segmentation-Reconstruction-Guided Facial Image De-occlusioncited by 6
- 2021Depth as Attention for Face Representation Learningcited by 5
- 2021Locality-aware Channel-wise Dropout for Occluded Face Recognitioncited by 5
- 2021GANmapper: geographical data translationcited by 5
- 2022A Deep Learning Framework to Reconstruct Face under Maskcited by 5
- 2022High-Quality Pluralistic Image Completion via Code Shared VQGANcited by 5
- 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restorationcited by 5
- 2021DuelGAN: A Duel Between Two Discriminators Stabilizes the GAN Trainingcited by 4
- 2021JDSR-GAN: Constructing An Efficient Joint Learning Network for Masked Face Super-Resolutioncited by 4
- 2021In-N-Out: Towards Good Initialization for Inpainting and Outpaintingcited by 4
- 2021Pro-UIGAN: Progressive Face Hallucination from Occluded Thumbnailscited by 4
- 2021MisConv: Convolutional Neural Networks for Missing Datacited by 4
- 2021Fully Context-Aware Image Inpainting with a Learned Semantic Pyramidcited by 4
- 2022ShowFace: Coordinated Face Inpainting with Memory-Disentangled Refinement Networkscited by 3
- 2022FusionVAE: A Deep Hierarchical Variational Autoencoder for RGB Image Fusioncited by 3
- 2022A Survey on Computer Vision based Human Analysis in the COVID-19 Eracited by 3
- 2023Local-to-Global Panorama Inpainting for Locale-Aware Indoor Lighting Predictioncited by 3
- 20213DFaceFill: An Analysis-By-Synthesis Approach to Face Completioncited by 2
- 2022Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognitioncited by 2
- 2022Multi-feature Co-learning for Image Inpaintingcited by 2
50 most cited of 79 All 79 (JSON)
- 2026When Diffusion Models Forget Who You Are: Identity Preservation in Face Inpainting under Large Occlusions5 Aug 2026
- 2025Disturbance-Free Surgical Video Generation from Multi-Camera Shadowless Lamps for Open Surgery9 Dec 2025
- 2025Automated Invoice Data Extraction: Using LLM and OCR1 Nov 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2024Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction25 Dec 2024
- 2024Pinco: Position-induced Consistent Adapter for Diffusion Transformer in Foreground-conditioned Inpainting5 Dec 2024
- 2024Machine Learning for Missing Value Imputation10 Oct 2024
- 2024RetCompletion:High-Speed Inference Image Completion with Retentive Network5 Oct 2024
- 2024Look Through Masks: Towards Masked Face Recognition with De-Occlusion Distillation19 Sep 2024
- 2024Face Mask Removal with Region-attentive Face Inpainting10 Sep 2024
- 2024A Comprehensive Survey of Masked Faces: Recognition, Detection, and Unmasking9 May 2024
- 2024FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features15 Apr 2024
38 more
- 2024Deep Learning-based Image and Video Inpainting: A Survey7 Jan 2024
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detection14 Dec 2023
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpainting6 Dec 2023
- 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restoration26 Nov 2023
- 2023Seeing through the Mask: Multi-task Generative Mask Decoupling Face Recognition20 Nov 2023
- 2023Posterior Consistency for Missing Data in Variational Autoencoders25 Oct 2023
- 2023Semantic Image Completion and Enhancement using GANs27 Jul 2023
- 2023A Unified Framework to Super-Resolve Face Images of Varied Low Resolutions6 Jun 2023
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Models10 May 2023
- 2023Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancement14 Apr 2023
- 2023Parameter Efficient Local Implicit Image Function Network for Face Segmentation27 Mar 2023
- 2023Local-to-Global Panorama Inpainting for Locale-Aware Indoor Lighting Prediction18 Mar 2023
- 2023Reference-Guided Large-Scale Face Inpainting with Identity and Texture Control13 Mar 2023
- 2023RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detection24 Feb 2023
- 2022Learning Representations for Masked Facial Recovery28 Dec 2022
- 2022Internal Diverse Image Completion18 Dec 2022
- 2022A Survey on Computer Vision based Human Analysis in the COVID-19 Era7 Nov 2022
- 2022Semantics-Guided Object Removal for Facial Images: with Broad Applicability and Robust Style Preservation29 Sep 2022
- 2022FusionVAE: A Deep Hierarchical Variational Autoencoder for RGB Image Fusion22 Sep 2022
- 2022Stochastic Attribute Modeling for Face Super-Resolution16 Jul 2022
- 2022NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors10 Jun 2022
- 2022Multi-feature Co-learning for Image Inpainting21 May 2022
- 2022Pluralistic Image Completion with Probabilistic Mixture-of-Experts18 May 2022
- 2022Synthetic Data -- what, why and how?6 May 2022
- 2022Generative Adversarial Networks for Image Super-Resolution: A Survey28 Apr 2022
- 2022Synthesizing Informative Training Samples with GAN15 Apr 2022
- 2022ShowFace: Coordinated Face Inpainting with Memory-Disentangled Refinement Networks6 Apr 2022
- 2022High-Quality Pluralistic Image Completion via Code Shared VQGAN5 Apr 2022
- 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creation28 Mar 2022
- 2022A Deep Learning Framework to Reconstruct Face under Mask23 Mar 2022
- 2022NeuralReshaper: Single-image Human-body Retouching with Deep Neural Networks20 Mar 2022
- 2022Enhancement of Novel View Synthesis Using Omnidirectional Image Completion18 Mar 2022
- 2022On generating parametrised structural data using conditional generative adversarial networks3 Mar 2022
- 2022Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition10 Feb 2022
- 2022Adaptive Image Inpainting1 Jan 2022
- 2021DeePaste -- Inpainting for Pasting20 Dec 2021
- 2021Segmentation-Reconstruction-Guided Facial Image De-occlusion15 Dec 2021
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learning12 Dec 2021
50 newest of 79 All 79 (JSON)
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Modelscited by 34
- 2021High-dimensional Assisted Generative Model for Color Image Restorationcited by 1
- 2024Pinco: Position-induced Consistent Adapter for Diffusion Transformer in Foreground-conditioned Inpaintingcited by 0
- 2026When Diffusion Models Forget Who You Are: Identity Preservation in Face Inpainting under Large Occlusionscited by 0
- 2026When Diffusion Models Forget Who You Are: Identity Preservation in Face Inpainting under Large Occlusions5 Aug 2026
- 2024Pinco: Position-induced Consistent Adapter for Diffusion Transformer in Foreground-conditioned Inpainting5 Dec 2024
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Models10 May 2023
- 2021High-dimensional Assisted Generative Model for Color Image Restoration14 Aug 2021
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2022Synthesizing Informative Training Samples with GANcited by 77
- 2022Synthetic Data -- what, why and how?cited by 67
- 2023Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancementcited by 57
- 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2022NeRF-In: Free-Form NeRF Inpainting with RGB-D Priorscited by 43
- 2021DeFLOCNet: Deep Image Editing via Flexible Low-level Controlscited by 26
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
12 most cited of 74 All 74 (JSON)
- 2025Disturbance-Free Surgical Video Generation from Multi-Camera Shadowless Lamps for Open Surgery9 Dec 2025
- 2025Automated Invoice Data Extraction: Using LLM and OCR1 Nov 2025
- 2025DisFaceRep: Representation Disentanglement for Co-occurring Facial Components in Weakly Supervised Face Parsing2 Aug 2025
- 2024Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction25 Dec 2024
- 2024Machine Learning for Missing Value Imputation10 Oct 2024
- 2024RetCompletion:High-Speed Inference Image Completion with Retentive Network5 Oct 2024
- 2024Look Through Masks: Towards Masked Face Recognition with De-Occlusion Distillation19 Sep 2024
- 2024Face Mask Removal with Region-attentive Face Inpainting10 Sep 2024
- 2024A Comprehensive Survey of Masked Faces: Recognition, Detection, and Unmasking9 May 2024
- 2024FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features15 Apr 2024
- 2024Deep Learning-based Image and Video Inpainting: A Survey7 Jan 2024
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detection14 Dec 2023
12 newest of 74 All 74 (JSON)