# Geometry-Aware Face Completion and Editing

arXiv: https://arxiv.org/abs/1809.02967 · HTML: https://mlsanity.com/paper/1809.02967/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 9 Sep 2018.

## Built on by (most cited first, 21 of 21)

- [Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation](https://mlsanity.com/paper/2104.07995/) (2021)
- [Deep Learning-based Image and Video Inpainting: A Survey](https://mlsanity.com/paper/2401.03395/) (2024)
- [MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpainting](https://mlsanity.com/paper/2203.06304/) (2022)
- [High-Fidelity Image Inpainting with GAN Inversion](https://mlsanity.com/paper/2208.11850/) (2022)
- [Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration](https://mlsanity.com/paper/2203.08444/) (2022)
- [Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion Interpolation](https://mlsanity.com/paper/2303.14926/) (2023)
- [FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpainting](https://mlsanity.com/paper/2108.04424/) (2021)
- [Everything's Talkin': Pareidolia Face Reenactment](https://mlsanity.com/paper/2104.03061/) (2021)
- [Unbiased Multi-Modality Guidance for Image Inpainting](https://mlsanity.com/paper/2208.11844/) (2022)
- [Deep Face Video Inpainting via UV Mapping](https://mlsanity.com/paper/2109.00681/) (2021)
- [Pro-UIGAN: Progressive Face Hallucination from Occluded Thumbnails](https://mlsanity.com/paper/2108.00602/) (2021)
- [A comprehensive survey on semantic facial attribute editing using generative adversarial networks](https://mlsanity.com/paper/2205.10587/) (2022)
- [A Survey on Computer Vision based Human Analysis in the COVID-19 Era](https://mlsanity.com/paper/2211.03705/) (2022)
- [3DFaceFill: An Analysis-By-Synthesis Approach to Face Completion](https://mlsanity.com/paper/2110.10395/) (2021)
- [Reasoning Structural Relation for Occlusion-Robust Facial Landmark Localization](https://mlsanity.com/paper/2112.10087/) (2021)
- [Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition](https://mlsanity.com/paper/2202.05297/) (2022)
- [Improve Deep Image Inpainting by Emphasizing the Complexity of Missing Regions](https://mlsanity.com/paper/2202.06266/) (2022)
- [UP-FacE: User-predictable Fine-grained Face Shape Editing](https://mlsanity.com/paper/2403.13972/) (2024)
- [Face Mask Removal with Region-attentive Face Inpainting](https://mlsanity.com/paper/2409.06845/) (2024)
- [HAIFAI: Human-AI Interaction for Mental Face Reconstruction](https://mlsanity.com/paper/2412.06323/) (2024)
- [High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion](https://mlsanity.com/paper/2504.12844/) (2025)

## Abstract (arXiv)

Face completion is a challenging generation task because it requires generating visually pleasing new pixels that are semantically consistent with the unmasked face region. This paper proposes a geometry-aware Face Completion and Editing NETwork (FCENet) by systematically studying facial geometry from the unmasked region. Firstly, a facial geometry estimator is learned to estimate facial landmark heatmaps and parsing maps from the unmasked face image. Then, an encoder-decoder structure generator serves to complete a face image and disentangle its mask areas conditioned on both the masked face image and the estimated facial geometry images. Besides, since low-rank property exists in manually labeled masks, a low-rank regularization term is imposed on the disentangled masks, enforcing our completion network to manage occlusion area with various shape and size. Furthermore, our network can generate diverse results from the same masked input by modifying estimated facial geometry, which provides a flexible mean to edit the completed face appearance. Extensive experimental results qualitatively and quantitatively demonstrate that our network is able to generate visually pleasing face completion results and edit face attributes as well.