Mask-Guided Portrait Editing with Conditional GANs
Not on the map. Why?
Abstract (arXiv)
Portrait editing is a popular subject in photo manipulation. The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing techniques: diversity, quality, and controllability for portrait synthesis and editing. To address these issues, we propose a novel end-to-end learning framework that leverages conditional GANs guided by provided face masks for generating faces. The framework learns feature embeddings for every face component (e.g., mouth, hair, eye), separately, contributing to better correspondences for image translation, and local face editing. With the mask, our network is available to many applications, like face synthesis driven by mask, face Swap+ (including hair in swapping), and local manipulation. It can also boost the performance of face parsing a bit as an option of data augmentation.
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 20; 2023: 9; 2024: 7; 2025: 4; 2026: 2.
61 papers.
Sort:
By area:
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2022Denoised MDPs: Learning World Models Better Than the World Itselfcited by 66
- 2022Improved Vector Quantized Diffusion Modelscited by 62
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
- 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
- 2021High-Fidelity and Arbitrary Face Editingcited by 35
- 2021ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignmentcited by 33
- 2022Cycle-Consistent Counterfactuals by Latent Transformationscited by 33
- 2021DeFLOCNet: Deep Image Editing via Flexible Low-level Controlscited by 26
38 more
- 2021Collaging Class-specific GANs for Semantic Image Synthesiscited by 25
- 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
- 2023PFB-Diff: Progressive Feature Blending Diffusion for Text-driven Image Editingcited by 20
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
- 2022DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGANcited by 18
- 2022GAN-based Facial Attribute Manipulationcited by 16
- 2021Retrieve in Style: Unsupervised Facial Feature Transfer and Retrievalcited by 15
- 2023Eliminating Contextual Prior Bias for Semantic Image Editing via Dual-Cycle Diffusioncited by 14
- 2021Disentangled Face Attribute Editing via Instance-Aware Latent Space Searchcited by 12
- 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editingcited by 12
- 2023SIEDOB: Semantic Image Editing by Disentangling Object and Backgroundcited by 11
- 2022SCAM! Transferring humans between images with Semantic Cross Attention Modulationcited by 10
- 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generationcited by 8
- 2022IA-FaceS: A Bidirectional Method for Semantic Face Editingcited by 8
- 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesiscited by 8
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversioncited by 8
- 2023ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNetcited by 7
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 7
- 2021Training Generative Adversarial Networks in One Stagecited by 6
- 2022RMGN: A Regional Mask Guided Network for Parser-free Virtual Try-oncited by 6
- 2022MAGIC: Mask-Guided Image Synthesis by Inverting a Quasi-Robust Classifiercited by 6
- 2023LC-NeRF: Local Controllable Face Generation in Neural Randiance Fieldcited by 6
- 2021FacialGAN: Style Transfer and Attribute Manipulation on Synthetic Facescited by 5
- 2022Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Datacited by 5
- 2023Example Forgetting: A Novel Approach to Explain and Interpret Deep Neural Networks in Seismic Interpretationcited by 4
- 2021Heredity-aware Child Face Image Generation with Latent Space Disentanglementcited by 3
- 2021SeCGAN: Parallel Conditional Generative Adversarial Networks for Face Editing via Semantic Consistencycited by 3
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networkscited by 3
- 2022ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutionscited by 3
- 2024GANs Conditioning Methods: A Surveycited by 3
- 2025Domain Generalizable Portrait Style Transfercited by 3
- 2021SketchHairSalon: Deep Sketch-based Hair Image Synthesiscited by 2
- 2021MixSyn: Learning Composition and Style for Multi-Source Image Synthesiscited by 2
- 2022Interactive Image Inpainting Using Semantic Guidancecited by 2
- 2022Dual-Domain Image Synthesis using Segmentation-Guided GANcited by 2
- 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Modelscited by 2
- 2023Completing Visual Objects via Bridging Generation and Segmentationcited by 2
- 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencodercited by 2
50 most cited of 61 All 61 (JSON)
- 2026DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model27 Feb 2026
- 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editing2 Feb 2026
- 2025Heatmap Regression without Soft-Argmax for Facial Landmark Detection19 Aug 2025
- 2025Domain Generalizable Portrait Style Transfer6 Jul 2025
- 2025Flux-Sculptor: Text-Driven Rich-Attribute Portrait Editing through Decomposed Spatial Flow Control5 Jul 2025
- 2025MuseFace: Text-driven Face Editing via Diffusion-based Mask Generation Approach31 Mar 2025
- 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencoder10 Dec 2024
- 2024HAIFAI: Human-AI Interaction for Mental Face Reconstruction9 Dec 2024
- 2024Task-Decoupled Image Inpainting Framework for Class-specific Object Remover3 Oct 2024
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositing6 Sep 2024
- 2024GANs Conditioning Methods: A Survey28 Aug 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
38 more
- 2024UP-FacE: User-predictable Fine-grained Face Shape Editing20 Mar 2024
- 2023ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNet5 Dec 2023
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversion23 Oct 2023
- 2023Completing Visual Objects via Bridging Generation and Segmentation1 Oct 2023
- 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesis22 Jul 2023
- 2023PFB-Diff: Progressive Feature Blending Diffusion for Text-driven Image Editing28 Jun 2023
- 2023SIEDOB: Semantic Image Editing by Disentangling Object and Background23 Mar 2023
- 2023Example Forgetting: A Novel Approach to Explain and Interpret Deep Neural Networks in Seismic Interpretation24 Feb 2023
- 2023LC-NeRF: Local Controllable Face Generation in Neural Randiance Field19 Feb 2023
- 2023Eliminating Contextual Prior Bias for Semantic Image Editing via Dual-Cycle Diffusion5 Feb 2023
- 2022Fine-Grained Face Swapping via Regional GAN Inversion25 Nov 2022
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov 2022
- 2022GAN-based Facial Attribute Manipulation23 Oct 2022
- 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Models19 Oct 2022
- 2022SCAM! Transferring humans between images with Semantic Cross Attention Modulation10 Oct 2022
- 2022MAGIC: Mask-Guided Image Synthesis by Inverting a Quasi-Robust Classifier23 Sep 2022
- 2022Denoised MDPs: Learning World Models Better Than the World Itself30 Jun 2022
- 2022Improved Vector Quantized Diffusion Models31 May 2022
- 2022ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutions24 May 2022
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networks21 May 2022
- 2022RMGN: A Regional Mask Guided Network for Parser-free Virtual Try-on24 Apr 2022
- 2022Dual-Domain Image Synthesis using Segmentation-Guided GAN19 Apr 2022
- 2022Flexible Portrait Image Editing with Fine-Grained Control4 Apr 2022
- 2022Cycle-Consistent Counterfactuals by Latent Transformations28 Mar 2022
- 2022IA-FaceS: A Bidirectional Method for Semantic Face Editing24 Mar 2022
- 2022DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGAN5 Mar 2022
- 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generation28 Feb 2022
- 2022Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data8 Feb 2022
- 2022Interactive Image Inpainting Using Semantic Guidance26 Jan 2022
- 2022Deep Generative Framework for Interactive 3D Terrain Authoring and Manipulation7 Jan 2022
- 2021SuperStyleNet: Deep Image Synthesis with Superpixel Based Style Encoder17 Dec 2021
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesis29 Nov 2021
- 2021MixSyn: Learning Composition and Style for Multi-Source Image Synthesis24 Nov 2021
- 2021SeCGAN: Parallel Conditional Generative Adversarial Networks for Face Editing via Semantic Consistency17 Nov 2021
- 2021FacialGAN: Style Transfer and Attribute Manipulation on Synthetic Faces18 Oct 2021
- 2021Collaging Class-specific GANs for Semantic Image Synthesis8 Oct 2021
- 2021SketchHairSalon: Deep Sketch-based Hair Image Synthesis16 Sep 2021
- 2021ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment13 Sep 2021
50 newest of 61 All 61 (JSON)
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2022Improved Vector Quantized Diffusion Modelscited by 62
- 2023PFB-Diff: Progressive Feature Blending Diffusion for Text-driven Image Editingcited by 20
- 2023Eliminating Contextual Prior Bias for Semantic Image Editing via Dual-Cycle Diffusioncited by 14
- 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Modelscited by 2
- 2025MuseFace: Text-driven Face Editing via Diffusion-based Mask Generation Approachcited by 2
- 2025MuseFace: Text-driven Face Editing via Diffusion-based Mask Generation Approach31 Mar 2025
- 2023PFB-Diff: Progressive Feature Blending Diffusion for Text-driven Image Editing28 Jun 2023
- 2023Eliminating Contextual Prior Bias for Semantic Image Editing via Dual-Cycle Diffusion5 Feb 2023
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov 2022
- 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Models19 Oct 2022
- 2022Improved Vector Quantized Diffusion Models31 May 2022
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesis29 Nov 2021
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
- 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
- 2021High-Fidelity and Arbitrary Face Editingcited by 35
- 2021ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignmentcited by 33
- 2022Cycle-Consistent Counterfactuals by Latent Transformationscited by 33
- 2021DeFLOCNet: Deep Image Editing via Flexible Low-level Controlscited by 26
- 2021Collaging Class-specific GANs for Semantic Image Synthesiscited by 25
- 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
- 2022DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGANcited by 18
12 most cited of 53 All 53 (JSON)
- 2026DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model27 Feb 2026
- 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editing2 Feb 2026
- 2025Heatmap Regression without Soft-Argmax for Facial Landmark Detection19 Aug 2025
- 2025Domain Generalizable Portrait Style Transfer6 Jul 2025
- 2025Flux-Sculptor: Text-Driven Rich-Attribute Portrait Editing through Decomposed Spatial Flow Control5 Jul 2025
- 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencoder10 Dec 2024
- 2024HAIFAI: Human-AI Interaction for Mental Face Reconstruction9 Dec 2024
- 2024Task-Decoupled Image Inpainting Framework for Class-specific Object Remover3 Oct 2024
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositing6 Sep 2024
- 2024GANs Conditioning Methods: A Survey28 Aug 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2024UP-FacE: User-predictable Fine-grained Face Shape Editing20 Mar 2024
12 newest of 53 All 53 (JSON)