MaskGAN: Towards Diverse and Interactive Facial Image Manipulation
Not on the map. Why?
Cited by 93 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Facial image manipulation has achieved great progress in recent years. However, previous methods either operate on a predefined set of face attributes or leave users little freedom to interactively manipulate images. To overcome these drawbacks, we propose a novel framework termed MaskGAN, enabling diverse and interactive face manipulation. Our key insight is that semantic masks serve as a suitable intermediate representation for flexible face manipulation with fidelity preservation. MaskGAN has two main components: 1) Dense Mapping Network (DMN) and 2) Editing Behavior Simulated Training (EBST). Specifically, DMN learns style mapping between a free-form user modified mask and a target image, enabling diverse generation results. EBST models the user editing behavior on the source mask, making the overall framework more robust to various manipulated inputs. Specifically, it introduces dual-editing consistency as the auxiliary supervision signal. To facilitate extensive studies, we construct a large-scale high-resolution face dataset with fine-grained mask annotations named CelebAMask-HQ. MaskGAN is comprehensively evaluated on two challenging tasks: attribute transfer and style copy, demonstrating superior performance over other state-of-the-art methods. The code, models, and dataset are available at https://github.com/switchablenorms/CelebAMask-HQ.
Key facts. Cited by 624 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 120; 2022: 130; 2023: 135; 2024: 113; 2025: 81; 2026: 45.
624 papers.
Sort:
By area:
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2021GAN Inversion: A Surveycited by 366
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2022Diffusion Models already have a Semantic Latent Spacecited by 324
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
38 more
- 2021Taming Visually Guided Sound Generationcited by 136
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022Semantic Image Synthesis via Diffusion Modelscited by 131
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116
- 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
- 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latentscited by 103
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2023Diffusion Model as Representation Learnercited by 95
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2022High-Quality Entity Segmentationcited by 93
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2023SlotDiffusion: Object-Centric Generative Modeling with Diffusion Modelscited by 85
- 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 84
- 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 79
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
- 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
- 2022Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesiscited by 75
- 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
- 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantizationcited by 68
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
- 2023LayoutDiffuse: Adapting Foundational Diffusion Models for Layout-to-Image Generationcited by 65
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 65
- 2022BCI: Breast Cancer Immunohistochemical Image Generation through Pyramid Pix2pixcited by 61
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
50 most cited of 624 All 624 (JSON)
- 2026Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation29 Sep 2026
- 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection24 Sep 2026
- 2026The Skin-Restricted Reinhard Transform:Uniqueness under a Lightness-Preserving Constraint23 Sep 2026
- 2026Long-Tail Adaptive Flow Matching with Explicit Conditional Consistency Guidance for Precise Multimodal Face Synthesis14 Sep 2026
- 2026Training-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model1 Sep 2026
- 2026RRFC: Recursive Refinement via Feedback Conditioning for Iterative Image-to-Image Generation16 Aug 2026
- 2026AlignFace: Human-Aligned Face Similarity Metric with Interpretable Concept Relations14 Aug 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
- 2026Face De-Identification: A Domain-Centric Survey from Capture to Processing28 Jul 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026Reference-Based Face Super-Resolution Using the Spatial Transformer13 Jul 2026
- 2026AU-Guided Synthetic Video Generation for Micro-Expression Recognition12 Jul 2026
38 more
- 2026Phantom: A Unified Face-Swap Deepfake Protection Framework with Latent and Spatial Constraints30 Jun 2026
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading26 Jun 2026
- 2026H"older++: Improving the Quality-Coherence Trade-off in Multimodal VAEs11 Jun 2026
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs5 Jun 2026
- 2026Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks29 May 2026
- 2026Missing Pattern Recognized Diffusion Imputation Model for Missing Not At Random25 May 2026
- 2026CAMAL: Improving Attention Alignment and Faithfulness with Segmentation Masks8 May 2026
- 2026Towards Fairness under Label Bias in Image Segmentation: Impact, Measurement and Mitigation7 May 2026
- 2026DBMSolver: A Training-free Diffusion Bridge Sampler for High-Quality Image-to-Image Translation7 May 2026
- 2026Zero-Shot Interpretable Image Steganalysis for Invertible Image Hiding2 May 2026
- 2026IdentiFace: Multi-Modal Iterative Diffusion Framework for Identifiable Suspect Face Generation in Crime Investigations1 May 2026
- 2026Meta Additive Model: Interpretable Sparse Learning With Auto Weighting22 Apr 2026
- 2026Prototype-Grounded Concept Models for Verifiable Concept Alignment17 Apr 2026
- 2026SCE-LITE-HQ: Smooth visual counterfactual explanations with generative foundation models17 Mar 2026
- 2026Component-Aware Sketch-to-Image Generation Using Self-Attention Encoding and Coordinate-Preserving Fusion10 Mar 2026
- 2026Improving Generative Adversarial Network Generalization for Facial Expression Synthesis4 Mar 2026
- 2026Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation4 Mar 2026
- 2026HumanOrbit: 3D Human Reconstruction as 360deg Orbit Generation27 Feb 2026
- 2026DiffBMP: Differentiable Rendering with Bitmap Primitives26 Feb 2026
- 2026MaskDiME: Adaptive Masked Diffusion for Precise and Efficient Visual Counterfactual Explanations21 Feb 2026
- 2026DFIC: Towards a balanced facial image dataset for automatic ICAO compliance verification11 Feb 2026
- 2026Med-SegLens: Latent-Level Model Diffing for Interpretable Medical Image Segmentation11 Feb 2026
- 2026Toward Fine-Grained Facial Control in 3D Talking Head Generation10 Feb 2026
- 2026Enhancing Adversarial Robustness with Signed Distance Fields for Harmonizing Geometric Invariance and Texture5 Feb 2026
- 2026SIDeR: Semantic Identity Decoupling for Unrestricted Face Privacy4 Feb 2026
- 2026S3POT: Contrast-Driven Face Occlusion Segmentation via Self-Supervised Prompt Learning31 Jan 2026
- 2026Towards Compact and Robust DNNs via Compression-aware Sharpness Minimization28 Jan 2026
- 2026PaW-ViT: A Patch-based Warping Vision Transformer for Robust Ear Verification27 Jan 2026
- 2026RemEdit: Efficient Diffusion Editing with Riemannian Geometry25 Jan 2026
- 2026DiffFace-Edit: A Diffusion-Based Facial Dataset for Forgery-Semantic Driven Deepfake Detection Analysis20 Jan 2026
- 2026Exploring Talking Head Models With Adjacent Frame Prior for Speech-Preserving Facial Expression Manipulation19 Jan 2026
- 2026AlignVTOFF: Texture-Spatial Feature Alignment for High-Fidelity Virtual Try-Off5 Jan 2026
- 2026ESGaussianFace: Emotional and Stylized Audio-Driven Facial Animation via 3D Gaussian Splatting5 Jan 2026
- 2025PixelArena: A benchmark for Pixel-Precision Visual Intelligence18 Dec 2025
- 2025Improving the Plausibility of Pressure Distributions Synthesized from Depth Image through Generative Modeling15 Dec 2025
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection11 Dec 2025
- 2025Fully Unsupervised Self-debiasing of Text-to-Image Diffusion Models3 Dec 2025
50 newest of 624 All 624 (JSON)
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2022Diffusion Models already have a Semantic Latent Spacecited by 324
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2022Semantic Image Synthesis via Diffusion Modelscited by 131
- 2023Collaborative Diffusion for Multi-Modal Face Generation and Editingcited by 116
- 2022DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latentscited by 103
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2023Diffusion Model as Representation Learnercited by 95
- 2023SlotDiffusion: Object-Centric Generative Modeling with Diffusion Modelscited by 85
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
- 2022Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesiscited by 75
12 most cited of 91 All 91 (JSON)
- 2026Long-Tail Adaptive Flow Matching with Explicit Conditional Consistency Guidance for Precise Multimodal Face Synthesis14 Sep 2026
- 2026Training-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model1 Sep 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading26 Jun 2026
- 2026DBMSolver: A Training-free Diffusion Bridge Sampler for High-Quality Image-to-Image Translation7 May 2026
- 2026Dual Diffusion Models for Multi-modal Guided 3D Avatar Generation4 Mar 2026
- 2026HumanOrbit: 3D Human Reconstruction as 360deg Orbit Generation27 Feb 2026
- 2026MaskDiME: Adaptive Masked Diffusion for Precise and Efficient Visual Counterfactual Explanations21 Feb 2026
- 2025Improving the Plausibility of Pressure Distributions Synthesized from Depth Image through Generative Modeling15 Dec 2025
- 2025Fully Unsupervised Self-debiasing of Text-to-Image Diffusion Models3 Dec 2025
- 2025TPSO: Training-Free Diverse Image Generation via Semantic Prompt Embedding Optimization25 Nov 2025
- 2025Multivariate Diffusion Transformer with Decoupled Attention for High-Fidelity Mask-Text Collaborative Facial Generation16 Nov 2025
12 newest of 91 All 91 (JSON)
- 2024Scissorhands: Scrub Data Influence via Connection Sensitivity in Networkscited by 50
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearningcited by 19
- 2023Copyright Protection and Accountability of Generative AI:Attack, Watermarking and Attributioncited by 15
- 2023When Fairness Meets Privacy: Exploring Privacy Threats in Fair Binary Classifiers via Membership Inference Attackscited by 5
- 2024Unlearning Personal Data from a Single Imagecited by 4
- 2025Mitigating Watermark Forgery in Generative Models via Randomized Key Selectioncited by 4
- 2025Mitigating Watermark Forgery in Generative Models via Randomized Key Selection10 Jul 2025
- 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearning8 Mar 2025
- 2024Unlearning Personal Data from a Single Image16 Jul 2024
- 2024Scissorhands: Scrub Data Influence via Connection Sensitivity in Networks11 Jan 2024
- 2023When Fairness Meets Privacy: Exploring Privacy Threats in Fair Binary Classifiers via Membership Inference Attacks7 Nov 2023
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection10 May 2023
- 2023Copyright Protection and Accountability of Generative AI:Attack, Watermarking and Attribution15 Mar 2023
- 2023SLiMe: Segment Like Mecited by 34
- 2024Personalized Large Vision-Language Modelscited by 12
- 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Modelscited by 12
- 2025Fake-in-Facext: Towards Fine-Grained Explainable DeepFake Analysiscited by 2
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMscited by 0
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs5 Jun 2026
- 2025Fake-in-Facext: Towards Fine-Grained Explainable DeepFake Analysis23 Oct 2025
- 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Models8 Mar 2025
- 2024Personalized Large Vision-Language Models23 Dec 2024
- 2023SLiMe: Segment Like Me6 Sep 2023
- 2021GAN Inversion: A Surveycited by 366
- 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
- 2021Taming Visually Guided Sound Generationcited by 136
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
12 most cited of 519 All 519 (JSON)
- 2026Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation29 Sep 2026
- 2026EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection24 Sep 2026
- 2026The Skin-Restricted Reinhard Transform:Uniqueness under a Lightness-Preserving Constraint23 Sep 2026
- 2026RRFC: Recursive Refinement via Feedback Conditioning for Iterative Image-to-Image Generation16 Aug 2026
- 2026AlignFace: Human-Aligned Face Similarity Metric with Interpretable Concept Relations14 Aug 2026
- 2026TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment30 Jul 2026
- 2026Face De-Identification: A Domain-Centric Survey from Capture to Processing28 Jul 2026
- 2026Reference-Based Face Super-Resolution Using the Spatial Transformer13 Jul 2026
- 2026AU-Guided Synthetic Video Generation for Micro-Expression Recognition12 Jul 2026
- 2026Phantom: A Unified Face-Swap Deepfake Protection Framework with Latent and Spatial Constraints30 Jun 2026
- 2026H"older++: Improving the Quality-Coherence Trade-off in Multimodal VAEs11 Jun 2026
- 2026Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks29 May 2026
12 newest of 519 All 519 (JSON)