SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Color
Not on the map. Why?
Abstract (arXiv)
We present a novel image editing system that generates images as the user provides free-form mask, sketch and color as an input. Our system consist of a end-to-end trainable convolutional network. Contrary to the existing methods, our system wholly utilizes free-form user input with color and shape. This allows the system to respond to the user's sketch and color input, using it as a guideline to generate an image. In our particular work, we trained network with additional style loss which made it possible to generate realistic results, despite large portions of the image being removed. Our proposed network architecture SC-FEGAN is well suited to generate high quality synthetic image using intuitive user inputs.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 33; 2023: 14; 2024: 20; 2025: 9; 2026: 2.
105 papers.
Sort:
By area:
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 79
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 42
38 more
- 2021Bridging Global Context Interactions for High-Fidelity Image Completioncited by 40
- 2022Neural Strands: Learning Hair Geometry and Appearance from Multi-View Imagescited by 39
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
- 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 32
- 2021LOHO: Latent Optimization of Hairstyles via Orthogonalizationcited by 30
- 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
- 2022Sketching without Worrying: Noise-Tolerant Sketch-Based Image Retrievalcited by 27
- 2023Contrastive Pseudo Learning for Open-World DeepFake Attributioncited by 27
- 2021DeFLOCNet: Deep Image Editing via Flexible Low-level Controlscited by 26
- 2021Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenescited by 25
- 2021Towards Open-World Text-Guided Face Image Generation and Manipulationcited by 25
- 2021Adversarial Open Domain Adaptation for Sketch-to-Photo Synthesiscited by 24
- 2024AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenariocited by 22
- 2021High Resolution Face Editing with Masked GAN Latent Code Optimizationcited by 21
- 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
- 2022DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGANcited by 18
- 2023HairCLIPv2: Unifying Hair Editing via Proxy Feature Blendingcited by 17
- 2022Learning Prior Feature and Attention Enhanced Image Inpaintingcited by 16
- 2022Style Your Hair: Latent Optimization for Pose-Invariant Hairstyle Transfer via Local-Style-Aware Hair Alignmentcited by 16
- 2022GAN-based Facial Attribute Manipulationcited by 16
- 2021Barbershop: GAN-based Image Compositing using Segmentation Maskscited by 14
- 2021The Image Local Autoregressive Transformercited by 14
- 2024FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Featurescited by 14
- 202415M Multimodal Facial Image-Text Datasetcited by 14
- 2023SIEDOB: Semantic Image Editing by Disentangling Object and Backgroundcited by 11
- 2022Context-Consistent Semantic Image Editing with Style-Preserved Modulationcited by 10
- 2023Reference-Guided Large-Scale Face Inpainting with Identity and Texture Controlcited by 10
- 2024HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attentioncited by 10
- 2024HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approachcited by 10
- 2021ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translationcited by 9
- 2022HairFIT: Pose-Invariant Hairstyle Transfer via Flow-based Hair Alignment and Semantic-Region-Aware Inpaintingcited by 9
- 2022Image Inpainting via Iteratively Decoupled Probabilistic Modelingcited by 9
- 2021Decorating Your Own Bedroom: Locally Controlling Image Generation with Generative Adversarial Networkscited by 8
- 2022Shape-guided Object Inpaintingcited by 8
- 2022Cross-Forgery Analysis of Vision Transformers and CNNs for Deepfake Image Detectioncited by 8
- 2022ManiCLIP: Multi-Attribute Face Manipulation from Textcited by 8
- 2023SketchFFusion: Sketch-guided image editing with diffusion modelcited by 8
- 2021Deep Face Video Inpainting via UV Mappingcited by 7
50 most cited of 105 All 105 (JSON)
- 2026SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting21 Apr 2026
- 2026AlignVTOFF: Texture-Spatial Feature Alignment for High-Fidelity Virtual Try-Off5 Jan 2026
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Models13 Oct 2025
- 2025Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing19 Aug 2025
- 2025Annotation-Free Human Sketch Quality Assessment28 Jul 2025
- 2025Learning Counterfactually Decoupled Attention for Open-World Model Attribution29 Jun 2025
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution7 May 2025
- 2025GroomLight: Hybrid Inverse Rendering for Relightable Human Hair Appearance Modeling13 Mar 2025
- 2025Interactive Tumor Progression Modeling via Sketch-Based Image Editing10 Mar 2025
- 2025Sketch-1-to-3: One Single Sketch to 3D Detailed Face Reconstruction25 Feb 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
38 more
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
- 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model16 Dec 2024
- 2024Improving Detail in Pluralistic Image Inpainting with Feature Dequantization2 Dec 2024
- 2024MagicQuill: An Intelligent Interactive Image Editing System14 Nov 2024
- 2024Active Fake: DeepFake Camouflage5 Sep 2024
- 2024IMAGDressing-v1: Customizable Virtual Dressing17 Jul 2024
- 202415M Multimodal Facial Image-Text Dataset11 Jul 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
- 2024AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenario28 May 2024
- 2024Assessing Image Inpainting via Re-Inpainting Self-Consistency Evaluation25 May 2024
- 2024Sketch-guided Image Inpainting with Partial Discrete Diffusion Process18 Apr 2024
- 2024FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features15 Apr 2024
- 2024HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach1 Apr 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024Inpainting-Driven Mask Optimization for Object Removal23 Mar 2024
- 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignment19 Mar 2024
- 2024HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attention22 Feb 2024
- 2024Panoramic Image Inpainting With Gated Convolution And Contextual Reconstruction Loss5 Feb 2024
- 2024Repositioning the Subject within Image30 Jan 2024
- 2023On Mask-based Image Set Desensitization with Recognition Support14 Dec 2023
- 2023HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending16 Oct 2023
- 2023Contrastive Pseudo Learning for Open-World DeepFake Attribution20 Sep 2023
- 2023Towards Interactive Image Inpainting via Sketch Refinement1 Jun 2023
- 2023LaCon: Late-Constraint Diffusion for Steerable Guided Image Synthesis19 May 2023
- 2023GRIG: Few-Shot Generative Residual Image Inpainting24 Apr 2023
- 2023Learning Geometry-aware Representations by Sketching17 Apr 2023
- 2023SketchFFusion: Sketch-guided image editing with diffusion model6 Apr 2023
- 2023Synthesizing Anyone, Anywhere, in Any Pose6 Apr 2023
- 2023SIEDOB: Semantic Image Editing by Disentangling Object and Background23 Mar 2023
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketches20 Mar 2023
- 2023Reference-Guided Large-Scale Face Inpainting with Identity and Texture Control13 Mar 2023
- 2023Few-shots Portrait Generation with Style Enhancement and Identity Preservation1 Mar 2023
- 2023Reference Guided Image Inpainting using Facial Attributes19 Jan 2023
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models16 Dec 2022
- 2022Structure-Guided Image Completion with Image-level and Object-level Semantic Discriminators13 Dec 2022
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection12 Dec 2022
- 2022Image Inpainting via Iteratively Decoupled Probabilistic Modeling6 Dec 2022
- 2022Extracting Semantic Knowledge from GANs with Unsupervised Learning30 Nov 2022
50 newest of 105 All 105 (JSON)
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2023SketchFFusion: Sketch-guided image editing with diffusion modelcited by 8
- 2024Sketch-guided Image Inpainting with Partial Discrete Diffusion Processcited by 7
- 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Modelcited by 5
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Modelscited by 5
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completioncited by 1
- 2023LaCon: Late-Constraint Diffusion for Steerable Guided Image Synthesiscited by 1
- 2025Interactive Tumor Progression Modeling via Sketch-Based Image Editingcited by 1
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Models13 Oct 2025
- 2025Interactive Tumor Progression Modeling via Sketch-Based Image Editing10 Mar 2025
- 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model16 Dec 2024
- 2024IMAGDressing-v1: Customizable Virtual Dressing17 Jul 2024
- 2024Sketch-guided Image Inpainting with Partial Discrete Diffusion Process18 Apr 2024
- 2023LaCon: Late-Constraint Diffusion for Steerable Guided Image Synthesis19 May 2023
- 2023SketchFFusion: Sketch-guided image editing with diffusion model6 Apr 2023
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Models16 Dec 2022
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completion18 Nov 2022
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 79
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 42
- 2021Bridging Global Context Interactions for High-Fidelity Image Completioncited by 40
- 2022Neural Strands: Learning Hair Geometry and Appearance from Multi-View Imagescited by 39
12 most cited of 95 All 95 (JSON)
- 2026SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting21 Apr 2026
- 2026AlignVTOFF: Texture-Spatial Feature Alignment for High-Fidelity Virtual Try-Off5 Jan 2026
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
- 2025Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing19 Aug 2025
- 2025Annotation-Free Human Sketch Quality Assessment28 Jul 2025
- 2025DATA: Multi-Disentanglement based Contrastive Learning for Open-World Semi-Supervised Deepfake Attribution7 May 2025
- 2025GroomLight: Hybrid Inverse Rendering for Relightable Human Hair Appearance Modeling13 Mar 2025
- 2025Sketch-1-to-3: One Single Sketch to 3D Detailed Face Reconstruction25 Feb 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
- 2024Improving Detail in Pluralistic Image Inpainting with Feature Dequantization2 Dec 2024
- 2024MagicQuill: An Intelligent Interactive Image Editing System14 Nov 2024
12 newest of 95 All 95 (JSON)