mlsanityData to 14 Oct 2026

DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGAN

arXiv 2203.02762 ↗First posted 5 Mar 2022cs.GR cs.CVcited by 18

Not on the map. Why?

Abstract (arXiv)

The research topic of sketch-to-portrait generation has witnessed a boost of progress with deep learning techniques. The recently proposed StyleGAN architectures achieve state-of-the-art generation ability but the original StyleGAN is not friendly for sketch-based creation due to its unconditional generation nature. To address this issue, we propose a direct conditioning strategy to better preserve the spatial information under the StyleGAN framework. Specifically, we introduce Spatially Conditioned StyleGAN (SC-StyleGAN for short), which explicitly injects spatial constraints to the original StyleGAN generation process. We explore two input modalities, sketches and semantic maps, which together allow users to express desired generation results more precisely and easily. Based on SC-StyleGAN, we present DrawingInStyles, a novel drawing interface for non-professional users to easily produce high-quality, photo-realistic face images with precise control, either from scratch or editing existing ones. Qualitative and quantitative evaluations show the superior generation ability of our method to existing and alternative solutions. The usability and expressiveness of our system are confirmed by a user study.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 37 of its 45 references that are in the map. First posted on arXiv 5 Mar 2022.

Builds on

37 of 45 references.

References · 37

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  5. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  6. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  8. 2014Conditional Generative Adversarial Netscited by 2,162
  9. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  10. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  11. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  12. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
25 more
  1. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  2. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  3. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  4. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  5. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
  6. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  7. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  8. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  9. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  10. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  11. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
  12. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  13. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
  14. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
  15. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 268
  16. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  17. 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
  18. 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 106
  19. 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
  20. 2016Scribbler: Controlling Deep Image Synthesis with Sketch and Colorcited by 78
  21. 2019Mask-Guided Portrait Editing with Conditional GANscited by 61
  22. 2020Disentangled Image Generation Through Structured Noise Injectioncited by 39
  23. 2020Deep Plastic Surgery: Robust and Controllable Image Editing with Human-Drawn Sketchescited by 37
  24. 2019LinesToFacePhoto: Face Photo Generation from Lines with Conditional Self-Attention Generative Adversarial Networkcited by 23
  25. 2020DeepFacePencil: Creating Face Images from Freehand Sketchescited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 3; 2024: 7; 2025: 4; 2026: 1.

18 papers.

Sort:

By area:

  1. 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
  2. 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 34
  3. 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
  4. 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 13
  5. 2023AniFaceDrawing: Anime Portrait Exploration during Your Sketchingcited by 7
  6. 2024Comparative Analysis of Generative Models: Enhancing Image Synthesis with VAEs, GANs, and Stable Diffusioncited by 7
  7. 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editingcited by 6
  8. 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketchescited by 5
  9. 2025MoSa: Motion Generation with Scalable Autoregressive Modelingcited by 5
  10. 2025HiFi-Portrait: Zero-shot Identity-preserved Portrait Generation with High-fidelity Multi-face Fusioncited by 5
  11. 2023StyleRetoucher: Generalized Portrait Image Retouching with GAN Priorscited by 3
  12. 2023Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generationcited by 2
6 more
  1. 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospectscited by 2
  2. 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Controlcited by 1
  3. 2022Semantics-Preserving Sketch Embedding for Face Generationcited by 0
  4. 2024FashionEngine: Interactive 3D Human Generation and Editing via Multimodal Controlscited by 0
  5. 2025Sketch-1-to-3: One Single Sketch to 3D Detailed Face Reconstructioncited by 0
  6. 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulationcited by 0