Bridging Unpaired Facial Photos And Sketches By Line-drawings
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel method to learn face sketch synthesis models by using unpaired data. Our main idea is bridging the photo domain X and the sketch domain Y by using the line-drawing domain Z. Specially, we map both photos and sketches to line-drawings by using a neural style transfer method, i.e. F: X/Y mapsto Z. Consequently, we obtain textitpseudo paired data (Z, Y), and can learn the mapping G:Z mapsto Y in a supervised learning manner. In the inference stage, given a facial photo, we can first transfer it to a line-drawing and then to a sketch by G circ F. Additionally, we propose a novel stroke loss for generating different types of strokes. Our method, termed sRender, accords well with human artists' rendering process. Experimental results demonstrate that sRender can generate multi-style sketches, and significantly outperforms existing unpaired image-to-image translation methods.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 18 of its 28 references that are in the map. First posted on arXiv 1 Feb 2021.
Builds on
18 of 28 references.
References · 18
- 2016Densely Connected Convolutional Networkscited by 6,707
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,687
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,005
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,178
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
- 2015A Neural Algorithm of Artistic Stylecited by 481
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2017Neural Style Transfer: A Reviewcited by 199
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
6 more
- 2020Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translationcited by 60
- 2017High-Quality Facial Photo-Sketch Synthesis Using Multi-Adversarial Networkscited by 11
- 2019Scoot: A Perceptual Metric for Facial Sketchescited by 10
- 2018Semi-Supervised Learning for Face Sketch Synthesis in the Wildcited by 7
- 2020Face Sketch Synthesis with Style Transfer using Pyramid Column Featurecited by 6
- 2020Making Robots Draw A Vivid Portrait In Two Minutescited by 3
Built on by
Not cited yet.