Tool- and Domain-Agnostic Parameterization of Style Transfer Effects Leveraging Pretrained Perceptual Metrics
Not on the map. Why?
Abstract (arXiv)
Current deep learning techniques for style transfer would not be optimal for design support since their "one-shot" transfer does not fit exploratory design processes. To overcome this gap, we propose parametric transcription, which transcribes an end-to-end style transfer effect into parameter values of specific transformations available in an existing content editing tool. With this approach, users can imitate the style of a reference sample in the tool that they are familiar with and thus can easily continue further exploration by manipulating the parameters. To enable this, we introduce a framework that utilizes an existing pretrained model for style transfer to calculate a perceptual style distance to the reference sample and uses black-box optimization to find the parameters that minimize this distance. Our experiments with various third-party tools, such as Instagram and Blender, show that our framework can effectively leverage deep learning techniques for computational design support.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 46 references that are in the map. First posted on arXiv 19 May 2021.
Builds on
19 of 46 references.
References · 19
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
- 2016Tutorial on Variational Autoencoderscited by 404
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
- 2017Neural Style Transfer: A Reviewcited by 199
- 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
- 2017Deep Photo Style Transfercited by 168
7 more
- 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 63
- 2018ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributescited by 50
- 2017Exposure: A White-Box Photo Post-Processing Frameworkcited by 27
- 2020Sequential Gallery for Interactive Visual Design Optimizationcited by 24
- 2018Latent Space Non-Linear Statisticscited by 12
- 2019MulGAN: Facial Attribute Editing by Exemplarcited by 8
- 2020Computational Design with Crowdscited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.