Interactive Cartoonization with Controllable Perceptual Factors
Not on the map. Why?
Abstract (arXiv)
Cartoonization is a task that renders natural photos into cartoon styles. Previous deep cartoonization methods only have focused on end-to-end translation, which may hinder editability. Instead, we propose a novel solution with editing features of texture and color based on the cartoon creation process. To do that, we design a model architecture to have separate decoders, texture and color, to decouple these attributes. In the texture decoder, we propose a texture controller, which enables a user to control stroke style and abstraction to generate diverse cartoon textures. We also introduce an HSV color augmentation to induce the networks to generate diverse and controllable color translation. To the best of our knowledge, our work is the first deep approach to control the cartoonization at inference while showing profound quality improvement over to baselines.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 19 Dec 2022.
Builds on
19 of 38 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
7 more
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 211
- 2021Rethinking Style Transfer: From Pixels to Parameterized Brushstrokescited by 42
- 2018Stroke Controllable Fast Style Transfer with Adaptive Receptive Fieldscited by 33
- 2021Learning the Superpixel in a Non-iterative and Lifelong Mannercited by 12
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 1.
4 papers.
- 2023DreamStyler: Paint by Style Inversion with Text-to-Image Diffusion Modelscited by 26
- 2024Noise Calibration: Plug-and-play Content-Preserving Video Enhancement using Pre-trained Video Diffusion Modelscited by 5
- 2025UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesiscited by 1
- 2023Private Gradient Estimation is Useful for Generative Modelingcited by 0
- 2025UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesis14 Mar 2025
- 2024Noise Calibration: Plug-and-play Content-Preserving Video Enhancement using Pre-trained Video Diffusion Models14 Jul 2024
- 2023DreamStyler: Paint by Style Inversion with Text-to-Image Diffusion Models13 Sep 2023
- 2023Private Gradient Estimation is Useful for Generative Modeling18 May 2023