Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes
Not on the map. Why?
Abstract (arXiv)
There have been many successful implementations of neural style transfer in recent years. In most of these works, the stylization process is confined to the pixel domain. However, we argue that this representation is unnatural because paintings usually consist of brushstrokes rather than pixels. We propose a method to stylize images by optimizing parameterized brushstrokes instead of pixels and further introduce a simple differentiable rendering mechanism. Our approach significantly improves visual quality and enables additional control over the stylization process such as controlling the flow of brushstrokes through user input. We provide qualitative and quantitative evaluations that show the efficacy of the proposed parameterized representation.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 31 Mar 2021.
Builds on
39 of 60 references.
References · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
27 more
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2017Universal Style Transfer via Feature Transformscited by 352
- 2016A Learned Representation For Artistic Stylecited by 340
- 2017A Neural Representation of Sketch Drawingscited by 311
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 173
- 2017Demystifying Neural Style Transfercited by 152
- 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
- 2018Synthesizing Programs for Images using Reinforced Adversarial Learningcited by 72
- 2019Learning to Paint With Model-based Deep Reinforcement Learningcited by 70
- 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
- 2018A Style-Aware Content Loss for Real-time HD Style Transfercited by 58
- 2020Collaborative Distillation for Ultra-Resolution Universal Style Transfercited by 52
- 2018Learning Linear Transformations for Fast Arbitrary Style Transfercited by 48
- 2019Diversified Arbitrary Style Transfer via Deep Feature Perturbationcited by 42
- 2019Two-Stage Peer-Regularized Feature Recombination for Arbitrary Image Style Transfercited by 36
- 2020Optical Flow Distillation: Towards Efficient and Stable Video Style Transfercited by 34
- 2020Deformable Style Transfercited by 31
- 2020Joint Bilateral Learning for Real-time Universal Photorealistic Style Transfercited by 31
- 2019Neural Painters: A learned differentiable constraint for generating brushstroke paintingscited by 28
- 2019Unsupervised Doodling and Painting with Improved SPIRALcited by 21
- 2018MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfercited by 16
- 2020Domain-Specific Mappings for Generative Adversarial Style Transfercited by 16
- 2020Filter Style Transfer between Photoscited by 10
- 2019PaintBot: A Reinforcement Learning Approach for Natural Media Paintingcited by 4
Built on by
Citing papers per year: 2021: 6; 2022: 12; 2023: 9; 2024: 6; 2025: 3; 2026: 6.
42 papers.
Sort:
By area:
- 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
- 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 186
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
- 2021Paint Transformer: Feed Forward Neural Painting with Stroke Predictioncited by 61
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
- 2022MicroAST: Towards Super-Fast Ultra-Resolution Arbitrary Style Transfercited by 19
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
- 2023Stroke-based Neural Painting and Stylization with Dynamically Predicted Painting Regioncited by 14
30 more
- 2021Facial-Sketch Synthesis: A New Challengecited by 13
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
- 2022Industrial Style Transfer with Large-scale Geometric Warping and Content Preservationcited by 9
- 2022Im2Oil: Stroke-Based Oil Painting Rendering with Linearly Controllable Fineness Via Adaptive Samplingcited by 9
- 2024VectorPainter: Advanced Stylized Vector Graphics Synthesis Using Stroke-Style Priorscited by 7
- 2021Intelli-Paint: Towards Developing Human-like Painting Agentscited by 6
- 2022Paint2Pix: Interactive Painting based Progressive Image Synthesis and Editingcited by 6
- 2024Inverse Painting: Reconstructing The Painting Processcited by 6
- 2022WISE: Whitebox Image Stylization by Example-based Learningcited by 5
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Modelscited by 5
- 2022Interactive Cartoonization with Controllable Perceptual Factorscited by 4
- 2022Stroke-based Rendering: From Heuristics to Deep Learningcited by 4
- 2023Multimodality-guided Image Style Transfer using Cross-modal GAN Inversioncited by 4
- 2023ITstyler: Image-optimized Text-based Style Transfercited by 3
- 2023Computational Approaches for Traditional Chinese Painting: From the "Six Principles of Painting" Perspectivecited by 3
- 2024D2Styler: Advancing Arbitrary Style Transfer with Discrete Diffusion Methodscited by 3
- 2024WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussianscited by 3
- 2021CAMS: Color-Aware Multi-Style Transfercited by 2
- 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Artcited by 2
- 2022Interactive Style Transfer: All is Your Palettecited by 1
- 2023Interactive Neural Paintingcited by 1
- 2023Collaborative Neural Paintingcited by 1
- 2025Text2VDM: Text to Vector Displacement Maps for Expressive and Interactive 3D Sculptingcited by 1
- 2026Thinking Like Van Gogh: Structure-Aware Style Transfer via Flow-Guided 3D Gaussian Splattingcited by 1
- 2026Look, Compare and Draw: Differential Query Transformer for Automatic Oil Paintingcited by 1
- 2023Neural Collage Transfer: Artistic Reconstruction via Material Manipulationcited by 0
- 2026Parameterized Brushstroke Style Transfercited by 0
- 2026Image-Guided Geometric Stylization of 3D Meshescited by 0
- 2026PaintCopilot: Modeling Painting as Autonomous Artistic Continuationcited by 0
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglementcited by 0
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglement14 Jul 2026
- 2026PaintCopilot: Modeling Painting as Autonomous Artistic Continuation20 May 2026
- 2026Image-Guided Geometric Stylization of 3D Meshes9 Apr 2026
- 2026Look, Compare and Draw: Differential Query Transformer for Automatic Oil Painting29 Mar 2026
- 2026Parameterized Brushstroke Style Transfer8 Mar 2026
- 2026Thinking Like Van Gogh: Structure-Aware Style Transfer via Flow-Guided 3D Gaussian Splatting15 Jan 2026
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Models5 Aug 2025
- 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art15 Mar 2025
- 2025Text2VDM: Text to Vector Displacement Maps for Expressive and Interactive 3D Sculpting27 Feb 2025
- 2024Inverse Painting: Reconstructing The Painting Process30 Sep 2024
- 2024WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians26 Sep 2024
- 2024D2Styler: Advancing Arbitrary Style Transfer with Discrete Diffusion Methods7 Aug 2024
30 more
- 2024ProcessPainter: Learn Painting Process from Sequence Data10 Jun 2024
- 2024VectorPainter: Advanced Stylized Vector Graphics Synthesis Using Stroke-Style Priors5 May 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2023Collaborative Neural Painting4 Dec 2023
- 2023Multimodality-guided Image Style Transfer using Cross-modal GAN Inversion4 Dec 2023
- 2023Neural Collage Transfer: Artistic Reconstruction via Material Manipulation3 Nov 2023
- 2023Stroke-based Neural Painting and Stylization with Dynamically Predicted Painting Region7 Sep 2023
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models15 Aug 2023
- 2023Interactive Neural Painting31 Jul 2023
- 2023Computational Approaches for Traditional Chinese Painting: From the "Six Principles of Painting" Perspective26 Jul 2023
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Models26 Jun 2023
- 2023ITstyler: Image-optimized Text-based Style Transfer26 Jan 2023
- 2022Stroke-based Rendering: From Heuristics to Deep Learning30 Dec 2022
- 2022Interactive Cartoonization with Controllable Perceptual Factors19 Dec 2022
- 2022MicroAST: Towards Super-Fast Ultra-Resolution Arbitrary Style Transfer28 Nov 2022
- 2022Im2Oil: Stroke-Based Oil Painting Rendering with Linearly Controllable Fineness Via Adaptive Sampling27 Sep 2022
- 2022Paint2Pix: Interactive Painting based Progressive Image Synthesis and Editing17 Aug 2022
- 2022WISE: Whitebox Image Stylization by Example-based Learning29 Jul 2022
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfer25 Jul 2022
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer11 Jul 2022
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translation25 May 2022
- 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning24 May 2022
- 2022Interactive Style Transfer: All is Your Palette25 Mar 2022
- 2022Industrial Style Transfer with Large-scale Geometric Warping and Content Preservation24 Mar 2022
- 2021Facial-Sketch Synthesis: A New Challenge31 Dec 2021
- 2021Intelli-Paint: Towards Developing Human-like Painting Agents16 Dec 2021
- 2021CLIPstyler: Image Style Transfer with a Single Text Condition1 Dec 2021
- 2021Paint Transformer: Feed Forward Neural Painting with Stroke Prediction9 Aug 2021
- 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoders28 Jun 2021
- 2021CAMS: Color-Aware Multi-Style Transfer26 Jun 2021
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Modelscited by 5
- 2024D2Styler: Advancing Arbitrary Style Transfer with Discrete Diffusion Methodscited by 3
- 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Artcited by 2
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglementcited by 0
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglement14 Jul 2026
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Models5 Aug 2025
- 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art15 Mar 2025
- 2024D2Styler: Advancing Arbitrary Style Transfer with Discrete Diffusion Methods7 Aug 2024
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models15 Aug 2023
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Models26 Jun 2023
- 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
- 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 186
- 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
- 2021Paint Transformer: Feed Forward Neural Painting with Stroke Predictioncited by 61
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
- 2022MicroAST: Towards Super-Fast Ultra-Resolution Arbitrary Style Transfercited by 19
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
- 2023Stroke-based Neural Painting and Stylization with Dynamically Predicted Painting Regioncited by 14
- 2021Facial-Sketch Synthesis: A New Challengecited by 13
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
12 most cited of 36 All 36 (JSON)
- 2026PaintCopilot: Modeling Painting as Autonomous Artistic Continuation20 May 2026
- 2026Image-Guided Geometric Stylization of 3D Meshes9 Apr 2026
- 2026Look, Compare and Draw: Differential Query Transformer for Automatic Oil Painting29 Mar 2026
- 2026Parameterized Brushstroke Style Transfer8 Mar 2026
- 2026Thinking Like Van Gogh: Structure-Aware Style Transfer via Flow-Guided 3D Gaussian Splatting15 Jan 2026
- 2025Text2VDM: Text to Vector Displacement Maps for Expressive and Interactive 3D Sculpting27 Feb 2025
- 2024Inverse Painting: Reconstructing The Painting Process30 Sep 2024
- 2024WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians26 Sep 2024
- 2024ProcessPainter: Learn Painting Process from Sequence Data10 Jun 2024
- 2024VectorPainter: Advanced Stylized Vector Graphics Synthesis Using Stroke-Style Priors5 May 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2023Collaborative Neural Painting4 Dec 2023
12 newest of 36 All 36 (JSON)