mlsanityData to 14 Oct 2026

StyleBrush: Style Extraction and Transfer from a Single Image

arXiv 2408.09496 ↗First posted 18 Aug 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Stylization for visual content aims to add specific style patterns at the pixel level while preserving the original structural features. Compared with using predefined styles, stylization guided by reference style images is more challenging, where the main difficulty is to effectively separate style from structural elements. In this paper, we propose StyleBrush, a method that accurately captures styles from a reference image and ``brushes'' the extracted style onto other input visual content. Specifically, our architecture consists of two branches: ReferenceNet, which extracts style from the reference image, and Structure Guider, which extracts structural features from the input image, thus enabling image-guided stylization. We utilize LLM and T2I models to create a dataset comprising 100K high-quality style images, encompassing a diverse range of styles and contents with high aesthetic score. To construct training pairs, we crop different regions of the same training image. Experiments show that our approach achieves state-of-the-art results through both qualitative and quantitative analyses. We will release our code and dataset upon acceptance of the paper.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 18 Aug 2024.

Builds on

24 of 38 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  10. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  11. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  12. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
12 more
  1. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
  2. 2017Neural Style Transfer: A Reviewcited by 199
  3. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
  4. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 196
  5. 2021StyTr2: Image Style Transfer with Transformerscited by 187
  6. 2017Exploring the structure of a real-time, arbitrary neural artistic stylization networkcited by 89
  7. 2024DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representationscited by 68
  8. 2024Visual Style Prompting with Swapping Self-Attentioncited by 63
  9. 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
  10. 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 43
  11. 2023CAP-VSTNet: Content Affinity Preserved Versatile Style Transfercited by 24
  12. 2024From Parts to Whole: A Unified Reference Framework for Controllable Human Image Generationcited by 17

Built on by

Not cited yet.