mlsanityData to 14 Oct 2026

DreamStyler: Paint by Style Inversion with Text-to-Image Diffusion Models

arXiv 2309.06933 ↗First posted 13 Sep 2023cs.CVcited by 27

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent progresses in large-scale text-to-image models have yielded remarkable accomplishments, finding various applications in art domain. However, expressing unique characteristics of an artwork (e.g. brushwork, colortone, or composition) with text prompts alone may encounter limitations due to the inherent constraints of verbal description. To this end, we introduce DreamStyler, a novel framework designed for artistic image synthesis, proficient in both text-to-image synthesis and style transfer. DreamStyler optimizes a multi-stage textual embedding with a context-aware text prompt, resulting in prominent image quality. In addition, with content and style guidance, DreamStyler exhibits flexibility to accommodate a range of style references. Experimental results demonstrate its superior performance across multiple scenarios, suggesting its promising potential in artistic product creation.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 24 of its 27 references that are in the map. First posted on arXiv 13 Sep 2023.

Builds on

24 of 27 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  2. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  3. 2022Inversion-Based Style Transfer with Diffusion Models23 Nov
  4. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
  5. 2022UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance28 Oct
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  7. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  9. 2022Perception Prioritized Training of Diffusion Modelscited by 303
  10. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  11. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
  12. 2021StyTr2: Image Style Transfer with Transformerscited by 187
4 more
  1. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  2. 2023AesPA-Net: Aesthetic Pattern-Aware Style Transfer Networkscited by 34
  3. 2022AesUST: Towards Aesthetic-Enhanced Universal Style Transfercited by 21
  4. 2022Interactive Cartoonization with Controllable Perceptual Factorscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 10; 2025: 12; 2026: 3.

27 papers.

Sort:

By area:

  1. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 63
  2. 2024StyleShot: A Snapshot on Any Stylecited by 62
  3. 2023Mini-DALLE3: Interactive Text to Image by Prompting Large Language Modelscited by 22
  4. 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Modelscited by 22
  5. 2024Diffusion-Based Visual Art Creation: A Survey and New Perspectivescited by 17
  6. 2024InstructG2I: Synthesizing Images from Multimodal Attributed Graphscited by 14
  7. 2024Imperceptible Protection against Style Imitation from Diffusion Modelscited by 9
  8. 2025Free-Lunch Color-Texture Disentanglement for Stylized Image Generationcited by 8
  9. 2024Isolated Diffusion: Optimizing Multi-Concept Text-to-Image Generation Training-Freely with Isolated Diffusion Guidancecited by 6
  10. 2024Ada-adapter:Fast Few-shot Style Personlization of Diffusion Model with Pre-trained Image Encodercited by 5
  11. 2024Font Style Interpolation with Diffusion Modelscited by 3
  12. 2024D2Styler: Advancing Arbitrary Style Transfer with Discrete Diffusion Methodscited by 3
15 more
  1. 2025Hummingbird: High Fidelity Image Generation via Multimodal Context Alignmentcited by 3
  2. 2025Control and Realism: Best of Both Worlds in Layout-to-Image without Trainingcited by 3
  3. 2026CleanStyle: Plug-and-Play Style Conditioning Purification for Text-to-Image Stylizationcited by 3
  4. 2025StyleBlend: Enhancing Style-Specific Content Creation in Text-to-Image Diffusion Modelscited by 2
  5. 2025Personalized Image Filter: Mastering Your Photographic Stylecited by 2
  6. 2025HSI: A Holistic Style Injector for Arbitrary Style Transfercited by 1
  7. 2025Semantix: An Energy Guided Sampler for Semantic Style Transfercited by 1
  8. 2025Edge-Assisted Collaborative Fine-Tuning for Multi-User Personalized Artificial Intelligence Generated Content (AIGC)cited by 1
  9. 2024Cross-Domain Image Conversion by CycleDMcited by 0
  10. 2025Solar Altitude Guided Scene Illuminationcited by 0
  11. 2025SPG: Style-Prompting Guidance for Style-Specific Content Creationcited by 0
  12. 2025Image Generation Based on Image Style Extractioncited by 0
  13. 2025PC-Diffusion: Aligning Diffusion Models with Human Preferences via Preference Classifiercited by 0
  14. 2026Jailbreaking Text-to-Image Models Through Cracks: Navigating Heterogeneous Safety Filters via Multi-Agent Debatecited by 0
  15. 2026Beyond User-Side Defenses: Image Protection in Open-Weight Diffusion Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025The Cow of Rembrandt - Analyzing Artistic Prompt Interpretation in Text-to-Image Models
  2. 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfer
  3. 2024Towards Highly Realistic Artistic Style Transfer via Stable Diffusion with Step-aware and Layer-aware Prompt
  4. 2024CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion
  5. 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Models
  6. 2025ArtCrafter: Text-Image Aligning Style Transfer via Embedding Reframing
  7. 2025Style Composition within Distinct LoRA modules for Traditional Art
  8. 2024ArtWeaver: Advanced Dynamic Style Integration via Diffusion Model