mlsanityData to 14 Oct 2026

ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptation

arXiv 2312.02109 ↗First posted 4 Dec 2023cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

This work introduces ArtAdapter, a transformative text-to-image (T2I) style transfer framework that transcends traditional limitations of color, brushstrokes, and object shape, capturing high-level style elements such as composition and distinctive artistic expression. The integration of a multi-level style encoder with our proposed explicit adaptation mechanism enables ArtAdapter to achieve unprecedented fidelity in style transfer, ensuring close alignment with textual descriptions. Additionally, the incorporation of an Auxiliary Content Adapter (ACA) effectively separates content from style, alleviating the borrowing of content from style references. Moreover, our novel fast finetuning approach could further enhance zero-shot style representation while mitigating the risk of overfitting. Comprehensive evaluations confirm that ArtAdapter surpasses current state-of-the-art methods.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 41 of its 51 references that are in the map. First posted on arXiv 4 Dec 2023.

Builds on

41 of 51 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  11. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  12. 2022Classifier-Free Diffusion Guidancecited by 5,847
29 more
  1. 2022Generative Adversarial Networkscited by 5,627
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  9. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  10. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  11. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  13. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
  14. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  15. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  16. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  17. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
  18. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  19. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  20. 2021StyTr2: Image Style Transfer with Transformerscited by 187
  21. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  22. 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
  23. 2023Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Modelscited by 117
  24. 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
  25. 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
  26. 2017Exploring the structure of a real-time, arbitrary neural artistic stylization networkcited by 89
  27. 2023Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Modelscited by 62
  28. 2021Language-Driven Image Style Transfercited by 37
  29. 2023ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 17; 2025: 17; 2026: 6.

40 papers.

Sort:

By area:

  1. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 83
  2. 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
  3. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  4. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  5. 2024Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmarkcited by 23
  6. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  7. 2024Conditional Balance: Improving Multi-Conditioning Trade-Offs in Image Generationcited by 9
  8. 2025ConsisLoRA: Enhancing Content and Style Consistency for LoRA-based Style Transfercited by 9
  9. 2024Multi-modal Generative AI: Multi-modal LLMs, Diffusions, and the Unificationcited by 8
  10. 2025Subject or Style: Adaptive and Training-Free Mixture of LoRAscited by 5
  11. 2025SplitFlux: Learning to Decouple Content and Style from a Single Imagecited by 5
  12. 2025ArtCrafter: Text-Image Aligning Style Transfer via Embedding Reframingcited by 4
28 more
  1. 2025SCSA: A Plug-and-Play Semantic Continuous-Sparse Attention for Arbitrary Semantic Style Transfercited by 4
  2. 2025Distribution-Conditional Generation: From Class Distribution to Creative Generationcited by 4
  3. 2024Volumetric Conditioning Module to Control Pretrained Diffusion Models for 3D Medical Imagescited by 3
  4. 2025Control and Realism: Best of Both Worlds in Layout-to-Image without Trainingcited by 3
  5. 2025CameraMaster: Unified Camera Semantic-Parameter Control for Photography Retouchingcited by 3
  6. 2026EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generationcited by 3
  7. 2024Redefining <Creative> in Dictionary: Towards an Enhanced Semantic Understanding of Creative Generationcited by 2
  8. 2025Category-Aware 3D Object Composition with Disentangled Texture and Shape Multi-view Diffusioncited by 2
  9. 2024PixelShuffler: A Simple Image Translation Through Pixel Rearrangementcited by 1
  10. 2024DomainGallery: Few-shot Domain-driven Image Generation by Attribute-centric Finetuningcited by 1
  11. 2024Safety Without Semantic Disruptions: Editing-free Safe Image Generation via Context-preserving Dual Latent Reconstructioncited by 1
  12. 2024USEFUSE: Uniform Stride for Enhanced Performance in Fused Layer Architecture of Deep Neural Networkscited by 1
  13. 2024WikiStyle+: A Multimodal Approach to Content-Style Representation Disentanglement for Artistic Image Stylizationcited by 1
  14. 2024Single Trajectory Distillation for Accelerating Image and Video Style Transfercited by 1
  15. 2025Coffee: Controllable Diffusion Fine-tuningcited by 1
  16. 2024ArtWeaver: Advanced Dynamic Style Integration via Diffusion Modelcited by 0
  17. 2024Improving Fine-Grained Control via Aggregation of Multiple Diffusion Modelscited by 0
  18. 2025Training Free Stylized Abstractioncited by 0
  19. 2025Break Stylistic Sophon: Are We Really Meant to Confine the Imagination in Style Transfer?cited by 0
  20. 2025Mitigating Semantic Collapse in Generative Personalization with Test-Time Embedding Adjustmentcited by 0
  21. 2025SafeCtrl: Region-Based Safety Control for Text-to-Image Diffusion via Detect-Then-Suppresscited by 0
  22. 2025Image Generation Based on Image Style Extractioncited by 0
  23. 2025Inversion-Free Style Transfer with Dual Rectified Flowscited by 0
  24. 2026Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integrationcited by 0
  25. 2026Adaptive Subspace Projection for Generative Personalizationcited by 0
  26. 2026GeM-NR: Geometry-Aware Multi-View Editing for Nonrigid Scene Changescited by 0
  27. 2026RankT2I: A Submodular Framework for Discovering Interpretable and Diverse Semantics in Text-to-Image Modelscited by 0
  28. 2026QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editingcited by 0