AttenST: A Training-Free Attention-Driven Style Transfer Framework with Pre-Trained Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
While diffusion models have achieved remarkable progress in style transfer tasks, existing methods typically rely on fine-tuning or optimizing pre-trained models during inference, leading to high computational costs and challenges in balancing content preservation with style integration. To address these limitations, we introduce AttenST, a training-free attention-driven style transfer framework. Specifically, we propose a style-guided self-attention mechanism that conditions self-attention on the reference style by retaining the query of the content image while substituting its key and value with those from the style image, enabling effective style feature integration. To mitigate style information loss during inversion, we introduce a style-preserving inversion strategy that refines inversion accuracy through multiple resampling steps. Additionally, we propose a content-aware adaptive instance normalization, which integrates content statistics into the normalization process to optimize style fusion while mitigating the content degradation. Furthermore, we introduce a dual-feature cross-attention mechanism to fuse content and style features, ensuring a harmonious synthesis of structural fidelity and stylistic expression. Extensive experiments demonstrate that AttenST outperforms existing methods, achieving state-of-the-art performance in style transfer dataset.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 45 of its 54 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
45 of 54 references.
Closest ancestors · 16
Same direction, newest first
- 2024FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editing25 Jul
- 2024Visual Style Prompting with Swapping Self-Attention20 Feb
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
- 2023MoEController: Instruction-based Arbitrary Image Manipulation with Mixture-of-Expert Controllers8 Sep
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models15 Aug
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing28 Mar
- 2023Training-free Content Injection using h-space in Diffusion Models27 Mar
- 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfer15 Mar
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Inversion-Based Style Transfer with Diffusion Models23 Nov
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
4 more
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representation30 Sep
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance10 Dec
Other references · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
17 more
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 166
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2020Arbitrary Style Transfer via Multi-Adaptation Networkcited by 70
- 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 51
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
- 2017Aesthetic-Driven Image Enhancement by Adversarial Learningcited by 38
- 2023AesPA-Net: Aesthetic Pattern-Aware Style Transfer Networkscited by 34
- 2025StyleSSP: Sampling StartPoint Enhancement for Training-free Diffusion-based Method for Style Transfercited by 23
- 2018A Unified Framework for Generalizable Style Transfer: Style and Content Separationcited by 11
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2026StyleGallery: Training-free and Semantic-aware Personalized Style Transfer from Arbitrary Image Referencescited by 2
- 2025SCAdapter: Content-Style Disentanglement for Diffusion Style Transfercited by 1
- 2025RichControl: Structure- and Appearance-Rich Training-Free Spatial Control for Text-to-Image Generationcited by 0
- 2025SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Modelcited by 0
- 2025Screen, Cache, and Match: A Training-Free Causality-Consistent Reference Frame Framework for Human Animationcited by 0
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfercited by 0
- 2026Heterogeneous Model Fusion for Privacy-Aware Multi-Camera Surveillance via Synthetic Domain Adaptationcited by 0
- 2026Scheduled Style Injection: Expanding the Style-Content Pareto Frontier in Training-Free Diffusion-based Style Transfercited by 0
- 2026Scheduled Style Injection: Expanding the Style-Content Pareto Frontier in Training-Free Diffusion-based Style Transfer26 May 2026
- 2026Heterogeneous Model Fusion for Privacy-Aware Multi-Camera Surveillance via Synthetic Domain Adaptation4 May 2026
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer14 Apr 2026
- 2026StyleGallery: Training-free and Semantic-aware Personalized Style Transfer from Arbitrary Image References11 Mar 2026
- 2025SCAdapter: Content-Style Disentanglement for Diffusion Style Transfer15 Dec 2025
- 2025Screen, Cache, and Match: A Training-Free Causality-Consistent Reference Frame Framework for Human Animation13 Dec 2025
- 2025SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Model13 Oct 2025
- 2025RichControl: Structure- and Appearance-Rich Training-Free Spatial Control for Text-to-Image Generation3 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026TRACE: Time-Adaptive Residual Attention Control with Content-Style Decomposition for Training-Free Diffusion Style Transfer
- 2024Tuning-Free Adaptive Style Incorporation for Structure-Consistent Text-Driven Style Transfer
- 2025ICAS: IP Adapter and ControlNet-based Attention Structure for Multi-Subject Style Transfer Optimization
- 2023Z^*: Zero-shot Style Transfer via Attention Rearrangement
- 2024DiffuseST: Unleashing the Capability of the Diffusion Model for Style Transfer
- 2026HAM: A Training-Free Style Transfer Approach via Heterogeneous Attention Modulation for Diffusion Models
- 2025Leveraging Diffusion Models for Stylization using Multiple Style Images
- 2024Harnessing the Latent Diffusion Model for Training-Free Image Style Transfer