A Training-Free Style-Personalization via SVD-Based Feature Decomposition
Not on the map. Why?
Abstract (arXiv)
We present a training-free framework for style-personalized image generation that operates during inference using a scale-wise autoregressive model. Our method generates a stylized image guided by a single reference style while preserving semantic consistency and mitigating content leakage. Through a detailed step-wise analysis of the generation process, we identify a pivotal step where the dominant singular values of the internal feature encode style-related components. Building upon this insight, we introduce two lightweight control modules: Principal Feature Blending, which enables precise modulation of style through SVD-based feature reconstruction, and Structural Attention Correction, which stabilizes structural consistency by leveraging content-guided attention correction across fine stages. Without any additional training, extensive experiments demonstrate that our method achieves competitive style fidelity and prompt fidelity compared to fine-tuned baselines, while offering faster inference and greater deployment flexibility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 64 references that are in the map. First posted on arXiv 6 Jul 2025.
Builds on
51 of 64 references.
References · 51
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
38 more
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2017Universal Style Transfer via Feature Transformscited by 354
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
- 2023Style Aligned Image Generation via Shared Attentioncited by 216
- 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 198
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 196
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 132
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
- 2020Arbitrary Style Transfer via Multi-Adaptation Networkcited by 70
- 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfercited by 59
- 2019Attention-aware Multi-stroke Style Transfercited by 47
- 2019A Closed-form Solution to Universal Style Transfercited by 42
- 2023Training-free Content Injection using h-space in Diffusion Modelscited by 36
- 2023AesPA-Net: Aesthetic Pattern-Aware Style Transfer Networkscited by 34
- 2024Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesiscited by 33
- 2024UnZipLoRA: Separating Content and Style from a Single Imagecited by 24
- 2025A Training-Free Style-aligned Image Generation with Scale-wise Autoregressive Modelcited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.