mlsanityData to 14 Oct 2026

A Training-Free Style-Personalization via SVD-Based Feature Decomposition

arXiv 2507.04482 ↗First posted 6 Jul 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a training-free framework for style-personalized image generation that operates during inference using a scale-wise autoregressive model. Our method generates a stylized image guided by a single reference style while preserving semantic consistency and mitigating content leakage. Through a detailed step-wise analysis of the generation process, we identify a pivotal step where the dominant singular values of the internal feature encode style-related components. Building upon this insight, we introduce two lightweight control modules: Principal Feature Blending, which enables precise modulation of style through SVD-based feature reconstruction, and Structural Attention Correction, which stabilizes structural consistency by leveraging content-guided attention correction across fine stages. Without any additional training, extensive experiments demonstrate that our method achieves competitive style fidelity and prompt fidelity compared to fine-tuned baselines, while offering faster inference and greater deployment flexibility.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 64 references that are in the map. First posted on arXiv 6 Jul 2025.

Builds on

51 of 64 references.

References · 51

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2017Neural Discrete Representation Learningcited by 4,712
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  12. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
38 more
  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  2. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  4. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  5. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  6. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  7. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  8. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  9. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  10. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
  11. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  12. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  13. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  14. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  15. 2017Universal Style Transfer via Feature Transformscited by 354
  16. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  17. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  18. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
  19. 2023Style Aligned Image Generation via Shared Attentioncited by 216
  20. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  21. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
  22. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 198
  23. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 196
  24. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  25. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  26. 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
  27. 2024Implicit Style-Content Separation using B-LoRAcited by 135
  28. 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 132
  29. 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
  30. 2020Arbitrary Style Transfer via Multi-Adaptation Networkcited by 70
  31. 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfercited by 59
  32. 2019Attention-aware Multi-stroke Style Transfercited by 47
  33. 2019A Closed-form Solution to Universal Style Transfercited by 42
  34. 2023Training-free Content Injection using h-space in Diffusion Modelscited by 36
  35. 2023AesPA-Net: Aesthetic Pattern-Aware Style Transfer Networkscited by 34
  36. 2024Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesiscited by 33
  37. 2024UnZipLoRA: Separating Content and Style from a Single Imagecited by 24
  38. 2025A Training-Free Style-aligned Image Generation with Scale-wise Autoregressive Modelcited by 4

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.