mlsanityData to 7 Oct 2026

FreeTuner: Any Subject in Any Style with Training-free Diffusion

arXiv 2405.14201 ↗First posted 23 May 2024cs.CVcited by 24

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

With the advance of diffusion models, various personalized image generation methods have been proposed. However, almost all existing work only focuses on either subject-driven or style-driven personalization. Meanwhile, state-of-the-art methods face several challenges in realizing compositional personalization, i.e., composing different subject and style concepts, such as concept disentanglement, unified reconstruction paradigm, and insufficient training data. To address these issues, we introduce FreeTuner, a flexible and training-free method for compositional personalization that can generate any user-provided subject in any user-provided style (see Figure 1). Our approach employs a disentanglement strategy that separates the generation process into two stages to effectively mitigate concept entanglement. FreeTuner leverages the intermediate features within the diffusion model for subject concept representation and introduces style guidance to align the synthesized images with the style concept, ensuring the preservation of both the subject's structure and the style's aesthetic features. Extensive experiments have demonstrated the generation ability of FreeTuner across various personalization settings.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 54 of its 59 references that are in the map. First posted on arXiv 23 May 2024.

Builds on

54 of 59 references.

Closest ancestors · 18

Same direction, newest first

  1. 2024Identity Decoupling for Multi-Subject Personalization of Text-to-Image Models5 Apr
  2. 2024DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representations11 Mar
  3. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition12 Dec
  4. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer11 Dec
  5. 2023Z^*: Zero-shot Style Transfer via Attention Rearrangement25 Nov
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  7. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion20 Jul
  8. 2023Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Models5 Apr
  9. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar
  10. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  12. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
6 more
  1. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  3. 2022Blended Latent Diffusion6 Jun
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  6. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov

Other references · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2023Segment Anythingcited by 8,158
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
24 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  2. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  3. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  4. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  5. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  6. 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 452
  7. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  8. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  9. 2017Universal Style Transfer via Feature Transformscited by 352
  10. 2023Scaling Open-Vocabulary Object Detectioncited by 335
  11. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  12. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  13. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  14. 2023Style Aligned Image Generation via Shared Attentioncited by 214
  15. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  16. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  17. 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 166
  18. 2017Demystifying Neural Style Transfercited by 152
  19. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
  20. 2024Implicit Style-Content Separation using B-LoRAcited by 135
  21. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  22. 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
  23. 2019A Closed-form Solution to Universal Style Transfercited by 42
  24. 2024Break-for-Make: Modular Low-Rank Adaptations for Composable Content-Style Customizationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 15; 2026: 4.

24 papers.

Sort:

By area:

  1. 2024InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generationcited by 51
  2. 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
  3. 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
  4. 2025StyleSSP: Sampling StartPoint Enhancement for Training-free Diffusion-based Method for Style Transfercited by 23
  5. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  6. 2024LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generationcited by 19
  7. 2025DreamPoster: A Unified Framework for Image-Conditioned Generative Poster Designcited by 15
  8. 2025Adv-CPG: A Customized Portrait Generation Framework with Facial Adversarial Attackscited by 13
  9. 2025ConsisLoRA: Enhancing Content and Style Consistency for LoRA-based Style Transfercited by 9
  10. 2025Training-Free Multi-Style Fusion Through Reference-Based Adaptive Modulationcited by 6
  11. 2024Training-free Color-Style Disentanglement for Constrained Text-to-Image Synthesiscited by 4
  12. 2025AIComposer: Any Style and Content Image Composition via Feature Integrationcited by 4
12 more
  1. 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
  2. 2024Di2Pose: Discrete Diffusion Model for Occluded 3D Human Pose Estimationcited by 2
  3. 2024Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matchingcited by 2
  4. 2025Inversion-Free Video Style Transfer with Trajectory Reset Attention Control and Content-Style Bridgingcited by 2
  5. 2025Zero-to-Hero: Zero-Shot Initialization Empowering Reference-Based Video Appearance Editingcited by 1
  6. 2025OmniStyle2: Learning to Stylize by Learning to Destylizecited by 1
  7. 2026Mixture of Style Experts for Diverse Image Stylizationcited by 1
  8. 2025Less is More: Masking Elements in Image Condition Features Avoids Content Leakages in Style Transfer Diffusion Modelscited by 0
  9. 2025MONKEY: Masking ON KEY-Value Activation Adapter for Personalizationcited by 0
  10. 2025Expanding the Content-Style Frontier: a Balanced Subspace Blending Approach for Content-Style LoRA Fusioncited by 0
  11. 2026AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfercited by 0
  12. 2026h-Flow: Flexible Flow-based Image Editing via Doob's h-Transformcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SubZero: Composing Subject, Style, and Action via Zero-Shot Personalization
  2. 2025Finetuning-Free Personalization of Text to Image Generation via Hypernetworks
  3. 2025Personalize Anything for Free with Diffusion Transformer
  4. 2024Pick-and-Draw: Training-free Semantic Guidance for Text-to-Image Personalization
  5. 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models
  6. 2024Ada-adapter:Fast Few-shot Style Personlization of Diffusion Model with Pre-trained Image Encoder
  7. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuning
  8. 2023Portrait Diffusion: Training-free Face Stylization with Chain-of-Painting