mlsanityData to 7 Oct 2026

FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalization

arXiv 2507.01792 ↗First posted 2 Jul 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Subject-driven image generation plays a crucial role in applications such as virtual try-on and poster design. Existing approaches typically fine-tune pretrained generative models or apply LoRA-based adaptations for individual subjects. However, these methods struggle with multi-subject personalization, as combining independently adapted modules often requires complex re-tuning or joint optimization. We present FreeLoRA, a simple and generalizable framework that enables training-free fusion of subject-specific LoRA modules for multi-subject personalization. Each LoRA module is adapted on a few images of a specific subject using a Full Token Tuning strategy, where it is applied across all tokens in the prompt to encourage weakly supervised token-content alignment. At inference, we adopt Subject-Aware Inference, activating each module only on its corresponding subject tokens. This enables training-free fusion of multiple personalized subjects within a single image, while mitigating overfitting and mutual interference between subjects. Extensive experiments show that FreeLoRA achieves strong performance in both subject fidelity and prompt consistency.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 51 of its 56 references that are in the map. First posted on arXiv 2 Jul 2025.

Builds on

51 of 56 references.

References · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  8. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  9. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  10. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  11. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  12. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
38 more
  1. 2024Autoregressive Image Generation without Vector Quantizationcited by 644
  2. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  3. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  4. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  5. 2024OmniGen: Unified Image Generationcited by 388
  6. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  7. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  8. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  9. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  10. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  11. 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 208
  12. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  13. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  14. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  15. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
  16. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  17. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
  18. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  19. 2024Randomized Autoregressive Visual Generationcited by 125
  20. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  21. 2024MaskBit: Embedding-free Image Generation via Bit Tokenscited by 96
  22. 2025DreamO: A Unified Framework for Image Customizationcited by 82
  23. 2024Multi-LoRA Composition for Image Generationcited by 80
  24. 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
  25. 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
  26. 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
  27. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  28. 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
  29. 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
  30. 2024How to Continually Adapt Text-to-Image Diffusion Models for Flexible Customization?cited by 32
  31. 2024BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Modelscited by 27
  32. 2025Personalize Anything for Free with Diffusion Transformercited by 22
  33. 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
  34. 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Modelscited by 14
  35. 2025Fine-Tuning Visual Autoregressive Models for Subject-Driven Generationcited by 13
  36. 2025Flux Already Knows -- Activating Subject-Driven Image Generation without Trainingcited by 11
  37. 2024Contrastive Test-Time Composition of Multiple LoRA Models for Image Generationcited by 9
  38. 2025Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generationcited by 6

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.