FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalization
Not on the map. Why?
Abstract (arXiv)
Subject-driven image generation plays a crucial role in applications such as virtual try-on and poster design. Existing approaches typically fine-tune pretrained generative models or apply LoRA-based adaptations for individual subjects. However, these methods struggle with multi-subject personalization, as combining independently adapted modules often requires complex re-tuning or joint optimization. We present FreeLoRA, a simple and generalizable framework that enables training-free fusion of subject-specific LoRA modules for multi-subject personalization. Each LoRA module is adapted on a few images of a specific subject using a Full Token Tuning strategy, where it is applied across all tokens in the prompt to encourage weakly supervised token-content alignment. At inference, we adopt Subject-Aware Inference, activating each module only on its corresponding subject tokens. This enables training-free fusion of multiple personalized subjects within a single image, while mitigating overfitting and mutual interference between subjects. Extensive experiments show that FreeLoRA achieves strong performance in both subject fidelity and prompt consistency.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 51 of its 56 references that are in the map. First posted on arXiv 2 Jul 2025.
Builds on
51 of 56 references.
References · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
38 more
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2024OmniGen: Unified Image Generationcited by 388
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 208
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2024Randomized Autoregressive Visual Generationcited by 125
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2024MaskBit: Embedding-free Image Generation via Bit Tokenscited by 96
- 2025DreamO: A Unified Framework for Image Customizationcited by 82
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
- 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
- 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
- 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
- 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2024How to Continually Adapt Text-to-Image Diffusion Models for Flexible Customization?cited by 32
- 2024BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Modelscited by 27
- 2025Personalize Anything for Free with Diffusion Transformercited by 22
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
- 2024MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Modelscited by 14
- 2025Fine-Tuning Visual Autoregressive Models for Subject-Driven Generationcited by 13
- 2025Flux Already Knows -- Activating Subject-Driven Image Generation without Trainingcited by 11
- 2024Contrastive Test-Time Composition of Multiple LoRA Models for Image Generationcited by 9
- 2025Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generationcited by 6
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026ReStyle-TTS: Relative and Continuous Style Control for Zero-Shot Speech Synthesiscited by 5
- 2025DCoAR: Deep Concept Injection into Unified Autoregressive Models for Personalized Text-to-Image Generationcited by 1
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generationcited by 0
- 2026Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weightingcited by 0
- 2026CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Secondscited by 0
- 2026CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Seconds1 Aug 2026
- 2026Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting2 Jun 2026
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
- 2026ReStyle-TTS: Relative and Continuous Style Control for Zero-Shot Speech Synthesis7 Jan 2026
- 2025DCoAR: Deep Concept Injection into Unified Autoregressive Models for Personalized Text-to-Image Generation10 Aug 2025