FreeFuse: Multi-Subject LoRA Fusion via Adaptive Token-Level Routing at Test Time
Not on the map. Why?
Abstract (arXiv)
This paper proposes FreeFuse, a training-free framework for multi-subject text-to-image generation through automatic fusion of multiple subject LoRAs. In contrast to prior studies that focus on retraining LoRAs to alleviate feature conflicts, our analysis shows that spatially routing LoRA residuals to their intended semantic regions provides an effective mechanism for suppressing direct cross-region LoRA interference while preserving the base model's global contextual reasoning. Accordingly, we implement Adaptive Token-Level Routing during the inference phase. However, obtaining reliable routing regions remains challenging. Existing methods that rely on text-image latent association, such as raw cross-attention or concept-level similarity matching, often suffer from sparse activations, hole artifacts, and unstable localization when handling visually similar subjects, leading to incomplete or ambiguous subject masks. To address these issues, we introduce FreeFuseAttn, a mechanism that exploits the flow matching model's intrinsic semantic alignment to dynamically match subject-specific tokens to their corresponding spatial regions at early denoising timesteps, thereby bypassing the need for external segmentors. FreeFuse distinguishes itself through high practicality: it necessitates no additional training, model modifications, or user-defined spatial constraints. Users need only provide subject activation words to achieve seamless integration into standard workflows. Extensive experiments validate that FreeFuse outperforms existing approaches in both identity preservation and compositional fidelity. The project page is at: https://future-item.github.io/FreeFuse/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 76 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
59 of 76 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2025DINOv3cited by 1,414
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2024OmniGen: Unified Image Generationcited by 394
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 375
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2022Perception Prioritized Training of Diffusion Modelscited by 303
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2023Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusioncited by 131
- 2023Navigating Text-To-Image Customization: From LyCORIS Fine-Tuning to Model Evaluationcited by 109
- 2023Open-vocabulary Object Segmentation with Diffusion Modelscited by 82
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
- 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
- 2025SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learningcited by 63
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
- 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 55
- 2023Readout Guidance: Learning Control from Diffusion Featurescited by 52
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 52
- 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 52
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
- 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
- 2024MC2: Multi-concept Guidance for Customized Multi-concept Generationcited by 26
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025AutoLoRA: Automatic LoRA Retrieval and Fine-Grained Gated Fusion for Text-to-Image Generation
- 2025TARA: Token-Aware LoRA for Composable Personalization in Diffusion Models
- 2025LoRAtorio: An intrinsic approach to LoRA Skill Composition
- 2026Gaussian Core LoRA: Distribution-Aware Dynamic Adaptation for Broad Concept Erasure
- 2024In-Context LoRA for Diffusion Transformers
- 2024LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation
- 2025Cached Multi-Lora Composition for Multi-Concept Image Generation
- 2026Discovering Undisclosed Concepts in LoRA Adapters for Diffusion-Based AIGC Models