mlsanityData to 14 Oct 2026

FreeFuse: Multi-Subject LoRA Fusion via Adaptive Token-Level Routing at Test Time

arXiv 2510.23515 ↗First posted 27 Oct 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper proposes FreeFuse, a training-free framework for multi-subject text-to-image generation through automatic fusion of multiple subject LoRAs. In contrast to prior studies that focus on retraining LoRAs to alleviate feature conflicts, our analysis shows that spatially routing LoRA residuals to their intended semantic regions provides an effective mechanism for suppressing direct cross-region LoRA interference while preserving the base model's global contextual reasoning. Accordingly, we implement Adaptive Token-Level Routing during the inference phase. However, obtaining reliable routing regions remains challenging. Existing methods that rely on text-image latent association, such as raw cross-attention or concept-level similarity matching, often suffer from sparse activations, hole artifacts, and unstable localization when handling visually similar subjects, leading to incomplete or ambiguous subject masks. To address these issues, we introduce FreeFuseAttn, a mechanism that exploits the flow matching model's intrinsic semantic alignment to dynamically match subject-specific tokens to their corresponding spatial regions at early denoising timesteps, thereby bypassing the need for external segmentors. FreeFuse distinguishes itself through high practicality: it necessitates no additional training, model modifications, or user-defined spatial constraints. Users need only provide subject activation words to achieve seamless integration into standard workflows. Extensive experiments validate that FreeFuse outperforms existing approaches in both identity preservation and compositional fidelity. The project page is at: https://future-item.github.io/FreeFuse/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 76 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

59 of 76 references.

References · 59

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
  1. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  6. 2025DINOv3cited by 1,414
  7. 2025Qwen-Image Technical Reportcited by 1,044
  8. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  9. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
  10. 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
  11. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  12. 2024OmniGen: Unified Image Generationcited by 394
  13. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 375
  14. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  15. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  16. 2022Perception Prioritized Training of Diffusion Modelscited by 303
  17. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  18. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
  19. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  20. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  21. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
  22. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  23. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  24. 2023Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusioncited by 131
  25. 2023Navigating Text-To-Image Customization: From LyCORIS Fine-Tuning to Model Evaluationcited by 109
  26. 2023Open-vocabulary Object Segmentation with Diffusion Modelscited by 82
  27. 2024Multi-LoRA Composition for Image Generationcited by 80
  28. 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
  29. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  30. 2025SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learningcited by 63
  31. 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
  32. 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 55
  33. 2023Readout Guidance: Learning Control from Diffusion Featurescited by 52
  34. 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 52
  35. 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 52
  36. 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
  37. 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
  38. 2024MC2: Multi-concept Guidance for Customized Multi-concept Generationcited by 26

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025AutoLoRA: Automatic LoRA Retrieval and Fine-Grained Gated Fusion for Text-to-Image Generation
  2. 2025TARA: Token-Aware LoRA for Composable Personalization in Diffusion Models
  3. 2025LoRAtorio: An intrinsic approach to LoRA Skill Composition
  4. 2026Gaussian Core LoRA: Distribution-Aware Dynamic Adaptation for Broad Concept Erasure
  5. 2024In-Context LoRA for Diffusion Transformers
  6. 2024LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation
  7. 2025Cached Multi-Lora Composition for Multi-Concept Image Generation
  8. 2026Discovering Undisclosed Concepts in LoRA Adapters for Diffusion-Based AIGC Models