NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
Not on the map. Why?
Abstract (arXiv)
Low-Rank Adaptation (LoRA) fusion enables the composition of subject and style representations for controllable generation without retraining. However, existing approaches primarily operate through weight-level merging, without explicitly modeling how independently trained LoRAs interact in the shared parameter space. We adopt a geometric perspective on LoRA fusion, interpreting content and style LoRAs as occupying overlapping, non-orthogonal low-rank subspaces, where such overlap can lead to conflicting parameter updates that affect generation quality. This observation motivates us to reformulate LoRA fusion not merely as parameter combination, but as a problem of controlling how updates from overlapping subspaces are combined. Based on this insight, we propose Null Space Projection LoRA (NP-LoRA), a training-free framework that employs projection as a fusion operator to explicitly modulate cross-LoRA interactions. Specifically, NP-LoRA uses principal directions of the style LoRA to define a projection subspace and projects the content LoRA onto the complementary subspace (i.e., the null space of the style LoRA), suppressing interference along dominant style directions while preserving complementary information. To avoid the overly aggressive suppression of hard projection, we further formulate soft projection as a regularized optimization problem that balances content preservation against style-subspace suppression. This objective admits a closed-form solution, yielding a projection operator controlled by a single parameter that continuously interpolates between linear merging and hard projection. Extensive experiments across multiple pretrained LoRA pairs show that NP-LoRA achieves more balanced content-style composition compared to strong baselines, without requiring retraining.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 48 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
44 of 48 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 377
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
32 more
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023VeRA: Vector-based Random Matrix Adaptationcited by 300
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 255
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2024Model merging with SVD to tie the Knotscited by 122
- 2023From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Modelscited by 98
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
- 2023Delta-LoRA: Fine-Tuning High-Rank Parameters with the Delta of Low-Rank Matricescited by 74
- 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
- 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
- 2024LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluationcited by 38
- 2024How to Continually Adapt Text-to-Image Diffusion Models for Flexible Customization?cited by 33
- 2024MC2: Multi-concept Guidance for Customized Multi-concept Generationcited by 26
- 2025OPLoRA: Orthogonal Projection LoRA Prevents Catastrophic Forgetting during Parameter-Efficient Fine-Tuningcited by 21
- 2024LoRACLR: Contrastive Adaptation for Customization of Diffusion Modelscited by 20
- 2025DuoLoRA : Cycle-consistent and Rank-disentangled Content-Style Personalizationcited by 10
- 2025LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusioncited by 7
- 2025Subject or Style: Adaptive and Training-Free Mixture of LoRAscited by 5
- 2025Zero-Shot Adaptation of Parameter-Efficient Fine-Tuning in Diffusion Modelscited by 3
- 2025Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropoutcited by 3
- 2025SubZero: Composing Subject, Style, and Action via Zero-Shot Personalizationcited by 2
Built on by
Not cited yet.