mlsanityData to 7 Oct 2026

ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs

arXiv 2311.13600 ↗First posted 22 Nov 2023cs.CV cs.GR cs.LGcited by 194

Not on the map. Why?

Cited by 74 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Methods for finetuning generative models for concept-driven personalization generally achieve strong results for subject-driven or style-driven generation. Recently, low-rank adaptations (LoRA) have been proposed as a parameter-efficient way of achieving concept-driven personalization. While recent work explores the combination of separate LoRAs to achieve joint generation of learned styles and subjects, existing techniques do not reliably address the problem; they often compromise either subject fidelity or style fidelity. We propose ZipLoRA, a method to cheaply and effectively merge independently trained style and subject LoRAs in order to achieve generation of any user-provided subject in any user-provided style. Experiments on a wide range of subject and style combinations show that ZipLoRA can generate compelling results with meaningful improvements over baselines in subject and style fidelity while preserving the ability to recontextualize. Project page: https://ziplora.github.io

Key facts. Cited by 194 papers in the map (data through 7 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

33 of 43 references.

References · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
21 more
  1. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  2. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  3. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  4. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  5. 2017Universal Style Transfer via Feature Transformscited by 352
  6. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  7. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  8. 2017Compressed Sensing using Generative Modelscited by 337
  9. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  10. 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
  11. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  12. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
  13. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  14. 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
  15. 2021JoJoGAN: One Shot Face Stylizationcited by 49
  16. 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
  17. 2021One-Shot Generative Domain Adaptationcited by 41
  18. 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
  19. 2022DreamArtist++: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adaptercited by 24
  20. 2022CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learningcited by 10
  21. 2022MultiStyleGAN: Multiple One-shot Image Stylizations using a Single GANcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 71; 2025: 71; 2026: 51.

194 papers.

Sort:

By area:

  1. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 247
  2. 2024Implicit Style-Content Separation using B-LoRAcited by 135
  3. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  4. 2024Model merging with SVD to tie the Knotscited by 118
  5. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  6. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 93
  7. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
  8. 2024Multi-LoRA Composition for Image Generationcited by 80
  9. 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
  10. 2024Towards Modular LLMs by Building and Reusing a Library of LoRAscited by 72
  11. 2024Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Effortscited by 71
  12. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
38 more
  1. 2024MagMax: Leveraging Model Merging for Seamless Continual Learningcited by 67
  2. 2024Learning to Route Among Specialized Experts for Zero-Shot Generalizationcited by 65
  3. 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
  4. 2024What Matters for Model Merging at Scale?cited by 52
  5. 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Spacecited by 51
  6. 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 51
  7. 2024LoRA Soups: Merging LoRAs for Practical Skill Composition Taskscited by 49
  8. 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
  9. 2024RB-Modulation: Training-Free Personalization of Diffusion Models using Stochastic Optimal Controlcited by 46
  10. 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 39
  11. 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
  12. 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
  13. 2024Interpreting the Weight Space of Customized Diffusion Modelscited by 35
  14. 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Reviewcited by 35
  15. 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Datacited by 32
  16. 2024Photorealistic Object Insertion with Diffusion-Guided Inverse Renderingcited by 27
  17. 2025RobustMerge: Parameter-Efficient Model Merging for MLLMs with Direction Robustnesscited by 25
  18. 2025We Should Chart an Atlas of All the World's Modelscited by 25
  19. 2024FreeTuner: Any Subject in Any Style with Training-free Diffusioncited by 24
  20. 2024Compress then Serve: Serving Thousands of LoRA Adapters with Little Overheadcited by 24
  21. 2024UnZipLoRA: Separating Content and Style from a Single Imagecited by 24
  22. 2024LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystemcited by 22
  23. 2024Edify Image: High-Quality Image Generation with Pixel Space Laplacian Diffusion Modelscited by 22
  24. 2025Personalize Anything for Free with Diffusion Transformercited by 22
  25. 2025Nested Attention: Semantic-aware Attention Values for Concept Personalizationcited by 21
  26. 2024LoRACLR: Contrastive Adaptation for Customization of Diffusion Modelscited by 20
  27. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  28. 2024LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generationcited by 19
  29. 2024Sparse High Rank Adapterscited by 17
  30. 2024Magic Insert: Style-Aware Drag-and-Dropcited by 17
  31. 2024Diffusion-Based Visual Art Creation: A Survey and New Perspectivescited by 17
  32. 2024Deep Linear Probe Generators for Weight Space Learningcited by 17
  33. 2024AlignGuard: Scalable Safety Alignment for Text-to-Image Generationcited by 17
  34. 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Imagescited by 16
  35. 2024Recovering the Pre-Fine-Tuning Weights of Generative Modelscited by 15
  36. 2024FouRA: Fourier Low Rank Adaptationcited by 15
  37. 2024SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Datacited by 14
  38. 2024Direct Consistency Optimization for Robust Customization of Text-to-Image Diffusion Modelscited by 12

50 most cited of 194 All 194 (JSON)