mlsanityData to 7 Oct 2026

Meta-LoRA: Meta-Learning LoRA Components for Domain-Aware ID Personalization

arXiv 2503.22352 ↗First posted 28 Mar 2025cs.CVcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent advancements in text-to-image generative models, particularly latent diffusion models (LDMs), have demonstrated remarkable capabilities in synthesizing high-quality images from textual prompts. However, achieving identity personalization-ensuring that a model consistently generates subject-specific outputs from limited reference images-remains a fundamental challenge. To address this, we introduce Meta-Low-Rank Adaptation (Meta-LoRA), a novel framework that leverages meta-learning to encode domain-specific priors into LoRA-based identity personalization. Our method introduces a structured three-layer LoRA architecture that separates identity-agnostic knowledge from identity-specific adaptation. In the first stage, the LoRA Meta-Down layers are meta-trained across multiple subjects, learning a shared manifold that captures general identity-related features. In the second stage, only the LoRA-Mid and LoRA-Up layers are optimized to specialize on a given subject, significantly reducing adaptation time while improving identity fidelity. To evaluate our approach, we introduce Meta-PHD, a new benchmark dataset for identity personalization, and compare Meta-LoRA against state-of-the-art methods. Our results demonstrate that Meta-LoRA achieves superior identity retention, computational efficiency, and adaptability across diverse identity conditions. Our code, model weights, and dataset are released on barisbatuhan.github.io/Meta-LoRA.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 30 of its 34 references that are in the map. First posted on arXiv 28 Mar 2025.

Builds on

30 of 34 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024HiFiVFS: High Fidelity Video Face Swapping27 Nov
  2. 2024FouRA: Fourier Low Rank Adaptation13 Jun
  3. 2024A Survey on Personalized Content Synthesis with Diffusion Models9 May
  4. 2024LCM-Lookahead for Encoder-based Text-to-Image Personalization4 Apr
  5. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
  6. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization11 Dec
  7. 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Models11 Sep
  8. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  9. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention17 May
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  11. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  12. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  7. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  8. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  9. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  10. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  11. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  12. 2023VeRA: Vector-based Random Matrix Adaptationcited by 294
6 more
  1. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  2. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
  3. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  4. 2024Parameter-Efficient Fine-Tuning with Discrete Fourier Transformcited by 67
  5. 2024VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Bankscited by 52
  6. 2024Face Anonymization Made Simplecited by 18

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion
  2. 2025TARA: Token-Aware LoRA for Composable Personalization in Diffusion Models
  3. 2024LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
  4. 2026Diffu-LoRA: A Novel Low-Rank Adaptation for Personalized Diffusion Models
  5. 2026Not All Layers Are Created Equal: Adaptive LoRA Ranks for Personalized Image Generation
  6. 2026Training-Free Multi-Concept LoRA Composition with Prompt-Aware Weighting
  7. 2025Taming Identity Consistency and Prompt Diversity in Diffusion Models via Latent Concatenation and Masked Conditional Flow Matching
  8. 2026ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets