mlsanityData to 7 Oct 2026

HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models

arXiv 2307.06949 ↗First posted 13 Jul 2023cs.CV cs.AI cs.GRcited by 224

Not on the map. Why?

Cited by 120 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Personalization has emerged as a prominent aspect within the field of generative AI, enabling the synthesis of individuals in diverse contexts and styles, while retaining high-fidelity to their identities. However, the process of personalization presents inherent challenges in terms of time and memory requirements. Fine-tuning each personalized model needs considerable GPU time investment, and storing a personalized model per subject can be demanding in terms of storage capacity. To overcome these challenges, we propose HyperDreamBooth - a hypernetwork capable of efficiently generating a small set of personalized weights from a single image of a person. By composing these weights into the diffusion model, coupled with fast finetuning, HyperDreamBooth can generate a person's face in various contexts and styles, with high subject details while also preserving the model's crucial knowledge of diverse styles and semantic modifications. Our method achieves personalization on faces in roughly 20 seconds, 25x faster than DreamBooth and 125x faster than Textual Inversion, using as few as one reference image, with the same quality and style diversity as DreamBooth. Also our method yields a model that is 10,000x smaller than a normal DreamBooth model. Project page: https://hyperdreambooth.github.io

Key facts. Cited by 224 papers in the map (data through 7 Oct 2026). Builds on 31 of its 39 references that are in the map. First posted on arXiv 13 Jul 2023.

Builds on

31 of 39 references.

References · 31

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  7. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  11. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  12. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
19 more
  1. 2016HyperNetworkscited by 1,003
  2. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  3. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  4. 2023Universal Guidance for Diffusion Modelscited by 426
  5. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  6. 2023Learning to Compress Prompts with Gist Tokenscited by 379
  7. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  8. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  9. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  10. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  11. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  12. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 210
  13. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  14. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  15. 2021Instance-Conditioned GANcited by 119
  16. 2023Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Modelscited by 116
  17. 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 77
  18. 2023Inserting Anybody in Diffusion Models via Celeb Basiscited by 63
  19. 2022HyperTuning: Toward Adapting Large Language Models without Back-propagationcited by 45

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 32; 2024: 99; 2025: 64; 2026: 29.

224 papers.

Sort:

By area:

  1. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  2. 2023Style Aligned Image Generation via Shared Attentioncited by 214
  3. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  4. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  5. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  6. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  7. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
  8. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 162
  9. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  10. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  11. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  12. 2023Navigating Text-To-Image Customization: From LyCORIS Fine-Tuning to Model Evaluationcited by 108
38 more
  1. 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
  2. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
  3. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
  4. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
  5. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
  6. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 72
  7. 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
  8. 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
  9. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  10. 2025Multi-subject Open-set Personalization in Video Generationcited by 65
  11. 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
  12. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  13. 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
  14. 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 58
  15. 2023DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedbackcited by 57
  16. 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Modelscited by 55
  17. 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
  18. 2024λ-ECLIPSE: Multi-Concept Personalized Text-to-Image Diffusion Models by Leveraging CLIP Latent Spacecited by 51
  19. 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
  20. 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
  21. 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
  22. 2024RB-Modulation: Training-Free Personalization of Diffusion Models using Stochastic Optimal Controlcited by 46
  23. 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 46
  24. 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Modelcited by 44
  25. 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
  26. 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 42
  27. 2023Alchemist: Parametric Control of Material Properties with Diffusion Modelscited by 38
  28. 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 37
  29. 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
  30. 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
  31. 2024Interpreting the Weight Space of Customized Diffusion Modelscited by 35
  32. 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Modelscited by 35
  33. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 34
  34. 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identitycited by 34
  35. 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 33
  36. 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
  37. 2024GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesiscited by 32
  38. 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30

50 most cited of 224 All 224 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Finetuning-Free Personalization of Text to Image Generation via Hypernetworks
  2. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds
  3. 2026Zero-Shot Personalization of Objects via Textual Inversion
  4. 2024JeDi: Joint-Image Diffusion Models for Finetuning-Free Personalized Text-to-Image Generation
  5. 2023Is This Loss Informative? Faster Text-to-Image Customization by Tracking Objective Dynamics
  6. 2024Dense-Face: Personalized Face Generation Model via Dense Annotation Prediction
  7. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models
  8. 2025Generating Synthetic Data via Augmentations for Improved Facial Resemblance in DreamBooth and InstantID