mlsanityData to 7 Oct 2026

PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding

arXiv 2312.04461 ↗First posted 7 Dec 2023cs.CV cs.AI cs.LGcited by 324

Not on the map. Why?

Cited by 125 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advances in text-to-image generation have made remarkable progress in synthesizing realistic human photos conditioned on given text prompts. However, existing personalized generation methods cannot simultaneously satisfy the requirements of high efficiency, promising identity (ID) fidelity, and flexible text controllability. In this work, we introduce PhotoMaker, an efficient personalized text-to-image generation method, which mainly encodes an arbitrary number of input ID images into a stack ID embedding for preserving ID information. Such an embedding, serving as a unified ID representation, can not only encapsulate the characteristics of the same input ID comprehensively, but also accommodate the characteristics of different IDs for subsequent integration. This paves the way for more intriguing and practically valuable applications. Besides, to drive the training of our PhotoMaker, we propose an ID-oriented data construction pipeline to assemble the training data. Under the nourishment of the dataset constructed through the proposed pipeline, our PhotoMaker demonstrates better ID preservation ability than test-time fine-tuning based methods, yet provides significant speed improvements, high-quality generation results, strong generalization capabilities, and a wide range of applications. Our project page is available at https://photo-maker.github.io/

Key facts. Cited by 324 papers in the map (data through 7 Oct 2026). Builds on 65 of its 82 references that are in the map. First posted on arXiv 7 Dec 2023.

Builds on

65 of 82 references.

References · 65

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
38 more
  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  8. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  13. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  14. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  15. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  16. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  17. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  18. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  19. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  20. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  21. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  22. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  23. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  24. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  25. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  26. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  27. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  28. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  29. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  30. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  31. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  32. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
  33. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 210
  34. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  35. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  36. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
  37. 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
  38. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 118; 2025: 139; 2026: 67.

324 papers.

Sort:

By area:

  1. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  2. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  3. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  4. 2024In-Context LoRA for Diffusion Transformerscited by 155
  5. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  6. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  7. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
  8. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  9. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  10. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  11. 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
  12. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
38 more
  1. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 93
  2. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 85
  3. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
  4. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
  5. 2025DreamO: A Unified Framework for Image Customizationcited by 82
  6. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  7. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 72
  8. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 67
  9. 2025Multi-subject Open-set Personalization in Video Generationcited by 65
  10. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  11. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  12. 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
  13. 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 49
  14. 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
  15. 2024Towards Understanding the Working Mechanism of Text-to-Image Diffusion Modelcited by 48
  16. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
  17. 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
  18. 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
  19. 2024DreamStory: Open-Domain Story Visualization by LLM-Guided Multi-Subject Consistent Diffusioncited by 46
  20. 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 46
  21. 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
  22. 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
  23. 2024One Diffusion to Generate Them Allcited by 41
  24. 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learningcited by 39
  25. 2024Infinite-ID: Identity-preserved Personalization via ID-semantics Decoupling Paradigmcited by 38
  26. 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 37
  27. 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 37
  28. 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 36
  29. 2024CLEAR: Character Unlearning in Textual and Visual Modalitiescited by 36
  30. 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
  31. 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identitycited by 34
  32. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 32
  33. 2024FlashFace: Human Image Personalization with High-fidelity Identity Preservationcited by 31
  34. 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
  35. 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30
  36. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  37. 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
  38. 2024DreamOmni: Unified Image Generation and Editingcited by 29

50 most cited of 324 All 324 (JSON)