mlsanityData to 7 Oct 2026

ID-Patch: Robust ID Association for Group Photo Personalization

arXiv 2411.13632 ↗First posted 20 Nov 2024cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

The ability to synthesize personalized group photos and specify the positions of each identity offers immense creative potential. While such imagery can be visually appealing, it presents significant challenges for existing technologies. A persistent issue is identity (ID) leakage, where injected facial features interfere with one another, resulting in low face resemblance, incorrect positioning, and visual artifacts. Existing methods suffer from limitations such as the reliance on segmentation models, increased runtime, or a high probability of ID leakage. To address these challenges, we propose ID-Patch, a novel method that provides robust association between identities and 2D positions. Our approach generates an ID patch and ID embeddings from the same facial features: the ID patch is positioned on the conditional image for precise spatial control, while the ID embeddings integrate with text embeddings to ensure high resemblance. Experimental results demonstrate that ID-Patch surpasses baseline methods across metrics, such as face ID resemblance, ID-position association accuracy, and generation efficiency. Project Page is: https://byteaigc.github.io/ID-Patch/

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 50 of its 61 references that are in the map. First posted on arXiv 20 Nov 2024.

Builds on

50 of 61 references.

References · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
38 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  2. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  3. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  5. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  6. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  7. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
  8. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  9. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  10. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  11. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  12. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  13. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  14. 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
  15. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  16. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  17. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  18. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  19. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
  20. 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
  21. 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Nowcited by 204
  22. 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
  23. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  24. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  25. 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Modelscited by 164
  26. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  27. 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
  28. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
  29. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  30. 2023Inserting Anybody in Diffusion Models via Celeb Basiscited by 63
  31. 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
  32. 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
  33. 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 46
  34. 2023Enhancing Detail Preservation for Customized Text-to-Image Generation: A Regularization-Free Approachcited by 43
  35. 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
  36. 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30
  37. 2024DisDet: Exploring Detectability of Backdoor Attack on Diffusion Modelscited by 17
  38. 2023COMCAT: Towards Efficient Compression and Customization of Attention-Based Vision Modelscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 7; 2026: 2.

11 papers.