ID-Patch: Robust ID Association for Group Photo Personalization
Not on the map. Why?
Abstract (arXiv)
The ability to synthesize personalized group photos and specify the positions of each identity offers immense creative potential. While such imagery can be visually appealing, it presents significant challenges for existing technologies. A persistent issue is identity (ID) leakage, where injected facial features interfere with one another, resulting in low face resemblance, incorrect positioning, and visual artifacts. Existing methods suffer from limitations such as the reliance on segmentation models, increased runtime, or a high probability of ID leakage. To address these challenges, we propose ID-Patch, a novel method that provides robust association between identities and 2D positions. Our approach generates an ID patch and ID embeddings from the same facial features: the ID patch is positioned on the conditional image for precise spatial control, while the ID embeddings integrate with text embeddings to ensure high resemblance. Experimental results demonstrate that ID-Patch surpasses baseline methods across metrics, such as face ID resemblance, ID-position association accuracy, and generation efficiency. Project Page is: https://byteaigc.github.io/ID-Patch/
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 50 of its 61 references that are in the map. First posted on arXiv 20 Nov 2024.
Builds on
50 of 61 references.
References · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
38 more
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Nowcited by 204
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Modelscited by 164
- 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
- 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
- 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
- 2023Inserting Anybody in Diffusion Models via Celeb Basiscited by 63
- 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
- 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
- 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 46
- 2023Enhancing Detail Preservation for Customized Text-to-Image Generation: A Regularization-Free Approachcited by 43
- 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
- 2024Imagine yourself: Tuning-Free Personalized Image Generationcited by 30
- 2024DisDet: Exploring Detectability of Backdoor Attack on Diffusion Modelscited by 17
- 2023COMCAT: Towards Efficient Compression and Customization of Attention-Based Vision Modelscited by 14
Built on by
Citing papers per year: 2024: 2; 2025: 7; 2026: 2.
11 papers.
- 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
- 2025WithAnyone: Towards Controllable and ID Consistent Image Generationcited by 16
- 2024COAP: Memory-Efficient Training with Correlation-Aware Gradient Projectioncited by 8
- 2025Lynx: Towards High-Fidelity Personalized Video Generationcited by 8
- 2025Canvas-to-Image: Compositional Image Generation with Multimodal Controlscited by 5
- 2025CanvasComposer: Personalized Group Photo Generation via a Multi-Reference Canvascited by 3
- 2025The Linear Geometry of Interpretable Tokens: Jailbreaking Attacks and Defenses for Unlearned Diffusion Modelscited by 2
- 2025Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generationcited by 2
- 2024PersonaCraft: Personalized and Controllable Full-Body Multi-Human Scene Generation Using Occlusion-Aware 3D-Conditioned Diffusioncited by 1
- 2026AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvascited by 0
- 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generationcited by 0
- 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generation20 Aug 2026
- 2026AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvas16 Mar 2026
- 2025Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generation27 Nov 2025
- 2025Canvas-to-Image: Compositional Image Generation with Multimodal Controls26 Nov 2025
- 2025CanvasComposer: Personalized Group Photo Generation via a Multi-Reference Canvas23 Oct 2025
- 2025WithAnyone: Towards Controllable and ID Consistent Image Generation16 Oct 2025
- 2025Lynx: Towards High-Fidelity Personalized Video Generation19 Sep 2025
- 2025The Linear Geometry of Interpretable Tokens: Jailbreaking Attacks and Defenses for Unlearned Diffusion Models30 Apr 2025
- 2025Personalized Image Generation with Deep Generative Models: A Decade Survey18 Feb 2025
- 2024PersonaCraft: Personalized and Controllable Full-Body Multi-Human Scene Generation Using Occlusion-Aware 3D-Conditioned Diffusion27 Nov 2024
- 2024COAP: Memory-Efficient Training with Correlation-Aware Gradient Projection26 Nov 2024