AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvas
Not on the map. Why?
Abstract (arXiv)
Multi-person identity-preserving generation requires binding multiple reference faces to specified locations under a text prompt. Strong identity/layout conditions often trigger copy-paste shortcuts and weaken prompt-driven controllability. We present AnyPhoto, a diffusion-transformer finetuning framework with (i) a RoPE-aligned location canvas plus location-aligned token pruning for spatial grounding, (ii) AdaLN-style identity-adaptive modulation from face-recognition embeddings for persistent identity injection, and (iii) identity-isolated attention to prevent cross-identity interference. Training combines conditional flow matching with an embedding-space face similarity loss, together with reference-face replacement and location-canvas degradations to discourage shortcuts. On MultiID-Bench, AnyPhoto improves identity similarity while reducing copy-paste tendency, with gains increasing as the number of identities grows. AnyPhoto also supports prompt-driven stylization with accurate placement, showing great potential application value.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 56 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
51 of 56 references.
References · 51
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024GPT-4o System Cardcited by 4,467
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
38 more
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2024OmniGen: Unified Image Generationcited by 388
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2024Arc2Face: A Foundation Model for ID-Consistent Human Facescited by 101
- 2025DreamO: A Unified Framework for Image Customizationcited by 82
- 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 77
- 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 56
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 55
- 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 51
- 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 46
- 2024Infinite-ID: Identity-preserved Personalization via ID-semantics Decoupling Paradigmcited by 38
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
- 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identitycited by 34
- 2025EliGen: Entity-Level Controlled Image Generation with Regional Attentioncited by 32
- 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
- 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 27
- 2025USO: Unified Style and Subject-Driven Generation via Disentangled and Reward Learningcited by 26
- 2023High-fidelity Person-centric Subject-to-Image Synthesiscited by 21
- 2023MagiCapture: High-Resolution Multi-Concept Portrait Customizationcited by 20
- 2025InstantCharacter: Personalize Any Characters with a Scalable Diffusion Transformer Frameworkcited by 19
- 2024IFAdapter: Instance Feature Control for Grounded Text-to-Image Generationcited by 18
- 2025UMO: Scaling Multi-Identity Consistency for Image Customization via Matching Rewardcited by 18
- 2025ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance Generationcited by 17
- 2025AnyStory: Towards Unified Single and Multiple Subject Personalization in Text-to-Image Generationcited by 16
- 2025WithAnyone: Towards Controllable and ID Consistent Image Generationcited by 16
- 2024ID-Patch: Robust ID Association for Group Photo Personalizationcited by 11
- 2025Create Anything Anywhere: Layout-Controllable Personalized Diffusion Model for Multiple Subjectscited by 3
- 2025CanvasComposer: Personalized Group Photo Generation via a Multi-Reference Canvascited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023When StyleGAN Meets Stable Diffusion: a mathscrW_+ Adapter for Personalized Image Generation
- 2026Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models
- 2025Learning Joint ID-Textual Representation for ID-Preserving Image Synthesis
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization
- 2026When Diffusion Models Forget Who You Are: Identity Preservation in Face Inpainting under Large Occlusions
- 2026IdGlow: Dynamic Identity Modulation for Multi-Subject Generation
- 2025IC-Portrait: In-Context Matching for View-Consistent Personalized Portrait
- 2024Beyond Inserting: Learning Identity Embedding for Semantic-Fidelity Personalized Diffusion Generation