BeyondFacial: Identity-Preserving Personalized Generation Beyond Facial Close-ups
Not on the map. Why?
Abstract (arXiv)
Identity-Preserving Personalized Generation (IPPG) has advanced film production and artistic creation, yet existing approaches overemphasize facial regions, resulting in outputs dominated by facial close-ups.These methods suffer from weak visual narrativity and poor semantic consistency under complex text prompts, with the core limitation rooted in identity (ID) feature embeddings undermining the semantic expressiveness of generative models. To address these issues, this paper presents an IPPG method that breaks the constraint of facial close-ups, achieving synergistic optimization of identity fidelity and scene semantic creation. Specifically, we design a Dual-Line Inference (DLI) pipeline with identity-semantic separation, resolving the representation conflict between ID and semantics inherent in traditional single-path architectures. Further, we propose an Identity Adaptive Fusion (IdAF) strategy that defers ID-semantic fusion to the noise prediction stage, integrating adaptive attention fusion and noise decision masking to avoid ID embedding interference on semantics without manual masking. Finally, an Identity Aggregation Prepending (IdAP) module is introduced to aggregate ID information and replace random initializations, further enhancing identity preservation. Experimental results validate that our method achieves stable and effective performance in IPPG tasks beyond facial close-ups, enabling efficient generation without manual masking or fine-tuning. As a plug-and-play component, it can be rapidly deployed in existing IPPG frameworks, addressing the over-reliance on facial close-ups, facilitating film-level character-scene creation, and providing richer personalized generation capabilities for related domains.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 15 Nov 2025.
Builds on
33 of 39 references.
References · 33
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
21 more
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 284
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2019Semantic Object Accuracy for Generative Text-to-Image Synthesiscited by 89
- 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
- 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 77
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
- 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
- 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 75
- 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
- 2023Inserting Anybody in Diffusion Models via Celeb Basiscited by 63
- 2023FaceStudio: Put Your Face Everywhere in Secondscited by 53
- 2023DreamTuner: Single Image is Enough for Subject-Driven Generationcited by 41
- 2023MagicFusion: Boosting Text-to-Image Generation Performance by Fusing Diffusion Modelscited by 16
- 2023Null-text Guidance in Diffusion Models is Secretly a Cartoon-style Creatorcited by 12
- 2023Photorealistic and Identity-Preserving Image-Based Emotion Manipulation with Latent Diffusion Modelscited by 5
- 2024MagicNaming: Consistent Identity Generation by Finding a "Name Space" in T2I Diffusion Modelscited by 5
Built on by
Not cited yet.